DEV Community

Cover image for Setting up a Data Engineering Environment
WanjohiChristopher
WanjohiChristopher

Posted on • Updated on

Setting up a Data Engineering Environment

Welcome back to our Data Engineering Series😊
Its now time to set up our environment!

Installing,Configuring and Setting Up VMware, MSSQL Server,Postgres and AdventureWorksDW&DB

When diving into the data engineering world, it is important for the set up to be ready.

To set up a data engineering environment it is advisable to work on Linux Environment.

To start with we started by using linux as a host machine.

Then we installed Virtual machine VMware. Then on the Vmware we installed the downloaded Windows operating system.

Now in order to make communication between host(Ubuntu) and virtual machine(Windows) we need to make configurations and networking on Vmware.You need to enable VNC connections as shown below.

Image description

Installation of MSSQL Server.

In this guide we walk you through the MSSQL Server installation in Windows on VMware.
The first step is to download SQL SERVER 2012. In this case it's the one we are using currently.
You can download it from here or download a later version. Then follow the instructions to install it,
then launch the SSMS(Sql Server Management Studio).The UI should be something like this:

Image description

Installation of Postgres Database on Ubuntu 20.04.

We will now install Postgres in our Ubuntu. To install this follow the installation steps here.

For Postgres configuration steps:

To check for Postgres version

     psql --version
Enter fullscreen mode Exit fullscreen mode




It is advisable to check if the Postgres is running using this command before you proceed


     sudo systemctl status postgresql
Enter fullscreen mode Exit fullscreen mode




Connection To PostgreSQL running.


     sudo -u postgres psql
Enter fullscreen mode Exit fullscreen mode




Installation of AdventureWorks2019 and AdventureWorksDW2019

First in order to start using the databases we start with installing Adventureworks2019 and DW.
To install follow the steps found here. Once installed we need to configure them in MSSQL Server on a virtual machine using these steps here.
After installation and configuration open SSMS and this should be the UI in SSMS:

Image description

Thanks and Happy Learning!

Article by
WanjohiChristopher

NicholasMusau
Respects:Neville Omwenga

Discussion (3)

Collapse
iamndeleva profile image
iamndeleva

Thanks for sharing

Collapse
elijahkungu profile image
Elijah

Thanks wanjohi we appreciate

Collapse
wanjohichristopher profile image
WanjohiChristopher Author

🙏