re: What Is The Difference Between A Data Engineer And A Data Scientist VIEW POST

re: Sounds about write. Scala is another language that can be used as a DE. I don't think it's weird. Personally, I enjoy the engineering style work o...

Also props for mentioning Luigi. Have you looked into Kedro? McKinsey's new open sourced thing. It's kind of neat. I've been using it for personal projects recently.

Oh man! No. It's so hard to keep up with all the new frameworks. But I will take a look.

The tutorial explains the features pretty well, it makes a sample regression pipeline that pre-process data and puts them into raw, processed, etc. folders.

I'm trying to see if I can combine it with tox and then maybe MLFlow for parameter saving.

code of conduct - report abuse