DEV Community

silverboi
silverboi

Posted on • Edited on

1

MLOps project setup: upload data to Hopsworks feature store

This is how the project will be looking after completing this step. Go see previous entries one, two and three if you want to follow along.
Architecture diagram

You'll need a Hopsworks account for this step so create one.

This is the complete code repo with the code to push a feature group to Hopsworks but basically what is happening is:

  1. retrieve data from Supabase database and load it into a pandas dataframe
  2. upload features into Hopsworks feature store

In between this two steps you can perform the following:

  • feature engineer, this is an optional step which I plan on completing later.
  • reassure data quality, this can be achieved through great expectations library this is also optional and for now I'm skipping this step

Here is a gist only with code for uploading feature groups.

Image of Datadog

The Essential Toolkit for Front-end Developers

Take a user-centric approach to front-end monitoring that evolves alongside increasingly complex frameworks and single-page applications.

Get The Kit

Top comments (0)

Postmark Image

Speedy emails, satisfied customers

Are delayed transactional emails costing you user satisfaction? Postmark delivers your emails almost instantly, keeping your customers happy and connected.

Sign up