DEV Community

silverboi
silverboi

Posted on • Updated on

MLOps project setup: upload data to Hopsworks feature store

This is how the project will be looking after completing this step. Go see previous entries one, two and three if you want to follow along.
Architecture diagram

You'll need a Hopsworks account for this step so create one.

This is the complete code repo with the code to push a feature group to Hopsworks but basically what is happening is:

  1. retrieve data from Supabase database and load it into a pandas dataframe
  2. upload features into Hopsworks feature store

In between this two steps you can perform the following:

  • feature engineer, this is an optional step which I plan on completing later.
  • reassure data quality, this can be achieved through great expectations library this is also optional and for now I'm skipping this step

Here is a gist only with code for uploading feature groups.

Top comments (0)