How to deserialize a DataFrame dict into faust Record?

How to deserialize a DataFrame dict into faust Record?

May 18 '24 Comments: 1 Answers: 0

0

I'm using faust to process some data, the example model looks like this:

class MyModel(faust.Record)
    entry_id: uuid.uuid4
    metadata: json.loads
    timestamp: lambda x: pd.Timestamp(x, tz=None)
    _offset: int
    # ... some other int, str, bool fields

Note I'm using functions as field descriptors to process incoming fields Now, I need to pre-fetch…

Open Full Question