DEV Community

Migrating Vector Database to the Cloud

MILVUS-LITE BACKUP / EXPORT
milvus-lite dump -d XavierEdgeAI.db -p /home/nvidia/nvme/AIM-XavierEdgeAI/backup/ -c XavierEdgeAI

Dump collection XavierEdgeAI’s data: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 33/33 [00:00<00:00, 188.54it/s]

Dump collection XavierEdgeAI success

Dump collection XavierEdgeAI’s data: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 33/33 [00:00<00:00, 127.16it/s]

Milvus-Lite to the Cloud
For many use cases we will want to distribute our local data to another computer, cluster or cloud. We could do that at the same time, in a batch, on a delay or at some other time.

Milvus-Lite Dump/Export to Cloud Import at some interval
Dual Ingest to local and other location concurrently
Switch to Cloud Only
Send JSON via Kafka / Pulsar / MQTT
Unstructured Data to MinIO, S3 or Cloud Object Storage

Top comments (0)