DEV Community

Juho
Juho

Posted on

1

Faster zfs snapshot transfers

Speeding up zfs snapshot xfer b/w machines. The gist is to just parallelize the up/download to the max.

On the source machine

zfs snapshot tank/data@snappy
zfs -v send tank/data@snappy >/data_snappy.zfsend
split -d -b500M /data_snappy.zfsend /data/zsnaps/snappy/data_snappy.zfsend_part_
gsutil -m rsync /data/zsnaps/snappy/data_snappy.zfsend_part_ $GS_BUCKET/data_snappy
Enter fullscreen mode Exit fullscreen mode

On the destination machine

gsutil -m rsync $GS_BUCKET/data_snappy /data/zsnaps/snappy
cat /data/zsnaps/snappy/* | pv | zfs receive tank/data
Enter fullscreen mode Exit fullscreen mode

Top comments (0)

A Workflow Copilot. Tailored to You.

Pieces.app image

Our desktop app, with its intelligent copilot, streamlines coding by generating snippets, extracting code from screenshots, and accelerating problem-solving.

Read the docs

👋 Kindness is contagious

Please leave a ❤️ or a friendly comment on this post if you found it helpful!

Okay