Speeding up zfs snapshot xfer b/w machines. The gist is to just parallelize the up/download to the max.
On the source machine
zfs snapshot tank/data@snappy
zfs -v send tank/data@snappy >/data_snappy.zfsend
split -d -b500M /data_snappy.zfsend /data/zsnaps/snappy/data_snappy.zfsend_part_
gsutil -m rsync /data/zsnaps/snappy/data_snappy.zfsend_part_ $GS_BUCKET/data_snappy
On the destination machine
gsutil -m rsync $GS_BUCKET/data_snappy /data/zsnaps/snappy
cat /data/zsnaps/snappy/* | pv | zfs receive tank/data
Top comments (0)