DEV Community

Juho
Juho

Posted on

Faster zfs snapshot transfers

#zfs

Speeding up zfs snapshot xfer b/w machines. The gist is to just parallelize the up/download to the max.

On the source machine 

zfs snapshot tank/data@snappy
zfs -v send tank/data@snappy >/data_snappy.zfsend
split -d -b500M /data_snappy.zfsend /data/zsnaps/snappy/data_snappy.zfsend_part_
gsutil -m rsync /data/zsnaps/snappy/data_snappy.zfsend_part_ $GS_BUCKET/data_snappy
Enter fullscreen mode Exit fullscreen mode

On the destination machine 

gsutil -m rsync $GS_BUCKET/data_snappy /data/zsnaps/snappy
cat /data/zsnaps/snappy/* | pv | zfs receive tank/data
Enter fullscreen mode Exit fullscreen mode

Top comments (0)

Read next

backendbro profile image

Step-by-Step Guide: Deploying a Full-Stack App on AWS EC2.

Ukagha Nzubechukwu -

reynolds profile image

Chicken Adobo

Ethan -

devleader profile image

MudBlazor with Blazor Interactive SSR – What You Need To Know

Dev Leader -

bilkeesu96 profile image

Understanding event delegation in javaScript

Bilkeesu Babangida -