Snapshot/Restore Elasticsearch using Curator

Shivesh Yadav — Thu, 21 Nov 2019 04:54:42 +0000

Well, first things first you will need Elasticsearch curator installed on your system.
I prefer installing it using pip as its easy peezy lemon squeezy. Just do
pip install elasticsearch-curator
There are other insane ways of installing it like using apt you can go to apt curator install instructions and follow the instructions there.
Now, the easy part. Follow along with the steps:

Create a snapshot directory.

mkdir -p /elasticsearchData/es-backup

Now, we need to give elasticsearch permissions to write to this directory. Provided the user running elasticsearch service is elasticsearch.

chown -R elasticsearch:elasticsearch /elasticsearchData/es-backup

Now we will give this backup path to elasticsearch by making an entry to the elasticsearch.yml

nano /etc/elasticsearch/elasticsearch.yml and add path.repo: ["/elasticseacrhData/es-backup"]

Next, we need to restart elasticsearch server. If you are on Ubuntu/Debian fire the below command.

sudo systemctl restart elasticsearch

Now we will add the created repository on to elasticsearch.

curl -XPUT -H "Content-Type: application/json;charset=UTF-8" 'http://localhost:9200/_snapshot/esbackup' -d '{ "type": "fs", "settings": { "location": "/elasticsearchData/es-backup", "compress": true } }'

where esbackup is the name of the repository where ES data will be backed up.
You should get this

{"acknowledge": true}

response.

Now, we can take backup by firing a curl command. But here we will use Elasticsearch Curator for backup and restore.
You can get the yml files for curator here.

Required yml file for curatorTo take backup go to the scripts folder and run

/path/where/curator/is/installed/envs/envname_py3/bin/curator ./action_snapshot.yml - config ./curator_conf.yml

To restore from the backup go to the scripts folder and run.

/path/where/curator/is/installed/envs/envname_py3/bin/curator ./action_restore.yml - config ./curator_conf.yml

Voila, you will see your backup RESTORED.

DEV Community: Shivesh Yadav

Snapshot/Restore Elasticsearch using Curator