Elasticsearch Tune for indexing speed

Increase the refresh interval and disable replicas

• On some projects, indexing happens at a different pace, not while the application is in use. In my current project, we follow a similar approach. So I'm disabling the refresh interval because we are not going to search while indexing is on. Also, I'll enable replication when all the indexing complete.

curl --location --request PUT 'localhost:9200/<index>/_settings' \
--header 'Content-Type: application/json' \
--data-raw '{
    "settings": {
        "index": {
            "number_of_replicas": "0",
            "refresh_interval": "600s"
        }
    }
}'

call GET endpoint to confirm the new variables.

curl --location --request GET 'localhost:9200/<index>/_settings'

• collecting these values initially will be helpful, so you can reset the configurations after indexing is complete.

bulk insert

• adjust the batch size of the elasticsearch-model import function argument.

API: https://rubydoc.info/gems/elasticsearch-model/Elasticsearch/Model/Importing/ClassMethods#import-instance_method

• more tips can be found from here: https://www.elastic.co/guide/en/elasticsearch/reference/current/tune-for-indexing-speed.html#tune-for-indexing-speed