Is it possible to reduce the number of shards in ElasticSearch search engine once the index is created ?
I tried :
$ curl -XPUT 'localhost:9200/myindex/_settings' -d '{"index" : {"number_of_shards" : 3}}'
But it gives an error :
{"error":"ElasticsearchIllegalArgumentException[can't change the number of shards for an index]","status":400}
This is no longer true, with 5.x you can shrink the number of indexes to a whole fraction. For example from 12 you could go down to 1, 2, 3 or 6 (see the docs). But you must put it to read-only mode and naturally the shrinking process requires lots of IO.
Alternatively, since version 2.3 you could use the reindex API, which would allow you to change to any number of shards. Reindex would need much more resources than the shrink API, because it would have to go through the process of indexing each document from scratch.
No, it's not possible. You could change a lot of stuff - e.g. number of replicas for each shard, or many other index settings, but not the number of shards.
For more information - take a look here - http://www.elastic.co/guide/en/elasticsearch/reference/1.5/indices-update-settings.html
Ok. Like @Mysterion said, it's not possible to change the number of shards with zero-downtime directly with an index update. But there is another way around.
You'll be needing to re-index your old index into an new index after creating it with the desired number of shards. (Like I said no zero-downtime)
For that you can use the Scroll Search API :
While a search request returns a single “page” of results, the scroll API can be used to retrieve large numbers of results (or even all results) from a single search request, in much the same way as you would use a cursor on a traditional database.
Scrolling is not intended for real time user requests, but rather for processing large amounts of data, e.g. in order to reindex the contents of one index into a new index with a different configuration.
Client support for scrolling and reindexing : Some of the officially supported clients provide helpers to assist with scrolled searches and reindexing of documents from one index to another:
Perl See Search::Elasticsearch::Bulk and Search::Elasticsearch::Scroll
Python See elasticsearch.helpers.*
For more information about the Scroll Search API, I suggest the official documentation
And you might also want to take a look at this answer here, maybe it can also give you some ideas in case you are using Java.
