POSTS
Elasticsearch Increase Disk
At my company we use AWS Elastic Search Service. It’s actually been great not having to manage the elastic cluster manually. As a test, I recently increased the disk space by 5GB per node to see how AWS manages this. In the AWS console you simply change your disk space size, then apply the changes.
You can query your cluster using the _cat API to see that AWS automatically brought three new nodes online with the designated disk space. The data will migrate to the new nodes with the higher disk space.
Here is the command to see your nodes (where $ES is your elastic search endpoint):
curl $ES/_cat/nodes?v
… and the resulting output:
shards disk.indices disk.used disk.avail disk.total disk.percent host ip node
0 0b 3.9gb 30.2gb 34.2gb 11 x.x.x.x x.x.x.x hzvurRt
0 0b 3.9gb 30.2gb 34.2gb 11 x.x.x.x x.x.x.x fHykXT9
20 16.6gb 21.8gb 17.3gb 39.1gb 55 x.x.x.x x.x.x.x 0ghAV5j
14 15.1gb 18.8gb 20.2gb 39.1gb 48 x.x.x.x x.x.x.x S-SSb_q
18 13.5gb 17.6gb 21.4gb 39.1gb 45 x.x.x.x x.x.x.x zJAnHvj
0 0b 3.9gb 30.2gb 34.2gb 11 x.x.x.x x.x.x.x aSu9BkS
This operation didn’t take very long (about 10 minutes) since our data set is small. As you can see we now have three nodes again, which contain all of our migrated data:
shards disk.indices disk.used disk.avail disk.total disk.percent host ip node
14 15.3gb 19gb 20gb 39.1gb 48 x.x.x.x x.x.x.x S-SSb_q
20 16.6gb 21.8gb 17.3gb 39.1gb 55 x.x.x.x x.x.x.x 0ghAV5j
18 13.5gb 17.6gb 21.4gb 39.1gb 45 x.x.x.x x.x.x.x zJAnHvj