Too Long; Didn't Read
Elasticsearch provides a native api to scan and <a href="https://www.elastic.co/guide/en/elasticsearch/reference/current/search-request-scroll.html" target="_blank">scroll</a> over indexes. It means that you get a ‘cursor’ and you can scroll over it. You can use the <a href="http://elasticsearch-py.readthedocs.io/en/master/helpers.html#elasticsearch.helpers.scan" target="_blank">scan</a> helper method for an easier use of the scroll api: