如何在Python中使用Elasticsearch检索1M文档？ [英] How to retrieve 1M documents with elasticsearch in Python?

问题描述

我如何从python中获得100000个寄存器在Elasticsearch中？ MatchAll查询只能检索10000。

How I can get 100000 registers in elasticsearch from python? MatchAll query only retrieve 10000.

推荐答案

就像已经指出的那样，我将使用Scan API来做到这一点。

Like it's been pointed out, I'd use the Scan API to do that.

import elasticsearch
from elasticsearch import Elasticsearch

ES_HOST = {
    "host": "localhost",
    "port": 9200
}
ES_INDEX = "index_name"
ES_TYPE = "type_name"

es = Elasticsearch(hosts=[ES_HOST], )

results_gen = elasticsearch.helpers.scan(
    es,
    query={"query": {"match_all": {}}},
    index=ES_INDEX,
    doc_type=ES_TYPE
)

results = list(results_gen)

您还应该阅读有关elasticsearch python DSL中的扫描助手的信息 http://elasticsearch-py.readthedocs.io/en/master/helpers.html#scan 。

You ought also reading about the scan helper in elasticsearch python DSL http://elasticsearch-py.readthedocs.io/en/master/helpers.html#scan.

Ref 。 Helpers 。

这篇关于如何在Python中使用Elasticsearch检索1M文档？的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！