3 ]D@sddlmZddlZddlmZddlmZddlmZm Z m Z ddl m Z dd l mZdd lmZdd lmZdd lmZdd lmZddlmZddlmZddlmZddlmZmZm Z ej!dZ"ddZ#Gddde$Z%dS))unicode_literalsN) Transport)TransportError) string_typesurlparseunquote) IndicesClient) IngestClient) ClusterClient) CatClient) NodesClient) RemoteClient)SnapshotClient) TasksClient) XPackClient) query_params _make_path SKIP_IN_PATHZ elasticsearchcCs|dkrigSt|tr|g}g}x|D]}t|trd|krFd|}t|}d|ji}|jrh|j|d<|jdkr|jpzd|d<d|d <|js|jrd t|jt|jf|d <|j r|j d kr|j |d <|j |q(|j |q(W|S)zv Helper function to transform hosts argument to :class:`~elasticsearch.Elasticsearch` to a list of dicts. Nz://z//%shostporthttpsiTZuse_sslz%s:%sZ http_auth/Z url_prefix) isinstancerrhostnamerschemeusernamepasswordrpathappend)hostsoutr parsed_urlhr%F/tmp/pip-build-z81i1n8o/elasticsearch/elasticsearch/client/__init__.py_normalize_hostss2         r'c-s8eZdZdZdefddZfddZddZedd d Z edd d Z ed ddddddddd dddZ edddd ddddddddd dddZ edd d!d"d#d d$d%ddd&dd dd'd(Z edd d!d"d#d d$d%dddd dd)d*Zedd d!d"d#d d$d%ddd&dd dd+d,Zedd d!d"d#d d$d%dddd dd-d.Zedd d!d"d#d$d%ddd& dd/d0Zedd d!d"d#d1ddd2d dd3ddddddddd4d5Zedd d!d"d#d6d7d8d9d:d;dd?d@dAdBdCdDdEdFd$dGdHdIddJdKdLdMdNdOd&dPdQdRdSdTddUdVdWd,ddXdYZedd d!d"d#d6d8d9dZd`_ is used to encode all outgoing requests. However, you can implement your own custom serializer:: from elasticsearch.serializer import JSONSerializer class SetEncoder(JSONSerializer): def default(self, obj): if isinstance(obj, set): return list(obj) if isinstance(obj, Something): return 'CustomSomethingRepresentation' return JSONSerializer.default(self, obj) es = Elasticsearch(serializer=SetEncoder()) NcKsp|t|f||_t||_t||_t||_t||_ t ||_ t ||_ t||_t||_t||_dS)a  :arg hosts: list of nodes we should connect to. Node should be a dictionary ({"host": "localhost", "port": 9200}), the entire dictionary will be passed to the :class:`~elasticsearch.Connection` class as kwargs, or a string in the format of ``host[:port]`` which will be translated to a dictionary automatically. If no value is given the :class:`~elasticsearch.Urllib3HttpConnection` class defaults will be used. :arg transport_class: :class:`~elasticsearch.Transport` subclass to use. :arg kwargs: any additional arguments will be passed on to the :class:`~elasticsearch.Transport` class and, subsequently, to the :class:`~elasticsearch.Connection` instances. N)r' transportr indicesr ingestr clusterr catrnodesrremotersnapshotrtasksrxpack)selfr!Ztransport_classkwargsr%r%r&__init__s        zElasticsearch.__init__c sRy8|jj}t|dkr(|dddg}dj|jj|dStt|jSdS)Nz...z<{cls}({cons})>)clscons) r)r!lenformat __class____name__superr(__repr__)r3r8)r;r%r&r>s zElasticsearch.__repr__cCs6t|ts djt|jjj|}|jds2|d7}|S)N )rrjoinmapr) serializerdumpsendswith)r3bodyr%r%r& _bulk_bodys   zElasticsearch._bulk_bodyc Cs,y|jjdd|dStk r&dSXdS)zo Returns True if the cluster is up, False otherwise. ``_ HEADr)paramsFN)r)perform_requestr)r3rHr%r%r&pingszElasticsearch.pingcCs|jjdd|dS)zh Get the basic info from the current cluster. ``_ GETr)rH)r)rI)r3rHr%r%r&infoszElasticsearch.infoparentZpipelineZrefreshZroutingtimeout timestampZttlversionZ version_typeZwait_for_active_shards_doccCsBx"|||fD]}|tkr tdq W|jjdt|||d||dS)aP Adds a typed JSON document in a specific index, making it searchable. Behind the scenes this method calls index(..., op_type='create') ``_ :arg index: The name of the index :arg id: Document ID :arg body: The document :arg parent: ID of the parent document :arg pipeline: The pipeline id to preprocess incoming documents with :arg refresh: If `true` then refresh the affected shards to make this operation visible to search, if `wait_for` then wait for a refresh to make this operation visible to search, if `false` (the default) then do nothing with refreshes., valid choices are: 'true', 'false', 'wait_for' :arg routing: Specific routing value :arg timeout: Explicit operation timeout :arg timestamp: Explicit timestamp for the document :arg ttl: Expiration time for the document :arg version: Explicit version number for concurrency control :arg version_type: Specific version type, valid choices are: 'internal', 'external', 'external_gte', 'force' :arg wait_for_active_shards: Sets the number of shard copies that must be active before proceeding with the index operation. Defaults to 1, meaning the primary shard only. Set to `all` for all shard copies, otherwise set to any non-negative value less than or equal to the total number of copies for the shard (number of replicas + 1) z+Empty value passed for a required argument.PUTZ_create)rHrE)r ValueErrorr)rIr)r3indexidrEdoc_typerHparamr%r%r&creates ) zElasticsearch.createZ if_seq_noZif_primary_termZop_typecCs>x ||fD]}|tkr tdq W|jjdt|||||dS)a Adds or updates a typed JSON document in a specific index, making it searchable. ``_ :arg index: The name of the index :arg body: The document :arg id: Document ID :arg if_primary_term: only perform the index operation if the last operation that has changed the document has the specified primary term :arg if_seq_no: only perform the index operation if the last operation that has changed the document has the specified sequence number :arg doc_type: Document type, defaults to `_doc`. Not used on ES 7 clusters. :arg op_type: Explicit operation type, default 'index', valid choices are: 'index', 'create' :arg parent: ID of the parent document :arg pipeline: The pipeline id to preprocess incoming documents with :arg refresh: If `true` then refresh the affected shards to make this operation visible to search, if `wait_for` then wait for a refresh to make this operation visible to search, if `false` (the default) then do nothing with refreshes., valid choices are: 'true', 'false', 'wait_for' :arg routing: Specific routing value :arg timeout: Explicit operation timeout :arg timestamp: Explicit timestamp for the document :arg ttl: Expiration time for the document :arg version: Explicit version number for concurrency control :arg version_type: Specific version type, valid choices are: 'internal', 'external', 'external_gte', 'force' :arg wait_for_active_shards: Sets the number of shard copies that must be active before proceeding with the index operation. Defaults to 1, meaning the primary shard only. Set to `all` for all shard copies, otherwise set to any non-negative value less than or equal to the total number of copies for the shard (number of replicas + 1) z+Empty value passed for a required argument.POST)rHrE)rrSr)rIr)r3rTrErVrUrHrWr%r%r&rT5s 3 zElasticsearch.index_sourceZ_source_excludeZ_source_excludesZ_source_includeZ_source_includesZ preferenceZrealtimeZ stored_fieldscCs<x ||fD]}|tkr tdq W|jjdt||||dS)a% Returns a boolean indicating whether or not given document exists in Elasticsearch. ``_ :arg index: The name of the index :arg id: The document ID :arg _source: True or false to return the _source field or not, or a list of fields to return :arg _source_exclude: A list of fields to exclude from the returned _source field :arg _source_include: A list of fields to extract and return from the _source field :arg parent: The ID of the parent document :arg preference: Specify the node or shard the operation should be performed on (default: random) :arg realtime: Specify whether to perform the operation in realtime or search mode :arg refresh: Refresh the shard containing the document before performing the operation :arg routing: Specific routing value :arg stored_fields: A comma-separated list of stored fields to return in the response :arg version: Explicit version number for concurrency control :arg version_type: Specific version type, valid choices are: 'internal', 'external', 'external_gte', 'force' z+Empty value passed for a required argument.rG)rH)rrSr)rIr)r3rTrUrVrHrWr%r%r&existsos * zElasticsearch.existscCs>x ||fD]}|tkr tdq W|jjdt|||d|dS)a^ ``_ :arg index: The name of the index :arg id: The document ID :arg _source: True or false to return the _source field or not, or a list of fields to return :arg _source_exclude: A list of fields to exclude from the returned _source field :arg _source_include: A list of fields to extract and return from the _source field :arg parent: The ID of the parent document :arg preference: Specify the node or shard the operation should be performed on (default: random) :arg realtime: Specify whether to perform the operation in realtime or search mode :arg refresh: Refresh the shard containing the document before performing the operation :arg routing: Specific routing value :arg version: Explicit version number for concurrency control :arg version_type: Specific version type, valid choices are: 'internal', 'external', 'external_gte', 'force' z+Empty value passed for a required argument.rGrZ)rH)rrSr)rIr)r3rTrUrVrHrWr%r%r& exists_sources & zElasticsearch.exists_sourcecCs<x ||fD]}|tkr tdq W|jjdt||||dS)a  Get a typed JSON document from the index based on its id. ``_ :arg index: The name of the index :arg id: The document ID :arg _source: True or false to return the _source field or not, or a list of fields to return :arg _source_exclude: A list of fields to exclude from the returned _source field :arg _source_include: A list of fields to extract and return from the _source field :arg parent: The ID of the parent document :arg preference: Specify the node or shard the operation should be performed on (default: random) :arg realtime: Specify whether to perform the operation in realtime or search mode :arg refresh: Refresh the shard containing the document before performing the operation :arg routing: Specific routing value :arg stored_fields: A comma-separated list of stored fields to return in the response :arg version: Explicit version number for concurrency control :arg version_type: Specific version type, valid choices are: 'internal', 'external', 'external_gte', 'force' z+Empty value passed for a required argument.rK)rH)rrSr)rIr)r3rTrUrVrHrWr%r%r&gets * zElasticsearch.getcCs>x ||fD]}|tkr tdq W|jjdt|||d|dS)a Get the source of a document by it's index, type and id. ``_ :arg index: The name of the index :arg id: The document ID :arg _source: True or false to return the _source field or not, or a list of fields to return :arg _source_exclude: A list of fields to exclude from the returned _source field :arg _source_include: A list of fields to extract and return from the _source field :arg parent: The ID of the parent document :arg preference: Specify the node or shard the operation should be performed on (default: random) :arg realtime: Specify whether to perform the operation in realtime or search mode :arg refresh: Refresh the shard containing the document before performing the operation :arg routing: Specific routing value :arg version: Explicit version number for concurrency control :arg version_type: Specific version type, valid choices are: 'internal', 'external', 'external_gte', 'force' z+Empty value passed for a required argument.rKrZ)rH)rrSr)rIr)r3rTrUrVrHrWr%r%r& get_sources ' zElasticsearch.get_sourcecCs,|tkrtd|jjdt||d||dS)a Get multiple documents based on an index, type (optional) and ids. ``_ :arg body: Document identifiers; can be either `docs` (containing full document information) or `ids` (when index and type is provided in the URL. :arg index: The name of the index :arg _source: True or false to return the _source field or not, or a list of fields to return :arg _source_exclude: A list of fields to exclude from the returned _source field :arg _source_include: A list of fields to extract and return from the _source field :arg preference: Specify the node or shard the operation should be performed on (default: random) :arg realtime: Specify whether to perform the operation in realtime or search mode :arg refresh: Refresh the shard containing the document before performing the operation :arg routing: Specific routing value :arg stored_fields: A comma-separated list of stored fields to return in the response z2Empty value passed for a required argument 'body'.rKZ_mget)rHrE)rrSr)rIr)r3rErVrTrHr%r%r&mget,s%zElasticsearch.mgetfieldslangZretry_on_conflictcCs@x ||fD]}|tkr tdq W|jjdt|||d||dS)a Update a document based on a script or partial data provided. ``_ :arg index: The name of the index :arg id: Document ID :arg body: The request definition using either `script` or partial `doc` :arg _source: True or false to return the _source field or not, or a list of fields to return :arg _source_exclude: A list of fields to exclude from the returned _source field :arg _source_include: A list of fields to extract and return from the _source field :arg fields: A comma-separated list of fields to return in the response :arg if_seq_no: :arg if_primary_term: :arg lang: The script language (default: painless) :arg parent: ID of the parent document. Is is only used for routing and when for the upsert request :arg refresh: If `true` then refresh the effected shards to make this operation visible to search, if `wait_for` then wait for a refresh to make this operation visible to search, if `false` (the default) then do nothing with refreshes., valid choices are: 'true', 'false', 'wait_for' :arg retry_on_conflict: Specify how many times should the operation be retried when a conflict occurs (default: 0) :arg routing: Specific routing value :arg timeout: Explicit operation timeout :arg timestamp: Explicit timestamp for the document :arg ttl: Expiration time for the document :arg version: Explicit version number for concurrency control :arg version_type: Specific version type, valid choices are: 'internal', 'force' :arg wait_for_active_shards: Sets the number of shard copies that must be active before proceeding with the update operation. Defaults to 1, meaning the primary shard only. Set to `all` for all shard copies, otherwise set to any non-negative value less than or equal to the total number of copies for the shard (number of replicas + 1) z+Empty value passed for a required argument.rY_update)rHrE)rrSr)rIr)r3rTrUrVrErHrWr%r%r&updateWs = zElasticsearch.updateZallow_no_indicesZallow_partial_search_resultsZanalyze_wildcardZanalyzerZbatched_reduce_sizeZccs_minimize_roundtripsZdefault_operatorZdfZdocvalue_fieldsZexpand_wildcardsexplainfrom_Zignore_throttledZignore_unavailableZlenientZmax_concurrent_shard_requestsZpre_filter_shard_sizeqZrest_total_hits_as_intZ request_cachescrollZ search_typeZseq_no_primary_termsizesortstatsZ suggest_fieldZ suggest_modeZ suggest_sizeZ suggest_textZterminate_afterZ track_scoresZtrack_total_hitsZ typed_keyscCs8d|kr|jd|d<|sd}|jjdt|d||dS)aa Execute a search query and get back search hits that match the query. ``_ :arg index: A list of index names to search, or a string containing a comma-separated list of index names to search; use `_all` or empty string to perform the operation on all indices :arg body: The search definition using the Query DSL :arg _source: True or false to return the _source field or not, or a list of fields to return :arg _source_exclude: A list of fields to exclude from the returned _source field :arg _source_include: A list of fields to extract and return from the _source field :arg allow_no_indices: Whether to ignore if a wildcard indices expression resolves into no concrete indices. (This includes `_all` string or when no indices have been specified) :arg allow_partial_search_results: Set to false to return an overall failure if the request would produce partial results. Defaults to True, which will allow partial results in the case of timeouts or partial failures :arg analyze_wildcard: Specify whether wildcard and prefix queries should be analyzed (default: false) :arg analyzer: The analyzer to use for the query string :arg batched_reduce_size: The number of shard results that should be reduced at once on the coordinating node. This value should be used as a protection mechanism to reduce the memory overhead per search request if the potential number of shards in the request can be large., default 512 :arg ccs_minimize_roundtrips: Indicates whether network round-trips should be minimized as part of cross-cluster search requests execution, default 'true' :arg default_operator: The default operator for query string query (AND or OR), default 'OR', valid choices are: 'AND', 'OR' :arg df: The field to use as default where no field prefix is given in the query string :arg docvalue_fields: A comma-separated list of fields to return as the docvalue representation of a field for each hit :arg expand_wildcards: Whether to expand wildcard expression to concrete indices that are open, closed or both., default 'open', valid choices are: 'open', 'closed', 'none', 'all' :arg explain: Specify whether to return detailed information about score computation as part of a hit :arg from\_: Starting offset (default: 0) :arg ignore_unavailable: Whether specified concrete indices should be ignored when unavailable (missing or closed) :arg lenient: Specify whether format-based query failures (such as providing text to a numeric field) should be ignored :arg max_concurrent_shard_requests: The number of concurrent shard requests this search executes concurrently. This value should be used to limit the impact of the search on the cluster in order to limit the number of concurrent shard requests, default 'The default grows with the number of nodes in the cluster but is at most 256.' :arg pre_filter_shard_size: A threshold that enforces a pre-filter roundtrip to prefilter search shards based on query rewriting if the number of shards the search request expands to exceeds the threshold. This filter roundtrip can limit the number of shards significantly if for instance a shard can not match any documents based on it's rewrite method ie. if date filters are mandatory to match but the shard bounds and the query are disjoint., default 128 :arg preference: Specify the node or shard the operation should be performed on (default: random) :arg q: Query in the Lucene query string syntax :arg rest_total_hits_as_int: This parameter is used to restore the total hits as a number in the response. This param is added version 6.x to handle mixed cluster queries where nodes are in multiple versions (7.0 and 6.latest) :arg request_cache: Specify if request cache should be used for this request or not, defaults to index level setting :arg routing: A comma-separated list of specific routing values :arg scroll: Specify how long a consistent view of the index should be maintained for scrolled search :arg search_type: Search operation type, valid choices are: 'query_then_fetch', 'dfs_query_then_fetch' :arg size: Number of hits to return (default: 10) :arg sort: A comma-separated list of : pairs :arg stats: Specific 'tag' of the request for logging and statistical purposes :arg stored_fields: A comma-separated list of stored fields to return as part of a hit :arg suggest_field: Specify which field to use for suggestions :arg suggest_mode: Specify suggest mode, default 'missing', valid choices are: 'missing', 'popular', 'always' :arg suggest_size: How many suggestions to return in response :arg suggest_text: The source text for which the suggestions should be returned :arg terminate_after: The maximum number of documents to collect for each shard, upon reaching which the query execution will terminate early. :arg timeout: Explicit operation timeout :arg track_scores: Whether to calculate and return scores even if they are not used for sorting :arg track_total_hits: Indicate if the number of documents that match the query should be tracked :arg typed_keys: Specify whether aggregation and suggester names should be prefixed by their respective types in the response :arg version: Specify whether to return document version as part of a hit refrom_allrK_search)rHrE)popr)rIr)r3rTrErHr%r%r&searchszElasticsearch.search conflictsZrequests_per_secondZ scroll_sizeZsearch_timeoutZslicesZwait_for_completioncCs*|tkrtd|jjdt|d||dS)a Perform an update on all documents matching a query. ``_ :arg index: A list of index names to search, or a string containing a comma-separated list of index names to search; use `_all` or the empty string to perform the operation on all indices :arg body: The search definition using the Query DSL :arg _source: True or false to return the _source field or not, or a list of fields to return :arg _source_exclude: A list of fields to exclude from the returned _source field :arg _source_include: A list of fields to extract and return from the _source field :arg allow_no_indices: Whether to ignore if a wildcard indices expression resolves into no concrete indices. (This includes `_all` string or when no indices have been specified) :arg analyze_wildcard: Specify whether wildcard and prefix queries should be analyzed (default: false) :arg analyzer: The analyzer to use for the query string :arg conflicts: What to do when the update by query hits version conflicts?, default 'abort', valid choices are: 'abort', 'proceed' :arg default_operator: The default operator for query string query (AND or OR), default 'OR', valid choices are: 'AND', 'OR' :arg df: The field to use as default where no field prefix is given in the query string :arg expand_wildcards: Whether to expand wildcard expression to concrete indices that are open, closed or both., default 'open', valid choices are: 'open', 'closed', 'none', 'all' :arg from\_: Starting offset (default: 0) :arg ignore_unavailable: Whether specified concrete indices should be ignored when unavailable (missing or closed) :arg lenient: Specify whether format-based query failures (such as providing text to a numeric field) should be ignored :arg pipeline: Ingest pipeline to set on index requests made by this action. (default: none) :arg preference: Specify the node or shard the operation should be performed on (default: random) :arg q: Query in the Lucene query string syntax :arg refresh: Should the effected indexes be refreshed? :arg request_cache: Specify if request cache should be used for this request or not, defaults to index level setting :arg requests_per_second: The throttle to set on this request in sub- requests per second. -1 means no throttle., default 0 :arg routing: A comma-separated list of specific routing values :arg scroll: Specify how long a consistent view of the index should be maintained for scrolled search :arg scroll_size: Size on the scroll request powering the update_by_query :arg search_timeout: Explicit timeout for each search request. Defaults to no timeout. :arg search_type: Search operation type, valid choices are: 'query_then_fetch', 'dfs_query_then_fetch' :arg size: Number of hits to return (default: 10) :arg slices: The number of slices this task should be divided into. Defaults to 1 meaning the task isn't sliced into subtasks., default 1 :arg sort: A comma-separated list of : pairs :arg stats: Specific 'tag' of the request for logging and statistical purposes :arg terminate_after: The maximum number of documents to collect for each shard, upon reaching which the query execution will terminate early. :arg timeout: Time each individual bulk request should wait for shards that are unavailable., default '1m' :arg version: Specify whether to return document version as part of a hit :arg version_type: Should the document increment the version number (internal) on hit or not (reindex) :arg wait_for_active_shards: Sets the number of shard copies that must be active before proceeding with the update by query operation. Defaults to 1, meaning the primary shard only. Set to `all` for all shard copies, otherwise set to any non-negative value less than or equal to the total number of copies for the shard (number of replicas + 1) :arg wait_for_completion: Should the request should block until the update by query operation is complete., default True z3Empty value passed for a required argument 'index'.rY_update_by_query)rHrE)rrSr)rIr)r3rTrErHr%r%r&update_by_query6suzElasticsearch.update_by_querycCs*|tkrtd|jjdtd|d|dS)a2 ``_ :arg task_id: The task id to rethrottle :arg requests_per_second: The throttle to set on this request in floating sub-requests per second. -1 means set no throttle. z5Empty value passed for a required argument 'task_id'.rYrq _rethrottle)rH)rrSr)rIr)r3task_idrHr%r%r&update_by_query_rethrottles  z(Elasticsearch.update_by_query_rethrottlecCs$|tkrtd|jjdd||dS)ar Reindex all documents from one index to another. ``_ :arg body: The search definition using the Query DSL and the prototype for the index request. :arg refresh: Should the effected indexes be refreshed? :arg requests_per_second: The throttle to set on this request in sub- requests per second. -1 means no throttle., default 0 :arg slices: The number of slices this task should be divided into. Defaults to 1 meaning the task isn't sliced into subtasks., default 1 :arg scroll: Control how long to keep the search context alive, default '5m' :arg timeout: Time each individual bulk request should wait for shards that are unavailable., default '1m' :arg wait_for_active_shards: Sets the number of shard copies that must be active before proceeding with the reindex operation. Defaults to 1, meaning the primary shard only. Set to `all` for all shard copies, otherwise set to any non-negative value less than or equal to the total number of copies for the shard (number of replicas + 1) :arg wait_for_completion: Should the request should block until the reindex is complete., default True z2Empty value passed for a required argument 'body'.rYz /_reindex)rHrE)rrSr)rI)r3rErHr%r%r&reindexs"zElasticsearch.reindexcCs|jjdtd|d|dS)a} Change the value of ``requests_per_second`` of a running ``reindex`` task. ``_ :arg task_id: The task id to rethrottle :arg requests_per_second: The throttle to set on this request in floating sub-requests per second. -1 means set no throttle. rYZ_reindexrs)rH)r)rIr)r3rtrHr%r%r&reindex_rethrottles z Elasticsearch.reindex_rethrottlecCs<x ||fD]}|tkr tdq W|jjdt|d||dS)at Delete all documents matching a query. ``_ :arg index: A list of index names to search, or a string containing a comma-separated list of index names to search; use `_all` or the empty string to perform the operation on all indices :arg body: The search definition using the Query DSL :arg _source: True or false to return the _source field or not, or a list of fields to return :arg _source_exclude: A list of fields to exclude from the returned _source field :arg _source_include: A list of fields to extract and return from the _source field :arg allow_no_indices: Whether to ignore if a wildcard indices expression resolves into no concrete indices. (This includes `_all` string or when no indices have been specified) :arg analyze_wildcard: Specify whether wildcard and prefix queries should be analyzed (default: false) :arg analyzer: The analyzer to use for the query string :arg conflicts: What to do when the delete-by-query hits version conflicts?, default 'abort', valid choices are: 'abort', 'proceed' :arg default_operator: The default operator for query string query (AND or OR), default 'OR', valid choices are: 'AND', 'OR' :arg df: The field to use as default where no field prefix is given in the query string :arg expand_wildcards: Whether to expand wildcard expression to concrete indices that are open, closed or both., default 'open', valid choices are: 'open', 'closed', 'none', 'all' :arg from\_: Starting offset (default: 0) :arg ignore_unavailable: Whether specified concrete indices should be ignored when unavailable (missing or closed) :arg lenient: Specify whether format-based query failures (such as providing text to a numeric field) should be ignored :arg preference: Specify the node or shard the operation should be performed on (default: random) :arg q: Query in the Lucene query string syntax :arg refresh: Should the effected indexes be refreshed? :arg request_cache: Specify if request cache should be used for this request or not, defaults to index level setting :arg requests_per_second: The throttle for this request in sub-requests per second. -1 means no throttle., default 0 :arg routing: A comma-separated list of specific routing values :arg scroll: Specify how long a consistent view of the index should be maintained for scrolled search :arg scroll_size: Size on the scroll request powering the update_by_query :arg search_timeout: Explicit timeout for each search request. Defaults to no timeout. :arg search_type: Search operation type, valid choices are: 'query_then_fetch', 'dfs_query_then_fetch' :arg size: Number of hits to return (default: 10) :arg slices: The number of slices this task should be divided into. Defaults to 1 meaning the task isn't sliced into subtasks., default 1 :arg sort: A comma-separated list of : pairs :arg stats: Specific 'tag' of the request for logging and statistical purposes :arg terminate_after: The maximum number of documents to collect for each shard, upon reaching which the query execution will terminate early. :arg timeout: Time each individual bulk request should wait for shards that are unavailable., default '1m' :arg version: Specify whether to return document version as part of a hit :arg wait_for_active_shards: Sets the number of shard copies that must be active before proceeding with the delete by query operation. Defaults to 1, meaning the primary shard only. Set to `all` for all shard copies, otherwise set to any non-negative value less than or equal to the total number of copies for the shard (number of replicas + 1) :arg wait_for_completion: Should the request should block until the delete-by-query is complete., default True z+Empty value passed for a required argument.rY_delete_by_query)rHrE)rrSr)rIr)r3rTrErHrWr%r%r&delete_by_querys o zElasticsearch.delete_by_querycCs*|tkrtd|jjdtd|d|dS)a2 ``_ :arg task_id: The task id to rethrottle :arg requests_per_second: The throttle to set on this request in floating sub-requests per second. -1 means set no throttle. z5Empty value passed for a required argument 'task_id'.rYrxrs)rH)rrSr)rIr)r3rtrHr%r%r&delete_by_query_rethrottlens  z(Elasticsearch.delete_by_query_rethrottlelocalcCs|jjdt|d|dS)a| The search shards api returns the indices and shards that a search request would be executed against. This can give useful feedback for working out issues or planning optimizations with routing and shard preferences. ``_ :arg index: A list of index names to search, or a string containing a comma-separated list of index names to search; use `_all` or the empty string to perform the operation on all indices :arg allow_no_indices: Whether to ignore if a wildcard indices expression resolves into no concrete indices. (This includes `_all` string or when no indices have been specified) :arg expand_wildcards: Whether to expand wildcard expression to concrete indices that are open, closed or both., default 'open', valid choices are: 'open', 'closed', 'none', 'all' :arg ignore_unavailable: Whether specified concrete indices should be ignored when unavailable (missing or closed) :arg local: Return local information, do not retrieve the state from master node (default: false) :arg preference: Specify the node or shard the operation should be performed on (default: random) :arg routing: Specific routing value rKZ_search_shards)rH)r)rIr)r3rTrHr%r%r& search_shardss zElasticsearch.search_shardsZprofilecCs|jjdt|dd||dS)a A query that accepts a query template and a map of key/value pairs to fill in template parameters. ``_ :arg index: A list of index names to search, or a string containing a comma-separated list of index names to search; use `_all` or the empty string to perform the operation on all indices :arg body: The search definition template and its params :arg allow_no_indices: Whether to ignore if a wildcard indices expression resolves into no concrete indices. (This includes `_all` string or when no indices have been specified) :arg ccs_minimize_roundtrips: Indicates whether network round-trips should be minimized as part of cross-cluster search requests execution, default 'true' :arg expand_wildcards: Whether to expand wildcard expression to concrete indices that are open, closed or both., default 'open', valid choices are: 'open', 'closed', 'none', 'all' :arg explain: Specify whether to return detailed information about score computation as part of a hit :arg ignore_unavailable: Whether specified concrete indices should be ignored when unavailable (missing or closed) :arg preference: Specify the node or shard the operation should be performed on (default: random) :arg profile: Specify whether to profile the query execution :arg routing: A comma-separated list of specific routing values :arg rest_total_hits_as_int: Indicates whether hits.total should be rendered as an integer or an object in the rest search response, default False :arg scroll: Specify how long a consistent view of the index should be maintained for scrolled search :arg search_type: Search operation type, valid choices are: 'query_then_fetch', 'query_and_fetch', 'dfs_query_then_fetch', 'dfs_query_and_fetch' :arg typed_keys: Specify whether aggregation and suggester names should be prefixed by their respective types in the response rKrmtemplate)rHrE)r)rIr)r3rTrErHr%r%r&search_templates4zElasticsearch.search_templatecCs@x ||fD]}|tkr tdq W|jjdt|||d||dS)a The explain api computes a score explanation for a query and a specific document. This can give useful feedback whether a document matches or didn't match a specific query. ``_ :arg index: The name of the index :arg id: The document ID :arg body: The query definition using the Query DSL :arg _source: True or false to return the _source field or not, or a list of fields to return :arg _source_exclude: A list of fields to exclude from the returned _source field :arg _source_include: A list of fields to extract and return from the _source field :arg analyze_wildcard: Specify whether wildcards and prefix queries in the query string query should be analyzed (default: false) :arg analyzer: The analyzer for the query string query :arg default_operator: The default operator for query string query (AND or OR), default 'OR', valid choices are: 'AND', 'OR' :arg df: The default field for query string query (default: _all) :arg lenient: Specify whether format-based query failures (such as providing text to a numeric field) should be ignored :arg parent: The ID of the parent document :arg preference: Specify the node or shard the operation should be performed on (default: random) :arg q: Query in the Lucene query string syntax :arg routing: Specific routing value :arg stored_fields: A comma-separated list of stored fields to return in the response z+Empty value passed for a required argument.rKZ_explain)rHrE)rrSr)rIr)r3rTrUrVrErHrWr%r%r&rds 1 zElasticsearch.explaincCsN|tkr|tkrtdn |r.| r.d|i}n |r:||d<|jjdd||dS)a Scroll a search request created by specifying the scroll parameter. ``_ :arg scroll_id: The scroll ID :arg body: The scroll ID if not passed by URL or query parameter. :arg scroll: Specify how long a consistent view of the index should be maintained for scrolled search :arg rest_total_hits_as_int: This parameter is used to restore the total hits as a number in the response. This param is added version 6.x to handle mixed cluster queries where nodes are in multiple versions (7.0 and 6.latest) z%You need to supply scroll_id or body. scroll_idrKz/_search/scroll)rHrE)rrSr)rI)r3rErrHr%r%r&rgs   zElasticsearch.scrollcCsP|tkr|tkrtdn"|r0| r0d|gi}n |r<||d<|jjdd||dS)a Clear the scroll request created by specifying the scroll parameter to search. ``_ :arg scroll_id: A comma-separated list of scroll IDs to clear :arg body: A comma-separated list of scroll IDs to clear if none was specified via the scroll_id parameter z%You need to supply scroll_id or body.rDELETEz/_search/scroll)rHrE)rrSr)rI)r3rrErHr%r%r& clear_scroll,s    zElasticsearch.clear_scrollcCs<x ||fD]}|tkr tdq W|jjdt||||dS)aq Delete a typed JSON document from a specific index based on its id. ``_ :arg index: The name of the index :arg id: The document ID :arg if_primary_term: only perform the delete operation if the last operation that has changed the document has the specified primary term :arg if_seq_no: only perform the delete operation if the last operation that has changed the document has the specified sequence number :arg parent: ID of parent document :arg refresh: If `true` then refresh the effected shards to make this operation visible to search, if `wait_for` then wait for a refresh to make this operation visible to search, if `false` (the default) then do nothing with refreshes., valid choices are: 'true', 'false', 'wait_for' :arg routing: Specific routing value :arg timeout: Explicit operation timeout :arg version: Explicit version number for concurrency control :arg version_type: Specific version type, valid choices are: 'internal', 'external', 'external_gte', 'force' :arg wait_for_active_shards: Sets the number of shard copies that must be active before proceeding with the delete operation. Defaults to 1, meaning the primary shard only. Set to `all` for all shard copies, otherwise set to any non-negative value less than or equal to the total number of copies for the shard (number of replicas + 1) z+Empty value passed for a required argument.r)rH)rrSr)rIr)r3rTrUrVrHrWr%r%r&deleteBs ( zElasticsearch.deleteZ min_scorecCs$|sd}|jjdt||d||dS)a Execute a query and get the number of matches for that query. ``_ :arg index: A list of index names or a string containing a comma-separated list of index names to restrict the results to :arg body: A query to restrict the results specified with the Query DSL (optional) :arg allow_no_indices: Whether to ignore if a wildcard indices expression resolves into no concrete indices. (This includes `_all` string or when no indices have been specified) :arg analyze_wildcard: Specify whether wildcard and prefix queries should be analyzed (default: false) :arg analyzer: The analyzer to use for the query string :arg default_operator: The default operator for query string query (AND or OR), default 'OR', valid choices are: 'AND', 'OR' :arg df: The field to use as default where no field prefix is given in the query string :arg expand_wildcards: Whether to expand wildcard expression to concrete indices that are open, closed or both., default 'open', valid choices are: 'open', 'closed', 'none', 'all' :arg ignore_unavailable: Whether specified concrete indices should be ignored when unavailable (missing or closed) :arg ignore_throttled: Whether specified concrete, expanded or aliased indices should be ignored when throttled :arg lenient: Specify whether format-based query failures (such as providing text to a numeric field) should be ignored :arg min_score: Include only documents with a specific `_score` value in the result :arg preference: Specify the node or shard the operation should be performed on (default: random) :arg q: Query in the Lucene query string syntax :arg routing: Specific routing value rlrK_count)rHrE)r)rIr)r3rVrTrErHr%r%r&countqs3zElasticsearch.countcCs8|tkrtd|jjdt||d||j|ddidS)a Perform many index/delete operations in a single API call. See the :func:`~elasticsearch.helpers.bulk` helper function for a more friendly API. ``_ :arg body: The operation definition and data (action-data pairs), separated by newlines :arg index: Default index for items which don't provide one :arg _source: True or false to return the _source field or not, or default list of fields to return, can be overridden on each sub- request :arg _source_exclude: Default list of fields to exclude from the returned _source field, can be overridden on each sub-request :arg _source_include: Default list of fields to extract and return from the _source field, can be overridden on each sub-request :arg fields: Default comma-separated list of fields to return in the response for updates, can be overridden on each sub-request :arg pipeline: The pipeline id to preprocess incoming documents with :arg refresh: If `true` then refresh the effected shards to make this operation visible to search, if `wait_for` then wait for a refresh to make this operation visible to search, if `false` (the default) then do nothing with refreshes., valid choices are: 'true', 'false', 'wait_for' :arg routing: Specific routing value :arg timeout: Explicit operation timeout :arg wait_for_active_shards: Sets the number of shard copies that must be active before proceeding with the bulk operation. Defaults to 1, meaning the primary shard only. Set to `all` for all shard copies, otherwise set to any non-negative value less than or equal to the total number of copies for the shard (number of replicas + 1) z2Empty value passed for a required argument 'body'.rYZ_bulkz content-typezapplication/x-ndjson)rHrEheaders)rrSr)rIrrF)r3rErVrTrHr%r%r&bulks/ zElasticsearch.bulkZmax_concurrent_searchescCs6|tkrtd|jjdt|d||j|ddidS)aP Execute several search requests within the same API. ``_ :arg body: The request definitions (metadata-search request definition pairs), separated by newlines :arg index: A list of index names, or a string containing a comma-separated list of index names, to use as the default :arg ccs_minimize_roundtrips: Indicates whether network round-trips should be minimized as part of cross-cluster search requests execution, default 'true' :arg max_concurrent_searches: Controls the maximum number of concurrent searches the multi search api will execute :arg pre_filter_shard_size: A threshold that enforces a pre-filter roundtrip to prefilter search shards based on query rewriting if the number of shards the search request expands to exceeds the threshold. This filter roundtrip can limit the number of shards significantly if for instance a shard can not match any documents based on it's rewrite method ie. if date filters are mandatory to match but the shard bounds and the query are disjoint., default 128 :arg search_type: Search operation type, valid choices are: 'query_then_fetch', 'query_and_fetch', 'dfs_query_then_fetch', 'dfs_query_and_fetch' :arg typed_keys: Specify whether aggregation and suggester names should be prefixed by their respective types in the response z2Empty value passed for a required argument 'body'.rK_msearchz content-typezapplication/x-ndjson)rHrEr)rrSr)rIrrF)r3rErTrHr%r%r&msearchs$zElasticsearch.msearchZfield_statisticsoffsetsZpayloadsZ positionsZterm_statisticscCs>x|fD]}|tkrtdqW|jjdt|||d||dS)a Returns information and statistics on terms in the fields of a particular document. The document could be stored in the index or artificially provided by the user (Added in 1.4). Note that for documents stored in the index, this is a near realtime API as the term vectors are not available until the next refresh. ``_ :arg index: The index in which the document resides. :arg id: The id of the document, when not specified a doc param should be supplied. :arg body: Define parameters and or supply a document to get termvectors for. See documentation. :arg field_statistics: Specifies if document count, sum of document frequencies and sum of total term frequencies should be returned., default True :arg fields: A comma-separated list of fields to return. :arg offsets: Specifies if term offsets should be returned., default True :arg parent: Parent id of documents. :arg payloads: Specifies if term payloads should be returned., default True :arg positions: Specifies if term positions should be returned., default True :arg preference: Specify the node or shard the operation should be performed on (default: random). :arg realtime: Specifies if request is real-time as opposed to near- real-time (default: true). :arg routing: Specific routing value. :arg term_statistics: Specifies if total term frequency and document frequency should be returned., default False :arg version: Explicit version number for concurrency control :arg version_type: Specific version type, valid choices are: 'internal', 'external', 'external_gte', 'force' z+Empty value passed for a required argument.rKZ _termvectors)rHrE)rrSr)rIr)r3rTrVrUrErHrWr%r%r& termvectorss2   zElasticsearch.termvectorsidscCs|jjdt||d||dS)a Multi termvectors API allows to get multiple termvectors based on an index, type and id. ``_ :arg index: The index in which the document resides. :arg body: Define ids, documents, parameters or a list of parameters per document here. You must at least provide a list of document ids. See documentation. :arg field_statistics: Specifies if document count, sum of document frequencies and sum of total term frequencies should be returned. Applies to all returned documents unless otherwise specified in body "params" or "docs"., default True :arg fields: A comma-separated list of fields to return. Applies to all returned documents unless otherwise specified in body "params" or "docs". :arg ids: A comma-separated list of documents ids. You must define ids as parameter or set "ids" or "docs" in the request body :arg offsets: Specifies if term offsets should be returned. Applies to all returned documents unless otherwise specified in body "params" or "docs"., default True :arg parent: Parent id of documents. Applies to all returned documents unless otherwise specified in body "params" or "docs". :arg payloads: Specifies if term payloads should be returned. Applies to all returned documents unless otherwise specified in body "params" or "docs"., default True :arg positions: Specifies if term positions should be returned. Applies to all returned documents unless otherwise specified in body "params" or "docs"., default True :arg preference: Specify the node or shard the operation should be performed on (default: random) .Applies to all returned documents unless otherwise specified in body "params" or "docs". :arg realtime: Specifies if requests are real-time as opposed to near- real-time (default: true). :arg routing: Specific routing value. Applies to all returned documents unless otherwise specified in body "params" or "docs". :arg term_statistics: Specifies if total term frequency and document frequency should be returned. Applies to all returned documents unless otherwise specified in body "params" or "docs"., default False :arg version: Explicit version number for concurrency control :arg version_type: Specific version type, valid choices are: 'internal', 'external', 'external_gte', 'force' rKZ _mtermvectors)rHrE)r)rIr)r3rVrTrErHr%r%r& mtermvectorsNs < zElasticsearch.mtermvectorsZmaster_timeoutcCs>x ||fD]}|tkr tdq W|jjdtd||||dS)aN Create a script in given language with specified ID. ``_ :arg id: Script ID :arg body: The document :arg master_timeout: Specify timeout for connection to master :arg timeout: Explicit operation timeout z+Empty value passed for a required argument.rR_scripts)rHrE)rrSr)rIr)r3rUrEcontextrHrWr%r%r& put_scripts  zElasticsearch.put_scriptcCs*|tkrtd|jjdt|d||dS)a ``_ :arg body: The ranking evaluation search definition, including search requests, document ratings and ranking metric definition. :arg index: A comma-separated list of index names to search; use `_all` or empty string to perform the operation on all indices :arg allow_no_indices: Whether to ignore if a wildcard indices expression resolves into no concrete indices. (This includes `_all` string or when no indices have been specified) :arg expand_wildcards: Whether to expand wildcard expression to concrete indices that are open, closed or both., default 'open', valid choices are: 'open', 'closed', 'none', 'all' :arg ignore_unavailable: Whether specified concrete indices should be ignored when unavailable (missing or closed) z2Empty value passed for a required argument 'body'.rKZ _rank_eval)rHrE)rrSr)rIr)r3rErTrHr%r%r& rank_evalszElasticsearch.rank_evalcCs(|tkrtd|jjdtd||dS)z Retrieve a script from the API. ``_ :arg id: Script ID :arg master_timeout: Specify timeout for connection to master z0Empty value passed for a required argument 'id'.rKr)rH)rrSr)rIr)r3rUrHr%r%r& get_scripts zElasticsearch.get_scriptcCs(|tkrtd|jjdtd||dS)a0 Remove a stored script from elasticsearch. ``_ :arg id: Script ID :arg master_timeout: Specify timeout for connection to master :arg timeout: Explicit operation timeout z0Empty value passed for a required argument 'id'.rr)rH)rrSr)rIr)r3rUrHr%r%r& delete_scripts zElasticsearch.delete_scriptcCs|jjdtdd|||dS)z ``_ :arg id: The id of the stored search template :arg body: The search definition template and its params rKZ_renderr})rHrE)r)rIr)r3rUrErHr%r%r&render_search_templatesz$Elasticsearch.render_search_templatercCs|jjdd|dS)zv `<>`_ :arg context: Select a specific context to retrieve API information about rKz/_scripts/painless/_context)rH)r)rI)r3rHr%r%r&scripts_painless_contextsz&Elasticsearch.scripts_painless_contextcCs|jjdd||dS)z ``_ :arg body: The script to execute rKz/_scripts/painless/_execute)rHrE)r)rI)r3rErHr%r%r&scripts_painless_executesz&Elasticsearch.scripts_painless_executecCs8|tkrtd|jjdt|dd||j|ddidS)a The /_search/template endpoint allows to use the mustache language to pre render search requests, before they are executed and fill existing templates with template parameters. ``_ :arg body: The request definitions (metadata-search request definition pairs), separated by newlines :arg index: A list of index names, or a string containing a comma-separated list of index names, to use as the default :arg ccs_minimize_roundtrips: Indicates whether network round-trips should be minimized as part of cross-cluster search requests execution, default 'true' :arg max_concurrent_searches: Controls the maximum number of concurrent searches the multi search api will execute :arg search_type: Search operation type, valid choices are: 'query_then_fetch', 'query_and_fetch', 'dfs_query_then_fetch', 'dfs_query_and_fetch' :arg typed_keys: Specify whether aggregation and suggester names should be prefixed by their respective types in the response z2Empty value passed for a required argument 'body'.rKrr}z content-typezapplication/x-ndjson)rHrEr)rrSr)rIrrF)r3rErTrHr%r%r&msearch_templates zElasticsearch.msearch_templateZinclude_unmappedcCs|jjdt|d||dS)a The field capabilities API allows to retrieve the capabilities of fields among multiple indices. ``_ :arg index: A list of index names, or a string containing a comma-separated list of index names; use `_all` or the empty string to perform the operation on all indices :arg body: Field json objects containing an array of field names :arg allow_no_indices: Whether to ignore if a wildcard indices expression resolves into no concrete indices. (This includes `_all` string or when no indices have been specified) :arg expand_wildcards: Whether to expand wildcard expression to concrete indices that are open, closed or both., default 'open', valid choices are: 'open', 'closed', 'none', 'all' :arg fields: A comma-separated list of field names :arg ignore_unavailable: Whether specified concrete indices should be ignored when unavailable (missing or closed) :arg include_unmapped: Indicates whether unmapped fields should be included in the response., default False rKZ _field_caps)rHrE)r)rIr)r3rTrErHr%r%r& field_caps"szElasticsearch.field_caps)N)N)rQN)rQNN)rQN)NN)rQN)rQN)NNN)rQNN)NNN)NN)N)N)NN)N)N)NN)NNN)rQNN)NNN)NNN)rQN)NNNN)NNN)NN)rQNNN)NNNN)NN)NN)N)N)NNN)N)NN)NN)NNN)/r< __module__ __qualname____doc__rr5r>rFrrJrLrXrTr[r\r]r^r_rcrorrrurvrwryrzr|r~rdrgrrrrrrrrrrrrrrrr __classcell__r%r%)r;r&r(Bs2{     $ + "  "   / m U    R   * '   $ * , % . 4         r()& __future__rloggingr)r exceptionsrcompatrrrr*r r+r r,r r-r r.rr/rr0rr1rr2rutilsrrr getLoggerloggerr'objectr(r%r%r%r&s"             -