Questions tagged [elasticsearch]
Elasticsearch is a free and open, distributed, RESTful search engine based on Lucene.
57,235
questions
0
votes
0
answers
12
views
React Javascript elastic search queries
in my api.js I want to check what type of query I received ( so if it was tagQuery I want to create nested objects, if it was countryQuery I want to create country objects and etc. ) So based on ...
1
vote
1
answer
12
views
Elasticsearch Index document count to query performance - is it linear?
I'm being asked to estimate the query throughput decrease for an imaginary ES index of 1B documents by "extrapolating from" the actual index we have of 10M docs.
Keeping things very simple - ...
-1
votes
0
answers
19
views
Javascript search queries [closed]
in my api.js I want to check what type of query I received ( so if it was tagQuery I want to create nested objects, if it was countryQuery I want to create country objects and etc. ) So based on ...
0
votes
0
answers
14
views
OpenSearch: aggregate geoshapes into buckets based on distance
I cannot find any working documentation or examples on how to query the data and aggregate the results into buckets based on distance.
example:
I would like to query the data and get back a clustering ...
0
votes
2
answers
25
views
Match with type phrase_prefix doesn't work when words mix numbers and letters
I'm trying to query as such:
{
"match": {
"query": "100",
"fields": "description",
"type": "phrase_prefix"
...
0
votes
1
answer
13
views
Why Kibana is not able authenticate Elasticsearch server because of security?
I am trying to deploy Elasticsearch and Kibana on the k8s cluster. I simply deploy Elasticsearch and Kibna it works perfectly. Then I try to add security by adding a username and password. ...
0
votes
0
answers
14
views
How do i keep response structure same in elastic
I am using elastic query like this
await client.search({
index: indexList,
q: `*${query}*`
})
I am getting response in hits array of objects. The strcuture is not same in every ...
0
votes
0
answers
6
views
How to convert incoming JSON data from HTTP response into a string and store it in a new field in Metricbeat?
I am using Metricbeat's HTTP module to make a request to the RabbitMQ API to retrieve queue data. However, the Metricbeat RabbitMQ module does not include some fields like incoming and delivery rate, ...
0
votes
0
answers
6
views
Elastic too many buckets exception on nested aggregation
I am running an aggregation
{
"metrics": [
{
"label": "person_1",
"id": ""
},
{
"...
0
votes
1
answer
15
views
Restore the old behavior for SearchResponse in Elasticsearch 8
Due to missing compatibility with the GeoBoundingBox query I am forced to use ad-hoc the new Elasticsearch 8 Java client. According to the documentation, when using the search, a document class must ...
1
vote
2
answers
25
views
How to solve Class "ElasticClient\ServiceProvider" not found
After upgrading babenkoivan/elastic-scout-driver package to ^3.1.0 version, I got this error message:
Class "ElasticClient\ServiceProvider" not found
I can't use any php artisan or composer ...
0
votes
0
answers
12
views
Elastic Polygon Shape query using Nest
I am trying to get the following Elastic query filter working by using Nest client
{
"geo_shape" : {
"SitePoint" : {
"shape" : {
"type" : "...
1
vote
1
answer
11
views
Mongoosastic search function undefined when using typescript
I'm using mongoose v6.0.0, and mongoosastic v5.0.0 and typescript when I try the following code after initializing the plugin and trying to set the types correctly it still tells me that PageModel....
0
votes
2
answers
20
views
Merge the result of two bool queries using two different sorting (of same type) fields
I have two different indexes which store data in different structure. I want to combine the results of query on these indexes based on the field of same type but different name in each of these ...
0
votes
1
answer
24
views
Elasticsearch boost documents where fulltext query substring exactly matches field
I'm using Elasticsearch 8.6 and I'm trying to boost documents in a full-text search where the value of a field is exactly contained within the query text. In other words, where a field is an exact ...
0
votes
0
answers
18
views
Elastic Search First Query is always slow and shards not getting distributed properly
I am creating per day index in Elastic Search ( version: 7.5.1 ). I have 3 nodes in total and 2 shards with one replica each, total disk: 5.6 TB and JVM Heap: 95.8 GB
per day index size is 40 GB with ...
0
votes
0
answers
16
views
Spring WebClient to send Flux to ElasticSearch using /_bulk api
What I would like to achieve:
Use Spring WebClient to send a Flux to ElasticSearch leveraging the /_bulk api.
https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-bulk.html
What I ...
0
votes
0
answers
17
views
Use Word Embedding models in. Elastic Search
I am trying use embedding models in elastic search following this tutorial
When I run this command
docker run -it --rm elastic/eland \
eland_import_hub_model \
--url https://username:password@...
0
votes
1
answer
12
views
Is it possible to get ONLY the original results from an elasticsearch query without elastic-added json
As the title suggests, I'm wondering if anyone is aware of a way to retrieve just the results of the query in a returned JSON array (that is: the data exactly as it was when written to the index).
i.e....
0
votes
0
answers
6
views
impementing autocomplete with nest elasticsearch
i am using nest version 7.17 in .net core and completion suggester
this is my code below
[HttpGet("[action]")]
public async Task<IActionResult> AutoComplete(string query)
{
...
0
votes
1
answer
13
views
Delete documents from Elasticsearch by DeleteByQueryAction
I am trying to delete documents from ElasticSearch which have a specific id.
I am doing this:
`// Create the low-level client
RestClient restClient = RestClient.builder( new HttpHost(hostName, ...
0
votes
0
answers
19
views
trying to connect elastic search with node.js
While attempting to establish a connection between Elasticsearch and Node.js, I encountered an issue where the SSL certificate utilized by the Elasticsearch server was found to be self-signed.
here is ...
1
vote
1
answer
24
views
Elasticsearch multi-term aggregation, but between records
I have a set of records in Elasticsearch, each record having some number of tags, i.e.:
{ id: 0, tags: ["ant", "bird", "dog", "fox"]},
{ id: 1, tags: [&...
0
votes
0
answers
12
views
Elasticsearch upgrade to 8.6 from 7.13 [closed]
We have been using Elasticsearch 7.13 for a search application for a long time now and we are planning to upgrade the same to 8.6. There are a lot of features that are new but I wanted to know ...
0
votes
0
answers
22
views
In elasticsearch join two indexes which have different schema(Like sql joins)
I have seen this post. But it was in 2015. So I just want to know if is there any way to achieve this, in elasticsearches recent releases.
My use case is like this, I have one index with the following ...
0
votes
1
answer
12
views
Weighted multi-term aggregation in elasticsearch
I'm trying to do a multi-term aggregation in Elasticsearch, but instead of simply counting the documents containing each set of terms, I would like it to sum the value of a third field.
So given data:
...
0
votes
0
answers
16
views
How to predict the Subgroup of a new entity
I have created the subgroups (Group_ID) based on Name, DOB & Zip, If a new record comes in, it should checks the condition (DOB & Zip should be same & first three characters of name should ...
-1
votes
1
answer
18
views
Configuring ElasticSearch SSL and Python Querying, Certificates Question
I have certificates from GoDaddy for my ElasticSearch instance. I'm trying to set it up and below I have the configuration for SSL. I can hit this via the browser easily and everything is fine. If I ...
0
votes
0
answers
15
views
Occasional variation in nearest neighbor document ID with Elasticsearch's approximate k-NN feature
I'm using Elasticsearch's approximate k-NN feature.
The problem is that when I repeat a query on the same index, sometimes the nearest neighbor document ID is different. From what I've read about ...
0
votes
0
answers
12
views
How to create ES query type rules with kibana create rule API using curl command?
I want to create kibana alert rules the type of ES query with curl command.
However I don't know how to implement.
0
votes
2
answers
21
views
Elasticsearch cannot be started (Could not load codec 'Lucene95'.)
I was installed latest version of ElasticSearch (8.6.2) and it worked fine. Then i realized that i need an older version (8.4.0), so i uninstalled it and then installed the older one.
Now when i try ...
0
votes
0
answers
32
views
+100
What is the best way to ingest/index markdown documents into Elasticsearch (in order to exploit their data)?
I've created a lot of markdown files with my knowledge.
one way, to produce some pdf from them,
another way, to benefit from Elasticsearch indexation
for that last part, I've added to the title, ...
0
votes
0
answers
8
views
how to get a lot of data in jupyter notebook from elasticsearch not using scoll API?
I am in confined environment so that I cannot download it.
And I should bring 40M data from elasticsearch
is there any good idea other than using Scroll API?
I tried requests like
import requests
...
0
votes
0
answers
24
views
How to create index mapping in Elastic.Clients.Elasticsearch for .Net
I'm using the .NET nuget package 'Elastic.Clients.Elasticsearch' (version 8) and trying to create an index mapping based on the below model.
How do I map the Employee members and its JobRole members? ...
0
votes
0
answers
11
views
AWS Opensearch/Elasticsearch index size jumped massively when trying to store compressed blob
I am using an AWS Opensearch cluster to store some historical data in indices every day. (An index for each date: 2023.03.24, 2023.03.23 etc..). Each index has 1:1 primary to replica shard ratio, and ...
0
votes
1
answer
24
views
Kubernetes copy secret into file via initContainer
I have a statefulSet where I have an ElasticSearch image running. I want to copy the certificates through Kubernetes secrets into files. I mkdir the folder where I want the certificates to go and then ...
0
votes
1
answer
10
views
How can I group logs by a certain portion of the log string in ElasticSearch?
I am doing an analysis on my logs in ElasticSearch and trying to figure out which 10 users hit a certain endpoint the most.
My log format is:
API request: [GET] /api/v1/person from user: 4fe5e06a-6h33-...
0
votes
0
answers
14
views
How to access a field named "value" in an ingest pipeline Painless script
I am working with a document schema over which I do not have control. There are nested fields in the mappings like predicates.description.value.
I would like to use an ingest pipeline to copy ...
0
votes
0
answers
13
views
How to resolve "module 'progressbar' has no attribute 'streams'"
Im trying to use Mordor-Elastic.py an script to ship security dataset (logs) to an elasticsearch distribution. The thing is, that the script has multiple progressbar functionality that doesnt work at ...
0
votes
0
answers
11
views
Elasticsearch ES7 migration - Failed to parse date field for three letter uppercase month
Using Elasticdump to migrate data from ES 5.3 to ES 7.10. Getting this error with date fields where month is all caps, three letters like JAN, FEB etc. Changing the data to Jan, Feb, Mar resolves the ...
0
votes
0
answers
9
views
Ship multiple json object in single line in file as separate document to ELK using Filebeat
I am new to ELK Stack. I have a requirement in which a file which contains json data as mentioned below in a single line or may be in next line.
File Content:
{"event":{"name":&...
0
votes
0
answers
4
views
Janusgraph is unable to connect to Elasticsearch running without SSL certs
Janusgraph is unable to connect to Elasticsearch running without SSL certs. Our Elasticsearch is hosted in GKE with basic auth and no SSL enabled. So, the Janusgraph is getting connection closed and ...
0
votes
2
answers
47
views
+50
Elasticsearch: Indexing .srt files
1
00:02:17,440 --> 00:02:20,375
Hello Bob,
2
00:02:20,476 --> 00:02:22,501
how are you doing today?
...
Consider a standard .srt file, which contains text data with timestamp information for ...
0
votes
0
answers
16
views
Improve elasticsearch aggreation performance
I am using elasticsearch aggregations to calculate counts for a faceted search. Therefore I define my general search query (e.g. status.keyword) and exlcude this filter from the status.keyword ...
0
votes
0
answers
20
views
How to parse log fields with fluentd-OpenSearch?
I have fluentd running in my Kubernetes cluster, collecting logs from Pods and sending them to OpenSearch.
The logs are formatted as JSON objects, such as:
{"logger_name":"a","...
0
votes
0
answers
10
views
Elasticsearch, learning-to-rank: How do I use document dependent features from external sources
I am trying to apply learningToRank to an es index, using the es ltr plugin.
The objects indexed are book records (metadata in a public library context).
One kind of features I wish to use are ...
0
votes
0
answers
21
views
in grafana, how to plot array stored in elasticsearch
i have data store in elasticsearch like this:
[
{
"ts":"2023-1-1",
"kpi": [
{
"name": "kpi-1",
...
0
votes
0
answers
20
views
Control/filter how to show only possible values
I'm trying to filter on Kibana Lens with controls and I would like to have only possible values when I choose a filter and I have to filter with another one.
Above an example:
| filter 1 | filter 2 |
|...
0
votes
0
answers
17
views
GetRepository(), CreateRepository(), DeleteRepository() methods no longer exists in Nest 7.x, how to use them?
I upgrade my project from .Net 4.5.2 to .Net 4.8.1 and of course nuget package "NEST" upgraded too.
In the NEST 7.X version we don't have anymore the next methods: GetRepository(), ...
0
votes
0
answers
14
views
How to monitor Publish and Delivery Rate of messages in RabbitMQ Queues using Metricbeat?
I am trying to monitor the publish and delivery rate of messages in RabbitMQ using Metricbeat, but I can't find any Metricbeat field that provides these metrics.
I have already configured Metricbeat ...