Questions tagged [elasticsearch]
Elasticsearch is a free and open, distributed, RESTful search engine based on Lucene.
54,412
questions
0
votes
1
answer
18
views
Elastic Search Result in List of POJO
Currently, I am mapping the elastic search hit to a POJO and then reiterating it to save in a list.
List<Content> contentList = new ArrayList<>();
final BoolQueryBuilder qb = ...
0
votes
1
answer
33
views
XML data display in grid using kibana and logstash
I wanted to display XML data using logstash and Kibana in grid format. using below conf file I am able to display data into grid but not able to split row data.
Example:
Output
logstash.conf file :
...
0
votes
1
answer
19
views
Search multi field with term query
I have some documents in a index..
"hits" : [
{
"_index" : "siem-referencedata-table-table2d526444eff99b1706053853ef7",
"_type" : "...
1
vote
1
answer
25
views
Cannot populate elasticsearch index using ```python manage.py search_index --rebuild``` in django using docker
I am using django, elasticsearch and postgresql from docker in separate containers. When I try to run python manage.py search_index --rebuild, I get the following error:
Traceback (most recent ...
-1
votes
1
answer
20
views
Why this query has 0 hits?
I have a document with ID of "students" in an index named "university". The document has the following content:
{
"1234567": {
name: "Jack",
...
0
votes
0
answers
21
views
Elasticsearch nested aggregations return duplicate value
This is data:
{
"search_product_sku" : "FD0044S",
"price" : 500.00,
"car_detail" : [
{
"car_brand" : "TOYOTA"...
0
votes
0
answers
16
views
Time function calculation in ElasticSearch
Using Elasticsearch 7.*, the below works fine:
#SQL1
POST _sql?format=txt
{"query": "Select Current_Date as Date, Current_Time as Time", "time_zone" : "US/Central&...
0
votes
0
answers
6
views
Elasticsearch/Kibana Upgrade Assistant only showing . indices
I am upgrading ES/K from 5.6 to 6 and then 7. I am looking at Upgrade Assistant to help with breaking changes, but it doesn't seem to pick up indices that contain the said breaking changes.
I've ...
0
votes
1
answer
11
views
OpenSearch Query Not Matching
I am trying to create a query that matches based off a file extension that is part of a key.
I know the following record exists in OpenSearch:
{
'_index': 'the_index',
'_type': 'some_type',
'_id'...
0
votes
0
answers
12
views
Elasticsearch query MUST conditions with MUST NOT
Given a customer purchase order elasticsearch index, I want to query for records under ALL the following criteria
purchase_datetime field greater than a specified date.
product_name field in a ...
0
votes
1
answer
9
views
elasticsearch move data from local device to cloud ealstic
Is there any way to copy all the data of an index from elasticsearch from my computer to cloud elastic ?
i'm working on localhost and now i want to migrate it to cloud.elastic.co
Cheers!
0
votes
0
answers
17
views
Controlling where shards are allocated
My setup:
two zoness: fast and slow with 5 nodes each.
fast nodes have ephemeral storage, whereas the slow nodes are NFS based.
Running Elasticsearch OSS v7.7.1. (I have no control over the version)
...
1
vote
0
answers
26
views
Elasticsearch container keeps exiting with these logs
I have a docker container with elasticsearch in it. I think when too much requests is sent to my server this container crashes (exits). Could you approve that this is because of the pressure on server?...
0
votes
1
answer
20
views
searching Mysql table with Elasticsearch
Lets say I have the following "expenses" MySQL Table:
id
amount
vendor
tag
1
100
google
foo
2
450
GitHub
bar
3
22
GitLab
fizz
4
75
AWS
buzz
I'm building an API that should return ...
0
votes
1
answer
27
views
Elasticsearch / Opensearch - intersection of common values in arrays
given
a = [1,2,3,4]
and
b = [1,3]
c = [5,6]
d = [1,6]
how can i find the exact number of common values of a with b,c,d in elasticsearch?
I would expect:
b -> 2
c -> 0
d -> 1
0
votes
0
answers
12
views
How to calculate & draw metrics of scripted metrics in elasticsearch
Problem description
we have log files from different devices parsed into our elastic search database, line by line. The log files are built as a ring buffer, so they always have a fixed size of 1000 ...
0
votes
0
answers
7
views
Grafana variable: Return all Elastic documents when selecting "All" and the attribute might be an empty list
Take the following Lucene query:
provision_org.keyword:$provision_org
If $provision_org has the value "hello", the query returns all documents where provision_org (a list) contains the item ...
0
votes
2
answers
43
views
How to basic search Elasticsearch via NEST
I'm very new to NEST and Elasticsearch but at my workplace they asked me to produce a wpf client to search and retrieve documents from elasticsearch.
This is an example of what is stored in Elastic
{
...
-2
votes
0
answers
25
views
I have a this List<Map<String, Object>> data need to sort this by nearLocation. this is possible
{
"data": [
{
"id": "ad4a6748-3d77-4eb8-9aa4-b7c11eff3df4",
"host_id": "fdd7732e-578f-4135-a644-749f2a567d55",
"...
0
votes
1
answer
21
views
How to filter irregular data on elasticsearch with logstash
I'm just learning to use elastic and I have a log like this.
*************************************************************************************
Task with ID = 119 is waiting for the message to ...
0
votes
0
answers
14
views
NoSuchMethodError: org.springframework.data.elasticsearch.core.mapping.ElasticsearchPersistentEntity.getInstanceCreatorMetadata()'
I am using "spring-data-elasticsearch" but
getting the below error while using findById(id) in spring data elasticsearch.
Note: save/update is working fine.
Can someone please help me here?
...
0
votes
0
answers
8
views
Is it possible to embed {{ctx.trigger.scheduled_time}} variable in the reporting url inside a watcher script?
I have deployed a watcher script that triggered for certain search criteria. The action of the watch is to generate a dashboard.pdf and send it through email.
Now the problem is, I'm using two systems ...
2
votes
1
answer
28
views
Elastic search Synonym completely eliminated by analyzer
I am using synonym file to create synonyms in elasticsearch, My requirement is to show photo frames of different sizes.
For example-
6x9, 6 x 9 => 6x9
But when I close and re-open the index, I am ...
-1
votes
0
answers
9
views
Not able to view some transactions in elastic, but requests can be seen in "Time spent by span type"
so I'm using Java Java 11.0.6, Agent name & version java 1.30.1. I am able to view entire transaction history for most of the transactions. Although there are some transactions (eg. SampleClass#...
0
votes
2
answers
20
views
How to install Elasticsearch with AWS EKS
I wanna install Elasticsearch in AWS EKS. But Elasticsearch is not recommended EFS Storage.
So I want to install Elasticsearch using AWS EKS + EC2 (Management Node Group) + EBS.
I'm curious about ...
0
votes
0
answers
30
views
Problem with Elasticsearch and getting results
I have a Elasticsearch in a dockercontainer, but I have problems getting results back.
My set up is like this:
In program.cs
var pool = new SingleNodeConnectionPool(new Uri(builder.Configuration....
0
votes
1
answer
30
views
How to make pagination search with SearchAfter() using .NET NEST API
I work on a small .NET 6 API project with elastic search using Nest package. I have an API controller that is supposed to send a specific number of results ex: 10 with every request with elasticSerach....
0
votes
1
answer
13
views
Log an arbitrary XML structure using logstash-logback-encoder
I'm using the logstash-logback-encoder library for logging traffic of a Java messaging service. The logs are stored in JSON files which are sent to Elasticsearch. So far I have been adding extra ...
0
votes
0
answers
12
views
mapper_parsing_exception while import dashboard to kibana
When I import a dashboard from kibana 7.5.1 to kibana 7.4.1, it failed with error "the file could not be processed". I call kibana import object api on kibana dev tool console instead, and ...
0
votes
1
answer
14
views
which elastic search node should I send rest calls to?
if I want to edit my index settings for example I want to change the number of replicas then I would have to send a request with the number of replicas through rest end point. my question is which ...
0
votes
0
answers
20
views
automate elastic enterprise with ansible playbook
I would really like someone's help on this platform to help me with this.
Task:
I want to deploy with ansible playbooks elastic search deployment template, instead of creating it manually in the ...
0
votes
0
answers
30
views
Indexing data from Azure to MongoDB and Elastic search
Currently, data is available in Azure, how to index the data which is present in azure into MongoDB and Elastic search.
0
votes
0
answers
13
views
Insert child document in Elasticsearch update_by_query
i have a parent-child model in Elasticsearch and i would like to add a new child to a parent based on a query. Naturally the update_by_user call is a candidate for this. However i struggle to insert a ...
0
votes
0
answers
15
views
Does ElasticSearch support OData?
So basically the question is as in the title. I haven't been able to found any relevant information about this. I've seen there are some smaller open source libraries but they don't have a big number ...
0
votes
1
answer
19
views
ElasticSearch: Query multiple AND with an OR only returning second half of query
I'm trying to create an ElasticSearch query that reads like this: (field1 == 1 && field2 != a) || (field3 == 2 && field4 != b)
I've referenced other Stack Overflow and came with this ...
0
votes
1
answer
10
views
Rename Indices when restoring snapshot in Elasticsearch, drop characters from index name
I am trying to rename some ES indices while restoring a buckup. I would like to drop some characters while doing it, e.g if my index is my_es_index-2022-10_tmp I would like to to be renamed to ...
0
votes
1
answer
22
views
How to transform JSON to send it to elasticsearch?
I have the following data and I want to ingest it into elasticsearch. I have stored this data in a JSON file and using filebeat I am shipping it to elasticsearch BUT when I view this data in ...
0
votes
0
answers
8
views
SSL fingerprint sent to Elasticsearch (Python) not recognized
I have implemented Elasticsearch 8.2 in Python (Django project). When I first ran the Elasticsearch instance on my Mac, it generated a user password, as well as a SHA-256 fingerprint.
I am trying to ...
0
votes
0
answers
13
views
Elasticsearch - split nested objects from an index into a new index
I have an index user-stats in Elastic that has documents as follows:
{
"userId": 1285641,
"pageVisits": [
{
"pageUrl": "/profile",
"...
1
vote
0
answers
23
views
Average response time from log files
I'm new to Elastic and Kibana, I'm working on log files that contains information about some operations on differents levels, I have a field timestamp that represent time when each operation has ...
0
votes
1
answer
8
views
How to label the names on x-axis and also change names accordingly in ad-hoc filters in grafana elasticsearch?
Here if i want to change the name of others to something else. how must I do in grafana. my datasource is elasticsearc
0
votes
1
answer
18
views
Logstash can't access logs if all users don't have write permissions on it
I am running logstash using docker and mounting a directory containing multiple log files but I have no output and the only solution is to give write permissions to all users on the directory ...
0
votes
0
answers
35
views
Is it possible in ElasticSearch to search from the output of previous query (multi layer filtration)
We have around 36K products. I am trying to do something like this in elastic.
Select all documents from index where brand = 'search_text', from this result, would like to further search pharma = '...
1
vote
1
answer
30
views
ElasticSearch Downtime From Closing and Opening Index
I'm managing an ElasticSearch cluster and I need to add an analyzer to one of my indices. The particular index I want to update is a bit more than 3TB. Will there be an excessive amount of downtime ...
0
votes
1
answer
10
views
About the immutableOpenmap in elasticsearch
I would like to ask what consideration is the immutableOpenmap in Elasticsearch designed for? What kind of utility does it have? It is used in both aliasmetadata and indexmetadata. My personal guess ...
0
votes
0
answers
18
views
Filter for max date in Opensearch Query DSL
I created a data table in Opensearch dashboards. I have 2 text fields (ID & Date) and the index pattern was created in AWS ElasticSearch. I would like to display the records where DATE = max(DATE) ...
0
votes
0
answers
38
views
Elasticsearch bulk upsert throwing status 400, not clear why
I am trying to update one field of a bunch of documents via a bulk upsert in a python application. I am successfully able to use upsert one at a time, but the bulk helper fails. I really need to do ...
0
votes
1
answer
21
views
error while send import request on kibana console
I send following request on Kibana console to try to import a local dashboard to kibana version 7.2.0
POST https://dcwidavcca0085.epg.nam.gm.com:5601/api/saved_objects/_import
{
"file"=&...
1
vote
1
answer
41
views
How do I control where my primary and replica shards are located?
So I have two zoness: fast and slow.
I'm looking to ensure the primary shards are in the fast nodes and the replicas are in the slow nodes.
I have the following cluster settings:
cluster.routing....
0
votes
0
answers
16
views
Combing a Terms Query and Numeric Range Query using Nest C#
I am are currently combining a TermQuery and a NumericRangeQuery against a nested object in a document.
Let's assume
{ "id": "329", "number": 150}
Then the Nest C# code
...