Connection Timeout with Elasticsearch

from datetime import datetime from elasticsearch import Elasticsearch es = Elasticsearch() doc = { 'author': 'kimchy', 'text': 'Elasticsearch: cool. bonsai cool.', 'timestamp':...

Elasticsearch is still initializing the kibana index

When I am trying to start Kibana I am facing the following issue. I first restarted my elasticsearch server it was running successfully. After starting Elasticsearch I tried to start Kibana but no...

Elasticsearch: Failed to connect to localhost port 9200 - Connection refused

When I tried connecting to Elasticsearch using the curl http://localhost:9200 it is working fine. But when I run the curl http://IpAddress:9200 it is throwing an error saying Failed to connect...

Elastic Search : Match Query not working in Nested Bool Filters

I am able to get data for the following elastic search query : { "query": { "filtered": { "query": [], "filter": { "bool": { "must": [ { ...

low disk watermark [??%] exceeded on

I use Elasticsearch 1.4.4 in my development machine (a single notebook). Everything is set as default because I never changed any settings. When I start it, I usually get the following...

Logging to ElasticSearch using Serilog

Is there a helpfull soul out there, who can help me get Serilog and its ElasticSearch module working in PowerShell? I've found a guy that did get the rolling file log working, but I've been unable...

Elasticsearch Scripting: updating array value

This is my document { "name": "andrew", "b": [{"x":"c1", "y": 0}, {"x":"c2", "y": 0}] } I want to find element in the array field "b" and update the entire object. I tried this script...

How to handle exceptions with Swagger?

I am building some test APIs using swagger (1.5) and JAX-rs with Jersey (1.13) and I m trying to implement exception handling. For example I have the following code when receiving the results from...

Elasticsearch terms aggregation on a not analyzed field with filters

I have a not analyzed field on my index: "city": { "type": "string", "index": "not_analyzed" } I have an aggregation like the following: "aggs": { "city": { "terms": { ...

Elasticsearch User federation for Keycloak

Does Keycloak have a plugin for config a user federation to use a pre-existent Elasticsearch index? If it doesn't, does anyone have the documentation to implement my own user federation to use my...

ES-v5.0.1 throw java.lang.SecurityException while snapshot

Elasticsearch version:v5.0.1 Plugins installed: [repository-hdfs] JVM version: java version "1.8.0_92" Java(TM) SE Runtime Environment (build 1.8.0_92-b14) Java HotSpot(TM) 64-Bit Server VM (build...

How to increase vm.max_map_count?

I'm trying to run Elastic search in an Ubuntu EC2 machine (t2.medium). But I'm getting the message: max virtual memory areas vm.max_map_count [65530] is too low, increase to at least...

Elasticsearch null values aggregation, sum beng 0 and avg being null?

I am using elasticsearch to do analyze and found that when doing the aggregation, if one bucket all elements are null value, the sum result is 0, but avg result is null. { "size" : 0, ...

Elastic search snapshot restore another cluster

How to restore elastic search snapshot another cluster? without repository-s3, repository-hdfs, repository-azure, repository-gcs.

Elasticsearch NEST Document count for default index

I am using NEST for Elasticsearch 6 and would like to get the number of documents for the default index. The documentation refers to the 1.1 version of the API which no longer seems to work. I...

Create index with new searchkick options in rails console

I am looking for a way to seamlessly update my Elasticsearch index. I am moving from: class Product < ApplicationRecord searchkick end To: class Product < ApplicationRecord searchkick...

ES Rest High Level Client throws SocketTimeoutException after being idle for sometime

RestHighLevelClient is used to connect to ES 6.4(hosted on AWS) in a spring-boot app. When the app goes idle for some time, and request arrives, then the RestHighLevelClient throws...

Best approach for sending logs from ECS Fargate into Elasticsearch

We have a setup with multiple containers running NodeJS services(node:11-alpine docker image) deployed in AWS ECS Fargate. We already have a running ElasticSearch instance collecting logs from...

ElasticSearch Node Failure

My Elasticsearch cluster dropped from 2B documents to 900M Records, on AWS it shows Relocating shards: 4 Whilst Showing Active Shards: 35 and Active primary shards: 34 (Might not be relevant...

Elasticsearch: why exact match has lower score than partial match

my question I search the word form, but the exact match word form is not the fisrt in result. Is there any way to solve this problem? my search query { "query": { "match": { "word":...

connect filebeat to logstash

I am trying to setup filebeat to logstash and get below errors at filebeat and logstash end: filebeat; Version: 7.7.0 logstash "number" : "7.8.0" Modified /etc/filebeat/filebeat.yml: enabled:...

Bootstrap method initialization exception - Elasticsearch 7.8.0

Using java-high-level-rest client when we call getMapping for index or create index functions below errors get generated every time. almost for all the index related calls are generating this...

Access Control in Elastic - missing authentication credentials for REST request

I am using Elastic 7.9.2 version and wanted to use security. so I ran : bin/elasticsearch-certutil cert -out config/elastic-certificates.p12 -pass "" and then added xpack.security.enabled:...

Elasticsearch and CAP Theorem

Elasticsearch is a distributed system. As per the CAP theorem, it can satisfy any 2 out of 3 properties. Which one is compromised in Elasticsearch?

Kafka js container cannot connect to kafka container on the same docker stack

I have a ELKK docker compose stack and I'm trying to connect a kafka client (kafka js) to kafka but with no luck. docker-compose.yml version: "3.7" services: zookeeper: image:...

Using apache-airflow-providers-snowflake on airflow (no module named Snowflake)

I have installed package apache-airflow-providers-snowflake on airflow on docker and i am getting error No module named Snowflake Please refer attachment (check the error mentioned for the...

Kibana startup fails with License information and later with Unable to retrieve version information

I'm tried to follow this guideline for installing ELK on Centos 8 (on top of one AWS cluster). After installing elastic and kibana, the kibana startup failed with: *"message":"License information...

Elastic Search failed to start after enabling xpack

I am trying to enable xpack in elasticsearch and followed the getting started blog post from elasticsearch site. Things I did: I ran this command $/usr/share/elasticsearch/elasticsearch-certutil...

How to run Elasticsearch 6 on an Apple Silicon Mac?

For developing an application, I need to run Elasticsearch 6 on an Apple Silicon Mac. I've tried to run it with Docker. Reading Docker Desktop for Apple silicon, I've installed Rosetta2...

AWS Opensearch with SAML authentication

I have configured SAML for my AWS Opensearch Service Dashboard and keep getting 'Internal Server Error' after succesfully logging in to Okta and getting redirected to the sso endpoint...