Kibana elasticsearch plugin goes red


(Jose Carlos) #1

Hi All,

We are using readonlyrest Enterprise, and, sometimes, elasticsearch plugin for kibana goes to red, after several minutes goes back to green.

{“type”:“log”,"@timestamp":“2018-06-01T08:00:11Z”,“tags”:[“status”,“ui settings”,“error”],“pid”:34485,“state”:“red”,“message”:“Status changed from green to red - Elasticsearch plugin is red”,“prevState”:“green”,“prevMsg”:“Ready”}

In ES we have this error at the same time (but I do not know if it is related with Kibana problem):

it seems that Kibana is asking for two kibana indexes at the same time, but we do not why is doing that…

[2018-06-01T08:00:11,576][WARN ][r.suppressed ] path: /.kibana_operacion_mantenimiento%2C.kibana_administracion/config/_search, params: {index=.kibana_operacion_mantenimiento,.kibana_administracion, type=config}
org.elasticsearch.action.search.SearchPhaseExecutionException:
at org.elasticsearch.action.search.AbstractSearchAsyncAction.onPhaseFailure(AbstractSearchAsyncAction.java:271) [elasticsearch-5.5.1.jar:5.5.1]
at org.elasticsearch.action.search.FetchSearchPhase$1.onFailure(FetchSearchPhase.java:92) [elasticsearch-5.5.1.jar:5.5.1]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.onFailure(ThreadContext.java:623) [elasticsearch-5.5.1.jar:5.5.1]
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:39) [elasticsearch-5.5.1.jar:5.5.1]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_151]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_151]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_151]
Caused by: java.lang.ClassCastException

And here it is our readonlyrest configuration:

readonlyrest:
ssl:
keystore_file: “/etc/elasticsearch/ssl-private/keystore.jks”
keystore_pass: password
key_pass: password

prompt_for_basic_auth: false

user_groups_providers:

name: GroupsService
groups_endpoint: “http://mxulomih:8081/WSUserValidation/groups
auth_token_name: “user”
auth_token_passed_as: QUERY_PARAM # HEADER OR QUERY_PARAM
response_groups_json_path: “$…groups[?(@.name)].name” # see: https://github.com/json-path/JsonPath
cache_ttl_in_sec: 600
access_control_rules:

name: ‘::KIBANA-SRV::’
auth_key: ‘kibana:password’

name: ‘::GRAFANA::’
indices : [ cdrs* ]
auth_key: ‘grafana:password’

name: “ADMINISTRACION”
proxy_auth: “*”
kibana_index: .kibana_administracion
kibana_access: rw
kibana_hide_apps: [“readonlyrest_kbn”]
groups_provider_authorization:
user_groups_provider: GroupsService
groups: [“administracion”]

name: “ROBOTIZACION”
proxy_auth: “”
kibana_index: .kibana_robotizacion
kibana_access: rw
indices : [ cdrs, .kibana_robotizacion]
kibana_hide_apps: [“readonlyrest_kbn”, “timelion”, “kibana:dev_tools”, “kibana:management”]
groups_provider_authorization:
user_groups_provider: “GroupsService”
groups: [“robotizacion”]

name: “DESPLIEGUE”
proxy_auth: “”
kibana_index: .kibana_despliegue
kibana_access: rw
indices : [ cdrs, .kibana_despliegue]
kibana_hide_apps: [“readonlyrest_kbn”, “timelion”, “kibana:dev_tools”, “kibana:management”]
groups_provider_authorization:
user_groups_provider: “GroupsService”
groups: [“despliegue”]

name: “INGENIERIA”
proxy_auth: “”
kibana_index: .kibana_ingenieria
kibana_access: rw
indices : [ cdrs, .kibana_ingenieria]
kibana_hide_apps: [“readonlyrest_kbn”, “timelion”, “kibana:dev_tools”, “kibana:management”]
groups_provider_authorization:
user_groups_provider: “GroupsService”
groups: [“ingenieria”]

name: “OPERACION_MANTENIMIENTO”
proxy_auth: “”
kibana_index: .kibana_operacion_mantenimiento
kibana_access: rw
indices : [ cdrs, .kibana_operacion_mantenimiento]
kibana_hide_apps: [“readonlyrest_kbn”, “timelion”, “kibana:dev_tools”, “kibana:management”]
groups_provider_authorization:
user_groups_provider: “GroupsService”
groups: [“operacion_mantenimiento”]

name: “PLANIFICACION”
proxy_auth: “”
kibana_index: .kibana_planificacion
kibana_access: rw
indices : [ cdrs, .kibana_planificacion]
kibana_hide_apps: [“readonlyrest_kbn”, “timelion”, “kibana:dev_tools”, “kibana:management”]
groups_provider_authorization:
user_groups_provider: “GroupsService”
groups: [“planificacion”]

name: “SEGURIDAD”
proxy_auth: “”
kibana_index: .kibana_seguridad
kibana_access: rw
indices : [ cdrs, .kibana_seguridad]
kibana_hide_apps: [“readonlyrest_kbn”, “timelion”, “kibana:dev_tools”, “kibana:management”]
groups_provider_authorization:
user_groups_provider: “GroupsService”
groups: [“seguridad”]

Any ideas about what’s going wrong??

Thanks in advance


(Simone Scarduzio) #2

Hello @JosCar!
What ROR Enterprise version is this? Because we fixed something very similar in 1.16.20.


(Felipe C.) #3

readonlyrest_kbn_enterprise-1.16.18

How could we get the last version??

Thanks in advance

Felipe


(Felipe C.) #4

We have downloaded the new version: readonlyrest_kbn_enterprise-1.16.20_es5.5.1.zip
But, it is safe to use it with : readonlyrest-1.16.18_es5.5.1.zip ???

Should we upgrade elasticsearch plugin to 16.20 also???

Thanks in advance


(Simone Scarduzio) #5

Hi @fcerezo, please update both plugins.