Kibana elasticsearch plugin goes red


(Felipe C.) #1

Hi All,

We are using readonlyrest enterprise, and, sometimes, elasticsearch plugin for kibana goes to red, after several minutes goes back to green.

{“type”:“log”,"@timestamp":“2018-06-01T08:00:11Z”,“tags”:[“status”,“ui settings”,“error”],“pid”:34485,“state”:“red”,“message”:“Status changed from green to red - Elasticsearch plugin is red”,“prevState”:“green”,“prevMsg”:“Ready”}

In ES we have this error at the same time (but I do not know if it is related with Kibana problem):

it seems that Kibana is asking for two kibana indexes at the same time, but we do not why is doing that…

[2018-06-01T08:00:11,576][WARN ][r.suppressed ] path: /.kibana_operacion_mantenimiento%2C.kibana_administracion/config/_search, params: {index=.kibana_operacion_mantenimiento,.kibana_administracion, type=config}
org.elasticsearch.action.search.SearchPhaseExecutionException:
at org.elasticsearch.action.search.AbstractSearchAsyncAction.onPhaseFailure(AbstractSearchAsyncAction.java:271) [elasticsearch-5.5.1.jar:5.5.1]
at org.elasticsearch.action.search.FetchSearchPhase$1.onFailure(FetchSearchPhase.java:92) [elasticsearch-5.5.1.jar:5.5.1]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.onFailure(ThreadContext.java:623) [elasticsearch-5.5.1.jar:5.5.1]
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:39) [elasticsearch-5.5.1.jar:5.5.1]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_151]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_151]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_151]
Caused by: java.lang.ClassCastException

And here it is our readonlyrest configuration:

readonlyrest:
ssl:
keystore_file: “/etc/elasticsearch/ssl-private/keystore.jks”
keystore_pass: password
key_pass: password

prompt_for_basic_auth: false

user_groups_providers:

access_control_rules:

  • name: ‘::KIBANA-SRV::’
    auth_key: ‘kibana:password’

  • name: ‘::GRAFANA::’
    indices : [ cdrs* ]
    auth_key: ‘grafana:password’

  • name: “ADMINISTRACION”
    proxy_auth: “*”
    kibana_index: .kibana_administracion
    kibana_access: rw
    kibana_hide_apps: [“readonlyrest_kbn”]
    groups_provider_authorization:
    user_groups_provider: GroupsService
    groups: [“administracion”]

  • name: “ROBOTIZACION”
    proxy_auth: ""
    kibana_index: .kibana_robotizacion
    kibana_access: rw
    indices : [ cdrs
    , .kibana_robotizacion]
    kibana_hide_apps: [“readonlyrest_kbn”, “timelion”, “kibana:dev_tools”, “kibana:management”]
    groups_provider_authorization:
    user_groups_provider: “GroupsService”
    groups: [“robotizacion”]

  • name: “DESPLIEGUE”
    proxy_auth: ""
    kibana_index: .kibana_despliegue
    kibana_access: rw
    indices : [ cdrs
    , .kibana_despliegue]
    kibana_hide_apps: [“readonlyrest_kbn”, “timelion”, “kibana:dev_tools”, “kibana:management”]
    groups_provider_authorization:
    user_groups_provider: “GroupsService”
    groups: [“despliegue”]

  • name: “INGENIERIA”
    proxy_auth: ""
    kibana_index: .kibana_ingenieria
    kibana_access: rw
    indices : [ cdrs
    , .kibana_ingenieria]
    kibana_hide_apps: [“readonlyrest_kbn”, “timelion”, “kibana:dev_tools”, “kibana:management”]
    groups_provider_authorization:
    user_groups_provider: “GroupsService”
    groups: [“ingenieria”]

  • name: “OPERACION_MANTENIMIENTO”
    proxy_auth: ""
    kibana_index: .kibana_operacion_mantenimiento
    kibana_access: rw
    indices : [ cdrs
    , .kibana_operacion_mantenimiento]
    kibana_hide_apps: [“readonlyrest_kbn”, “timelion”, “kibana:dev_tools”, “kibana:management”]
    groups_provider_authorization:
    user_groups_provider: “GroupsService”
    groups: [“operacion_mantenimiento”]

  • name: “PLANIFICACION”
    proxy_auth: ""
    kibana_index: .kibana_planificacion
    kibana_access: rw
    indices : [ cdrs
    , .kibana_planificacion]
    kibana_hide_apps: [“readonlyrest_kbn”, “timelion”, “kibana:dev_tools”, “kibana:management”]
    groups_provider_authorization:
    user_groups_provider: “GroupsService”
    groups: [“planificacion”]

  • name: “SEGURIDAD”
    proxy_auth: ""
    kibana_index: .kibana_seguridad
    kibana_access: rw
    indices : [ cdrs
    , .kibana_seguridad]
    kibana_hide_apps: [“readonlyrest_kbn”, “timelion”, “kibana:dev_tools”, “kibana:management”]
    groups_provider_authorization:
    user_groups_provider: “GroupsService”
    groups: [“seguridad”]

Any ideas about what’s going wrong??

Thanks in advance
Felipe