By type
AJSC HOME directory is /appl/dmaapMR1 AJSC Conf Directory is /appl/dmaapMR1/bundleconfig Starting using /appl/dmaapMR1/lib/ajsc-runner-3.0.11-oss.jar Initializing the AJSC . . . AJSC_HOME has been set to: /appl/dmaapMR1 AJSC_CONF_HOME has been set to: /appl/dmaapMR1/bundleconfig System properties scanning directory has been set to: /appl/dmaapMR1/bundleconfig/etc/sysprops AJSC_TEMP_DIR has been set to: /appl/dmaapMR1/jetty/webapps/ajsc-temp.dir7885904937650816729 APP_SERVLET_URL_PATTERN has been set to: (empty/root), and will be registered as '/' with GRM. APP_RESTLET_URL_PATTERN has been set to: /rest, and will be registered with GRM. AJSC_CONTEXT_PATH has been set to: / AJSC_WAR_PATH has been set to: /appl/dmaapMR1/lib/ajsc.war AJSC_HTTP_PORT has been set to: 3904 2021-06-07 13:58:25.715:INFO::main: Logging initialized @757ms to org.eclipse.jetty.util.log.StdErrLog 2021-06-07 13:58:25.892:INFO:oejs.Server:main: jetty-9.4.z-SNAPSHOT; built: 2018-08-14T14:46:56.477Z; git: 1f9703cf836af6c70ac0665fbc6790c0a8229a7a; jvm 1.8.0_212-b04 2021-06-07 13:58:27.070:INFO:oejw.StandardDescriptorProcessor:main: NO JSP Support for /, did not find org.eclipse.jetty.jsp.JettyJspServlet 2021-06-07 13:58:27.111:INFO:oejs.session:main: DefaultSessionIdManager workerName=node0 2021-06-07 13:58:27.111:INFO:oejs.session:main: No SessionScavenger set, using defaults 2021-06-07 13:58:27.112:INFO:oejs.session:main: node0 Scavenging every 660000ms 13:58:27,172 |-INFO in ch.qos.logback.classic.LoggerContext[module.ajsc.namespace.name_IS_UNDEFINED] - Found resource [/appl/dmaapMR1/bundleconfig/etc/logback.xml] at [file:/appl/dmaapMR1/bundleconfig/etc/logback.xml] 13:58:27,245 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set 13:58:27,251 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - Will scan for changes in [file:/appl/dmaapMR1/bundleconfig/etc/logback.xml] 13:58:27,251 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - Setting ReconfigureOnChangeTask scanning period to 3 seconds 13:58:27,256 |-INFO in ch.qos.logback.classic.joran.action.ContextNameAction - Setting logger context name as [module.ajsc.namespace.name_IS_UNDEFINED] 13:58:27,256 |-INFO in ch.qos.logback.classic.joran.action.JMXConfiguratorAction - begin 13:58:27,266 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:58:27,272 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 13:58:27,282 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:58:27,341 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:58:27,341 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [INFO] 13:58:27,344 |-WARN in ch.qos.logback.core.ConsoleAppender[INFO] - Encoder has not been set. Cannot invoke its init method. 13:58:27,344 |-ERROR in ch.qos.logback.core.ConsoleAppender[INFO] - No encoder set for the appender named "INFO". 13:58:27,345 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:58:27,345 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [DEBUG] 13:58:27,345 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:58:27,345 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:58:27,345 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ERROR] 13:58:27,346 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:58:27,347 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap.dmf.mr.service] to INFO 13:58:27,347 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap.dmf.mr.service.impl] to INFO 13:58:27,348 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap.dmf.mr.resources] to INFO 13:58:27,348 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap.dmf.mr.resources.streamReaders] to INFO 13:58:27,348 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap.dmf.mr.backends] to INFO 13:58:27,348 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap.dmf.mr.backends.kafka] to INFO 13:58:27,348 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap.dmf.mr.backends.memory] to INFO 13:58:27,348 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap.dmf.mr.beans] to INFO 13:58:27,348 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap.dmf.mr.constants] to INFO 13:58:27,348 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap.dmf.mr.exception] to INFO 13:58:27,348 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap.dmf.mr.listener] to INFO 13:58:27,348 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap.dmf.mr.metabroker] to INFO 13:58:27,348 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap.dmf.mr.metrics.publisher] to INFO 13:58:27,348 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap.dmf.mr.metrics.publisher.impl] to INFO 13:58:27,348 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap.dmf.mr.security] to INFO 13:58:27,348 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap.dmf.mr.security.impl] to INFO 13:58:27,348 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap.dmf.mr.transaction] to INFO 13:58:27,348 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.att.dmf.mr.transaction.impl] to INFO 13:58:27,348 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap.dmf.mr.metabroker] to INFO 13:58:27,348 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap.dmf.mr.metabroker] to INFO 13:58:27,348 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap.dmf.mr.utils] to INFO 13:58:27,348 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap.mr.filter] to INFO 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap.service] to INFO 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.dmaap] to INFO 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.springframework] to WARN 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.springframework] to false 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.springframework.beans] to WARN 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.springframework.beans] to false 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.springframework.web] to WARN 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.springframework.web] to false 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.blog.spring.jms] to WARN 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [com.blog.spring.jms] to false 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [ajsc] to WARN 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [ajsc] to false 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [ajsc.RouteMgmtService] to INFO 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [ajsc.RouteMgmtService] to false 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [ajsc.ComputeService] to INFO 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [ajsc.ComputeService] to false 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [ajsc.VandelayService] to WARN 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [ajsc.VandelayService] to false 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [ajsc.FilePersistenceService] to WARN 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [ajsc.FilePersistenceService] to false 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [ajsc.UserDefinedJarService] to WARN 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [ajsc.UserDefinedJarService] to false 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [ajsc.UserDefinedBeansDefService] to WARN 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [ajsc.UserDefinedBeansDefService] to false 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [ajsc.LoggingConfigurationService] to WARN 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [ajsc.LoggingConfigurationService] to false 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [ajsc.utils] to WARN 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [ajsc.utils] to false 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [ajsc.utils.DME2Helper] to INFO 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [ajsc.utils.DME2Helper] to false 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [ajsc.filters] to DEBUG 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [ajsc.filters] to false 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [ajsc.beans.interceptors] to DEBUG 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [ajsc.beans.interceptors] to false 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [ajsc.restlet] to DEBUG 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [ajsc.restlet] to false 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [ajsc.servlet] to DEBUG 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [ajsc.servlet] to false 13:58:27,349 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.att] to WARN 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [com.att] to false 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.att.ajsc.csi.logging] to WARN 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [com.att.ajsc.csi.logging] to false 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.att.ajsc.filemonitor] to WARN 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [com.att.ajsc.filemonitor] to false 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.att.nsa.dmaap.util] to INFO 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [com.att.nsa.dmaap.util] to false 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.att.cadi.filter] to INFO 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [com.att.cadi.filter] to false 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [net.sf] to WARN 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [net.sf] to false 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.commons.httpclient] to WARN 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.apache.commons.httpclient] to false 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.commons] to WARN 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.apache.commons] to false 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.coyote] to WARN 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.apache.coyote] to false 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.jasper] to WARN 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.apache.jasper] to false 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.camel] to WARN 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.apache.camel] to false 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.cxf] to WARN 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.apache.cxf] to false 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.camel.processor.interceptor] to WARN 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.apache.camel.processor.interceptor] to false 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.cxf.jaxrs.interceptor] to WARN 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.apache.cxf.jaxrs.interceptor] to false 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.cxf.service] to WARN 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.apache.cxf.service] to false 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.restlet] to DEBUG 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.restlet] to false 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.camel.component.restlet] to DEBUG 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.apache.camel.component.restlet] to false 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.kafka] to DEBUG 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.apache.kafka] to false 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.zookeeper] to INFO 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.apache.zookeeper] to false 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.I0Itec.zkclient] to DEBUG 13:58:27,350 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [org.I0Itec.zkclient] to false 13:58:27,351 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [ch.qos.logback.classic] to INFO 13:58:27,351 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [ch.qos.logback.classic] to false 13:58:27,351 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [ch.qos.logback.core] to INFO 13:58:27,351 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [ch.qos.logback.core] to false 13:58:27,351 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:58:27,351 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [auditLogs] 13:58:27,352 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:58:27,352 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:58:27,352 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [perfLogs] 13:58:27,352 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 13:58:27,353 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 13:58:27,356 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC-audit] 13:58:27,356 |-ERROR in ch.qos.logback.core.joran.action.AppenderRefAction - Could not find an appender named [Audit-Record-Queue]. Did you define it below instead of above in the configuration file? 13:58:27,356 |-ERROR in ch.qos.logback.core.joran.action.AppenderRefAction - See http://logback.qos.ch/codes.html#appender_order for more details. 13:58:27,356 |-ERROR in ch.qos.logback.classic.AsyncAppender[ASYNC-audit] - No attached appenders found. 13:58:27,357 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [AuditRecord] to INFO 13:58:27,357 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [AuditRecord] to false 13:58:27,357 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[AuditRecord] 13:58:27,357 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [AuditRecord_DirectCall] to INFO 13:58:27,357 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [AuditRecord_DirectCall] to false 13:58:27,357 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[AuditRecord_DirectCall] 13:58:27,357 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 13:58:27,357 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC-perf] 13:58:27,357 |-ERROR in ch.qos.logback.core.joran.action.AppenderRefAction - Could not find an appender named [Performance-Tracker-Queue]. Did you define it below instead of above in the configuration file? 13:58:27,357 |-ERROR in ch.qos.logback.core.joran.action.AppenderRefAction - See http://logback.qos.ch/codes.html#appender_order for more details. 13:58:27,357 |-ERROR in ch.qos.logback.classic.AsyncAppender[ASYNC-perf] - No attached appenders found. 13:58:27,357 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [PerfTrackerRecord] to INFO 13:58:27,357 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [PerfTrackerRecord] to false 13:58:27,357 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC-perf] to Logger[PerfTrackerRecord] 13:58:27,357 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [perfLogs] to Logger[PerfTrackerRecord] 13:58:27,357 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to DEBUG 13:58:27,357 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [DEBUG] to Logger[ROOT] 13:58:27,357 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ERROR] to Logger[ROOT] 13:58:27,357 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [INFO] to Logger[ROOT] 13:58:27,357 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT] 13:58:27,357 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 13:58:27,358 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@3e27ba32 - Registering current configuration as safe fallback point 2021-06-07 13:58:27.363:INFO:oejshC.ROOT:main: Initializing Spring root WebApplicationContext isosgiEnable= false DocService initialized successfully /appl/dmaapMR1/services/deployed/ /appl/dmaapMR1/services/deployed/ PropertiesService initialized successfully DocService initialized successfully UserDefinedJarService initialized successfully UserDefinedBeansDefService initialized successfully ComputeService::start Adding intercept strategies to the context Intercept strategies added to the context: SpringCamelContext(default-0) with spring id org.springframework.web.context.WebApplicationContext: --> [] "2021-06-07 13:58:35,358 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [org.springframework.context.annotation.internalCommonAnnotationProcessor] "13:58:35.358 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [org.springframework.context.annotation.internalCommonAnnotationProcessor] "2021-06-07 13:58:35,361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [apiKeysServiceImpl] "13:58:35.361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [apiKeysServiceImpl] "2021-06-07 13:58:35,361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [ServicePropertiesListener] "13:58:35.361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [ServicePropertiesListener] "2021-06-07 13:58:35,361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [MMAgentUtil] "13:58:35.361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [MMAgentUtil] "2021-06-07 13:58:35,361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [contentLengthInterceptor] "13:58:35.361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [contentLengthInterceptor] "2021-06-07 13:58:35,361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [cambriaExMapper] "13:58:35.361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [cambriaExMapper] "2021-06-07 13:58:35,361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [adminRestService] "13:58:35.361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [adminRestService] "2021-06-07 13:58:35,361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [defLength] "13:58:35.361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [defLength] "2021-06-07 13:58:35,361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [transactionRestService] "13:58:35.361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [transactionRestService] "2021-06-07 13:58:35,361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [ServicePropertiesMap] "13:58:35.361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [ServicePropertiesMap] "2021-06-07 13:58:35,361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [propertyReader] "13:58:35.361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [propertyReader] "2021-06-07 13:58:35,361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [org.springframework.context.annotation.internalConfigurationAnnotationProcessor] "13:58:35.361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [org.springframework.context.annotation.internalConfigurationAnnotationProcessor] "2021-06-07 13:58:35,361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [servicePropsBean] "13:58:35.361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [servicePropsBean] "2021-06-07 13:58:35,361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [eventsRestService] "13:58:35.361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [eventsRestService] "2021-06-07 13:58:35,361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [eventsServiceImpl] "13:58:35.361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [eventsServiceImpl] "2021-06-07 13:58:35,361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [org.springframework.context.annotation.internalPersistenceAnnotationProcessor] "13:58:35.361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [org.springframework.context.annotation.internalPersistenceAnnotationProcessor] "2021-06-07 13:58:35,361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [org.springframework.context.support.PropertySourcesPlaceholderConfigurer#0] "13:58:35.361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [org.springframework.context.support.PropertySourcesPlaceholderConfigurer#0] "2021-06-07 13:58:35,361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [topicRestService] "13:58:35.361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [topicRestService] "2021-06-07 13:58:35,361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [metricsRestService] "13:58:35.361 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [metricsRestService] "2021-06-07 13:58:35,362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [dMaaPKafkaConsumerFactory] "13:58:35.362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [dMaaPKafkaConsumerFactory] "2021-06-07 13:58:35,362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [org.springframework.context.annotation.internalRequiredAnnotationProcessor] "13:58:35.362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [org.springframework.context.annotation.internalRequiredAnnotationProcessor] "2021-06-07 13:58:35,362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [jacksonProvider] "13:58:35.362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [jacksonProvider] "2021-06-07 13:58:35,362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [dMaaPZkConfigDb] "13:58:35.362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [dMaaPZkConfigDb] "2021-06-07 13:58:35,362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [curator] "13:58:35.362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [curator] "2021-06-07 13:58:35,362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [kafkaPublisher] "13:58:35.362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [kafkaPublisher] "2021-06-07 13:58:35,362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [UIRestServices] "13:58:35.362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [UIRestServices] "2021-06-07 13:58:35,362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [helloWorld] "13:58:35.362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [helloWorld] "2021-06-07 13:58:35,362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [transactionServiceImpl] "13:58:35.362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [transactionServiceImpl] "2021-06-07 13:58:35,362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [webExMapper] "13:58:35.362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [webExMapper] "2021-06-07 13:58:35,362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [mmb] "13:58:35.362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [mmb] "2021-06-07 13:58:35,362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [dMaaPKafkaMetaBroker] "13:58:35.362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [dMaaPKafkaMetaBroker] "2021-06-07 13:58:35,362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [org.springframework.beans.factory.config.MethodInvokingFactoryBean#0] "13:58:35.362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [org.springframework.beans.factory.config.MethodInvokingFactoryBean#0] "2021-06-07 13:58:35,362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [org.springframework.context.annotation.internalAutowiredAnnotationProcessor] "13:58:35.362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [org.springframework.context.annotation.internalAutowiredAnnotationProcessor] "2021-06-07 13:58:35,362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [ServicePropertyService] "13:58:35.362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [ServicePropertyService] "2021-06-07 13:58:35,362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [MMRestService] "13:58:35.362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [MMRestService] "2021-06-07 13:58:35,362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [adminServiceImpl] "13:58:35.362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [adminServiceImpl] "2021-06-07 13:58:35,362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [DMaaPErrorMessages] "13:58:35.362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [DMaaPErrorMessages] "2021-06-07 13:58:35,362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [UIServiceImpl] "13:58:35.362 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [UIServiceImpl] "2021-06-07 13:58:35,363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [apiKeysRestService] "13:58:35.363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [apiKeysRestService] "2021-06-07 13:58:35,363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [DMaaPCambriaLimiter] "13:58:35.363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [DMaaPCambriaLimiter] "2021-06-07 13:58:35,363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [metricsServiceImpl] "13:58:35.363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [metricsServiceImpl] "2021-06-07 13:58:35,363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [configurationReader] "13:58:35.363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [configurationReader] "2021-06-07 13:58:35,363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [kafkaLiveLockAvoider2] "13:58:35.363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [kafkaLiveLockAvoider2] "2021-06-07 13:58:35,363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [topicServiceImpl] "13:58:35.363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [topicServiceImpl] "2021-06-07 13:58:35,363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [jsonProvider] "13:58:35.363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [jsonProvider] "2021-06-07 13:58:35,363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [q] "13:58:35.363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [q] "2021-06-07 13:58:35,363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [dMaaPNsaApiDb] "13:58:35.363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [dMaaPNsaApiDb] "2021-06-07 13:58:35,363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [DMaaPAuthFilter] "13:58:35.363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [DMaaPAuthFilter] "2021-06-07 13:58:35,363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [dMaaPAuthenticatorImpl] "13:58:35.363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [dMaaPAuthenticatorImpl] "2021-06-07 13:58:35,363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [dMaaPZkClient] "13:58:35.363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [dMaaPZkClient] "2021-06-07 13:58:35,363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [drumlinRequestRouter] "13:58:35.363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [drumlinRequestRouter] "2021-06-07 13:58:35,363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [dMaaPMetricsSet] "13:58:35.363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [dMaaPMetricsSet] "2021-06-07 13:58:35,363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [MMServiceImpl] "13:58:35.363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [MMServiceImpl] "2021-06-07 13:58:35,363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [kafkalockavoid] "13:58:35.363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [kafkalockavoid] "2021-06-07 13:58:35,363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [org.springframework.context.annotation.CommonAnnotationBeanPostProcessor#0] "13:58:35.363 [main] DEBUG org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration - [RuntimeConfiguration] Registering bean [org.springframework.context.annotation.CommonAnnotationBeanPostProcessor#0] "2021-06-07 13:58:35,364 [main] INFO org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext - Refreshing org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext@7c8c70d6: startup date [Mon Jun 07 13:58:35 GMT 2021]; parent: Root WebApplicationContext "13:58:35.364 [main] INFO org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext - Refreshing org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext@7c8c70d6: startup date [Mon Jun 07 13:58:35 GMT 2021]; parent: Root WebApplicationContext "2021-06-07 13:58:35,364 [main] DEBUG org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext - Bean factory for org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext@7c8c70d6: org.springframework.beans.factory.support.DefaultListableBeanFactory@57594b: defining beans [org.springframework.context.annotation.internalCommonAnnotationProcessor,apiKeysServiceImpl,ServicePropertiesListener,MMAgentUtil,contentLengthInterceptor,cambriaExMapper,adminRestService,defLength,transactionRestService,ServicePropertiesMap,propertyReader,org.springframework.context.annotation.internalConfigurationAnnotationProcessor,servicePropsBean,eventsRestService,eventsServiceImpl,org.springframework.context.annotation.internalPersistenceAnnotationProcessor,org.springframework.context.support.PropertySourcesPlaceholderConfigurer#0,topicRestService,metricsRestService,dMaaPKafkaConsumerFactory,org.springframework.context.annotation.internalRequiredAnnotationProcessor,jacksonProvider,dMaaPZkConfigDb,curator,kafkaPublisher,UIRestServices,helloWorld,transactionServiceImpl,webExMapper,mmb,dMaaPKafkaMetaBroker,org.springframework.beans.factory.config.MethodInvokingFactoryBean#0,org.springframework.context.annotation.internalAutowiredAnnotationProcessor,ServicePropertyService,MMRestService,adminServiceImpl,DMaaPErrorMessages,UIServiceImpl,apiKeysRestService,DMaaPCambriaLimiter,metricsServiceImpl,configurationReader,kafkaLiveLockAvoider2,topicServiceImpl,jsonProvider,q,dMaaPNsaApiDb,DMaaPAuthFilter,dMaaPAuthenticatorImpl,dMaaPZkClient,drumlinRequestRouter,dMaaPMetricsSet,MMServiceImpl,kafkalockavoid,org.springframework.context.annotation.CommonAnnotationBeanPostProcessor#0]; parent: org.springframework.beans.factory.support.DefaultListableBeanFactory@3bd323e9 "13:58:35.364 [main] DEBUG org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext - Bean factory for org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext@7c8c70d6: org.springframework.beans.factory.support.DefaultListableBeanFactory@57594b: defining beans [org.springframework.context.annotation.internalCommonAnnotationProcessor,apiKeysServiceImpl,ServicePropertiesListener,MMAgentUtil,contentLengthInterceptor,cambriaExMapper,adminRestService,defLength,transactionRestService,ServicePropertiesMap,propertyReader,org.springframework.context.annotation.internalConfigurationAnnotationProcessor,servicePropsBean,eventsRestService,eventsServiceImpl,org.springframework.context.annotation.internalPersistenceAnnotationProcessor,org.springframework.context.support.PropertySourcesPlaceholderConfigurer#0,topicRestService,metricsRestService,dMaaPKafkaConsumerFactory,org.springframework.context.annotation.internalRequiredAnnotationProcessor,jacksonProvider,dMaaPZkConfigDb,curator,kafkaPublisher,UIRestServices,helloWorld,transactionServiceImpl,webExMapper,mmb,dMaaPKafkaMetaBroker,org.springframework.beans.factory.config.MethodInvokingFactoryBean#0,org.springframework.context.annotation.internalAutowiredAnnotationProcessor,ServicePropertyService,MMRestService,adminServiceImpl,DMaaPErrorMessages,UIServiceImpl,apiKeysRestService,DMaaPCambriaLimiter,metricsServiceImpl,configurationReader,kafkaLiveLockAvoider2,topicServiceImpl,jsonProvider,q,dMaaPNsaApiDb,DMaaPAuthFilter,dMaaPAuthenticatorImpl,dMaaPZkClient,drumlinRequestRouter,dMaaPMetricsSet,MMServiceImpl,kafkalockavoid,org.springframework.context.annotation.CommonAnnotationBeanPostProcessor#0]; parent: org.springframework.beans.factory.support.DefaultListableBeanFactory@3bd323e9 "2021-06-07 13:58:35,525 [main] DEBUG org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext - Unable to locate MessageSource with name 'messageSource': using default [org.springframework.context.support.DelegatingMessageSource@69052034] "13:58:35.525 [main] DEBUG org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext - Unable to locate MessageSource with name 'messageSource': using default [org.springframework.context.support.DelegatingMessageSource@69052034] "2021-06-07 13:58:35,525 [main] DEBUG org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext - Unable to locate ApplicationEventMulticaster with name 'applicationEventMulticaster': using default [org.springframework.context.event.SimpleApplicationEventMulticaster@26da28df] "13:58:35.525 [main] DEBUG org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext - Unable to locate ApplicationEventMulticaster with name 'applicationEventMulticaster': using default [org.springframework.context.event.SimpleApplicationEventMulticaster@26da28df] "2021-06-07 13:58:35,605 [main] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Cambria Exception Mapper Created.. "13:58:35.605 [main] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Cambria Exception Mapper Created.. Jun 07, 2021 1:58:35 PM com.att.nsa.metrics.impl.CdmMetricsRegistryImpl$evalThread run INFO: Metrics registry eval thread starting. "2021-06-07 13:58:37,494 [main] INFO org.apache.curator.utils.Compatibility - Running in ZooKeeper 3.4.x compatibility mode "13:58:37.494 [main] INFO org.apache.curator.utils.Compatibility - Running in ZooKeeper 3.4.x compatibility mode "2021-06-07 13:58:37,625 [main] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Welcome...................................................................................... "13:58:37.625 [main] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Welcome...................................................................................... "2021-06-07 13:58:37,628 [main] ERROR org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Error during creation of permanent Znodes under /live-lock-avoid "java.lang.IllegalStateException: instance must be started before calling this method at org.apache.curator.shaded.com.google.common.base.Preconditions.checkState(Preconditions.java:444) at org.apache.curator.framework.imps.CuratorFrameworkImpl.checkExists(CuratorFrameworkImpl.java:432) at org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2.init(KafkaLiveLockAvoider2.java:60) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:366) at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:311) at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:134) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:409) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1626) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:555) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:483) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:351) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108) at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:648) at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1201) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1103) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:513) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:483) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202) at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:208) at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1138) at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1066) at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:835) at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:741) at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:189) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1201) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1103) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:513) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:483) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202) at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:208) at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1138) at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1066) at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:585) at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:88) at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(AutowiredAnnotationBeanPostProcessor.java:366) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1272) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:553) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:483) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197) at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:761) at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:942) at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:482) at org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration.getApplicationContext(DefaultRuntimeSpringConfiguration.java:153) at grails.spring.BeanBuilder.createApplicationContext(BeanBuilder.java:593) at grails.spring.BeanBuilder$createApplicationContext.call(Unknown Source) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:117) at ajsc.ComputeService.loadBeans(ComputeService.groovy:333) at ajsc.ComputeService$loadBeans$2.callCurrent(Unknown Source) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:52) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:154) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:174) at ajsc.ComputeService.start(ComputeService.groovy:377) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93) at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325) at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:384) at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1027) at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.callCurrent(PogoMetaClassSite.java:69) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:52) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:154) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:166) at ajsc.ComputeService$_start_closure11.doCall(ComputeService.groovy:359) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93) at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325) at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:294) at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1027) at groovy.lang.Closure.call(Closure.java:414) at org.codehaus.groovy.runtime.DefaultGroovyMethods.callClosureForMapEntry(DefaultGroovyMethods.java:5226) at org.codehaus.groovy.runtime.DefaultGroovyMethods.each(DefaultGroovyMethods.java:2107) at org.codehaus.groovy.runtime.dgm$163.invoke(Unknown Source) at org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite$PojoMetaMethodSiteNoUnwrapNoCoerce.invoke(PojoMetaMethodSite.java:274) at org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite.call(PojoMetaMethodSite.java:56) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:125) at ajsc.ComputeService.start(ComputeService.groovy:352) at ajsc.ComputeService.init(ComputeService.groovy:958) at ajsc.ComputeService$init.call(Unknown Source) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:117) at ajsc.RouteMgmtService.init(RouteMgmtService.groovy:148) at ajsc.RouteMgmtService$init$0.call(Unknown Source) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:117) at ajsc.ContextMgr.onApplicationEvent(ContextMgr.groovy:19) at org.springframework.context.event.SimpleApplicationEventMulticaster.multicastEvent(SimpleApplicationEventMulticaster.java:96) at org.springframework.context.support.AbstractApplicationContext.publishEvent(AbstractApplicationContext.java:335) at org.springframework.context.support.AbstractApplicationContext.finishRefresh(AbstractApplicationContext.java:958) at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:485) at org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:443) at org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:325) at org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:107) at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:953) at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:558) at org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:918) at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:370) at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1497) at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1459) at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:848) at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:287) at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:545) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:138) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:117) at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113) at org.eclipse.jetty.server.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:168) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:138) at org.eclipse.jetty.server.Server.start(Server.java:419) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:108) at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113) at org.eclipse.jetty.server.Server.doStart(Server.java:386) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at com.att.ajsc.runner.Runner.main(Runner.java:227) "2021-06-07 13:58:37,628 [main] ERROR org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Error during creation of permanent Znodes under /live-lock-avoid "java.lang.IllegalStateException: instance must be started before calling this method at org.apache.curator.shaded.com.google.common.base.Preconditions.checkState(Preconditions.java:444) at org.apache.curator.framework.imps.CuratorFrameworkImpl.checkExists(CuratorFrameworkImpl.java:432) at org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2.init(KafkaLiveLockAvoider2.java:60) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:366) at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:311) at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:134) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:409) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1626) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:555) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:483) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:351) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108) at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:648) at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1201) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1103) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:513) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:483) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202) at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:208) at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1138) at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1066) at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:835) at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:741) at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:189) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1201) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1103) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:513) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:483) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202) at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:208) at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1138) at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1066) at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:585) at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:88) at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(AutowiredAnnotationBeanPostProcessor.java:366) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1272) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:553) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:483) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197) at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:761) at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:942) at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:482) at org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration.getApplicationContext(DefaultRuntimeSpringConfiguration.java:153) at grails.spring.BeanBuilder.createApplicationContext(BeanBuilder.java:593) at grails.spring.BeanBuilder$createApplicationContext.call(Unknown Source) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:117) at ajsc.ComputeService.loadBeans(ComputeService.groovy:333) at ajsc.ComputeService$loadBeans$2.callCurrent(Unknown Source) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:52) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:154) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:174) at ajsc.ComputeService.start(ComputeService.groovy:377) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93) at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325) at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:384) at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1027) at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.callCurrent(PogoMetaClassSite.java:69) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:52) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:154) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:166) at ajsc.ComputeService$_start_closure11.doCall(ComputeService.groovy:359) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93) at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325) at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:294) at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1027) at groovy.lang.Closure.call(Closure.java:414) at org.codehaus.groovy.runtime.DefaultGroovyMethods.callClosureForMapEntry(DefaultGroovyMethods.java:5226) at org.codehaus.groovy.runtime.DefaultGroovyMethods.each(DefaultGroovyMethods.java:2107) at org.codehaus.groovy.runtime.dgm$163.invoke(Unknown Source) at org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite$PojoMetaMethodSiteNoUnwrapNoCoerce.invoke(PojoMetaMethodSite.java:274) at org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite.call(PojoMetaMethodSite.java:56) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:125) at ajsc.ComputeService.start(ComputeService.groovy:352) at ajsc.ComputeService.init(ComputeService.groovy:958) at ajsc.ComputeService$init.call(Unknown Source) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:117) at ajsc.RouteMgmtService.init(RouteMgmtService.groovy:148) at ajsc.RouteMgmtService$init$0.call(Unknown Source) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:117) at ajsc.ContextMgr.onApplicationEvent(ContextMgr.groovy:19) at org.springframework.context.event.SimpleApplicationEventMulticaster.multicastEvent(SimpleApplicationEventMulticaster.java:96) at org.springframework.context.support.AbstractApplicationContext.publishEvent(AbstractApplicationContext.java:335) at org.springframework.context.support.AbstractApplicationContext.finishRefresh(AbstractApplicationContext.java:958) at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:485) at org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:443) at org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:325) at org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:107) at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:953) at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:558) at org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:918) at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:370) at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1497) at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1459) at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:848) at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:287) at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:545) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:138) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:117) at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113) at org.eclipse.jetty.server.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:168) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:138) at org.eclipse.jetty.server.Server.start(Server.java:419) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:108) at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113) at org.eclipse.jetty.server.Server.doStart(Server.java:386) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at com.att.ajsc.runner.Runner.main(Runner.java:227) 13:58:37.628 [main] ERROR org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Error during creation of permanent Znodes under /live-lock-avoid java.lang.IllegalStateException: instance must be started before calling this method at org.apache.curator.shaded.com.google.common.base.Preconditions.checkState(Preconditions.java:444) at org.apache.curator.framework.imps.CuratorFrameworkImpl.checkExists(CuratorFrameworkImpl.java:432) at org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2.init(KafkaLiveLockAvoider2.java:60) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:366) at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:311) at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:134) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:409) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1626) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:555) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:483) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:351) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108) at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:648) at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1201) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1103) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:513) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:483) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202) at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:208) at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1138) at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1066) at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:835) at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:741) at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:189) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1201) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1103) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:513) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:483) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202) at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:208) at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1138) at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1066) at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:585) at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:88) at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(AutowiredAnnotationBeanPostProcessor.java:366) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1272) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:553) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:483) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197) at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:761) at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:942) at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:482) at org.codehaus.groovy.grails.commons.spring.DefaultRuntimeSpringConfiguration.getApplicationContext(DefaultRuntimeSpringConfiguration.java:153) at grails.spring.BeanBuilder.createApplicationContext(BeanBuilder.java:593) at grails.spring.BeanBuilder$createApplicationContext.call(Unknown Source) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:117) at ajsc.ComputeService.loadBeans(ComputeService.groovy:333) at ajsc.ComputeService$loadBeans$2.callCurrent(Unknown Source) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:52) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:154) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:174) at ajsc.ComputeService.start(ComputeService.groovy:377) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93) at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325) at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:384) at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1027) at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.callCurrent(PogoMetaClassSite.java:69) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:52) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:154) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:166) at ajsc.ComputeService$_start_closure11.doCall(ComputeService.groovy:359) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93) at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325) at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:294) at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1027) at groovy.lang.Closure.call(Closure.java:414) at org.codehaus.groovy.runtime.DefaultGroovyMethods.callClosureForMapEntry(DefaultGroovyMethods.java:5226) at org.codehaus.groovy.runtime.DefaultGroovyMethods.each(DefaultGroovyMethods.java:2107) at org.codehaus.groovy.runtime.dgm$163.invoke(Unknown Source) at org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite$PojoMetaMethodSiteNoUnwrapNoCoerce.invoke(PojoMetaMethodSite.java:274) at org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite.call(PojoMetaMethodSite.java:56) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:125) at ajsc.ComputeService.start(ComputeService.groovy:352) at ajsc.ComputeService.init(ComputeService.groovy:958) at ajsc.ComputeService$init.call(Unknown Source) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:117) at ajsc.RouteMgmtService.init(RouteMgmtService.groovy:148) at ajsc.RouteMgmtService$init$0.call(Unknown Source) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:117) at ajsc.ContextMgr.onApplicationEvent(ContextMgr.groovy:19) at org.springframework.context.event.SimpleApplicationEventMulticaster.multicastEvent(SimpleApplicationEventMulticaster.java:96) at org.springframework.context.support.AbstractApplicationContext.publishEvent(AbstractApplicationContext.java:335) at org.springframework.context.support.AbstractApplicationContext.finishRefresh(AbstractApplicationContext.java:958) at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:485) at org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:443) at org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:325) at org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:107) at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:953) at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:558) at org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:918) at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:370) at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1497) at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1459) at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:848) at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:287) at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:545) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:138) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:117) at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113) at org.eclipse.jetty.server.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:168) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:138) at org.eclipse.jetty.server.Server.start(Server.java:419) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:108) at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113) at org.eclipse.jetty.server.Server.doStart(Server.java:386) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at com.att.ajsc.runner.Runner.main(Runner.java:227) "2021-06-07 13:58:37,630 [main] INFO org.onap.dmaap.dmf.mr.beans.DMaaPKafkaConsumerFactory - This Cambria API Node identifies itself as [dev-message-router-0.message-router.onap.svc.cluster.local:3904]. "13:58:37.630 [main] INFO org.onap.dmaap.dmf.mr.beans.DMaaPKafkaConsumerFactory - This Cambria API Node identifies itself as [dev-message-router-0.message-router.onap.svc.cluster.local:3904]. "2021-06-07 13:58:37,636 [main] INFO org.apache.curator.framework.imps.CuratorFrameworkImpl - Starting "13:58:37.636 [main] INFO org.apache.curator.framework.imps.CuratorFrameworkImpl - Starting "2021-06-07 13:58:37,662 [main] INFO org.apache.curator.framework.imps.CuratorFrameworkImpl - Default schema "13:58:37.662 [main] INFO org.apache.curator.framework.imps.CuratorFrameworkImpl - Default schema "2021-06-07 13:58:38,926 [main-EventThread] INFO org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED "13:58:38.926 [main-EventThread] INFO org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED "2021-06-07 13:58:39,021 [main] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - KafkaConsumerCache started "13:58:39.021 [main] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - KafkaConsumerCache started "2021-06-07 13:58:39,021 [main] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - sweeping cached clients every 15 seconds "13:58:39.021 [main] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - sweeping cached clients every 15 seconds "2021-06-07 13:58:44,009 [main] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Done creating task holder and watcher for APP name: dev-message-router-0.message-router.onap.svc.cluster.local:3904 "13:58:44.009 [main] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Done creating task holder and watcher for APP name: dev-message-router-0.message-router.onap.svc.cluster.local:3904 "2021-06-07 13:58:44,102 [main] INFO org.onap.dmaap.dmf.mr.beans.DMaaPNsaApiDb - This server is configured to use an encrypted API key database. "13:58:44.102 [main] INFO org.onap.dmaap.dmf.mr.beans.DMaaPNsaApiDb - This server is configured to use an encrypted API key database. "2021-06-07 13:58:44,365 [main] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Broker Type is:kafka "13:58:44.365 [main] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Broker Type is:kafka "2021-06-07 13:58:44,367 [main] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Broker Type is:kafka "13:58:44.367 [main] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Broker Type is:kafka "2021-06-07 13:58:44,502 [main] INFO org.onap.dmaap.DMaaPWebExceptionMapper - WebException Mapper Created.. "13:58:44.502 [main] INFO org.onap.dmaap.DMaaPWebExceptionMapper - WebException Mapper Created.. "2021-06-07 13:58:44,538 [main] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Welcome...................................................................................... "13:58:44.538 [main] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Welcome...................................................................................... RestletComponentFactory.getRestletComponent for key: default:0 RestletComponentFactory.getRestletComponent returning RestletComponent: org.apache.camel.component.restlet.RestletComponent@477090bf ComputeService::Started Adding route: dmaap:UIService:v1 to context: SpringCamelContext(default-0) with spring id org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext@7c8c70d6 Adding route: dmaap:adminService2:v1 to context: SpringCamelContext(default-0) with spring id org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext@7c8c70d6 Adding route: dmaap:helloWorld:v1 to context: SpringCamelContext(default-0) with spring id org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext@7c8c70d6 Adding route: dmaap:mirrorService:v1 to context: SpringCamelContext(default-0) with spring id org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext@7c8c70d6 Adding route: dmaap:helloCAET:v1 to context: SpringCamelContext(default-0) with spring id org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext@7c8c70d6 Adding route: dmaap:transactionService:v1 to context: SpringCamelContext(default-0) with spring id org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext@7c8c70d6 Adding route: dmaap:errorMessage:v1 to context: SpringCamelContext(default-0) with spring id org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext@7c8c70d6 Adding route: dmaap:eventService:v1 to context: SpringCamelContext(default-0) with spring id org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext@7c8c70d6 Adding route: dmaap:helloServlet:v1 to context: SpringCamelContext(default-0) with spring id org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext@7c8c70d6 Adding route: dmaap:adminService:v1 to context: SpringCamelContext(default-0) with spring id org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext@7c8c70d6 Adding route: dmaap:apiKeyService2:v1 to context: SpringCamelContext(default-0) with spring id org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext@7c8c70d6 Adding route: dmaap:topicService:v1 to context: SpringCamelContext(default-0) with spring id org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext@7c8c70d6 Adding route: dmaap:apiKeyService:v1 to context: SpringCamelContext(default-0) with spring id org.codehaus.groovy.grails.commons.spring.GrailsApplicationContext@7c8c70d6 ___ ____________________ / . \ /__ __/ ____// ____/ / /_\ \___/ / (____ )/ /___ /_/ \/____/ /_____/(_____/ Version: 3.0.11-oss AT&T's Java Services Container has initialized successfully and services are now available 2021-06-07 13:58:47.751:INFO:oejshC.ROOT:main: 2021-06-07T13:58:47.751+0000 INIT [cadi] https.protocols set by cadi_protocols in CADI Properties 2021-06-07 13:58:47.751:INFO:oejshC.ROOT:main: 2021-06-07T13:58:47.751+0000 INIT [cadi] jdk.tls.client.protocols set from Default Protocols 2021-06-07 13:58:47.762:INFO:oejshC.ROOT:main: 2021-06-07T13:58:47.762+0000 INIT [cadi] hostname is set to dev-message-router-0 2021-06-07 13:58:47.762:INFO:oejshC.ROOT:main: 2021-06-07T13:58:47.762+0000 INIT [cadi] basic_realm is set to dev-message-router-0 2021-06-07 13:58:47.762:INFO:oejshC.ROOT:main: 2021-06-07T13:58:47.762+0000 INIT [cadi] aaf_default_realm is set to dev-message-router-0 2021-06-07 13:58:47.763:INFO:oejshC.ROOT:main: 2021-06-07T13:58:47.763+0000 INIT [cadi] aaf_id is set to dmaapmr@mr.dmaap.onap.org 2021-06-07 13:58:48.194:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.194+0000 INIT [cadi] X509 Chain| 0)| Subject: C=US, O=ONAP, OU=OSAAF, OU=dmaapmr@mr.dmaap.onap.org:DEV, CN=dmaap-mr| Issuer : CN=intermediateCA_9, OU=OSAAF, O=ONAP, C=US| Expires: Tue Jun 07 13:58:06 GMT 2022| 1)| Subject: CN=intermediateCA_9, OU=OSAAF, O=ONAP, C=US| Issuer : C=US, O=ONAP, OU=OSAAF| Expires: Thu Aug 17 18:51:37 GMT 2023| 2021-06-07 13:58:48.197:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.196+0000 INIT [cadi] https.protocols loaded from System Properties 2021-06-07 13:58:48.197:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.197+0000 INIT [cadi] jdk.tls.client.protocols loaded from System Properties 2021-06-07 13:58:48.201:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.201+0000 INIT [cadi] RegistrationProperty: default_container='' 2021-06-07 13:58:48.201:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.201+0000 INIT [cadi] RegistrationProperty: public_port='null' 2021-06-07 13:58:48.202:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.202+0000 INIT [cadi] RegistrationProperty: hostname='dev-message-router-0' 2021-06-07 13:58:48.202:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.202+0000 INIT [cadi] RegistrationProperty: public_fqdn='dev-message-router-0' 2021-06-07 13:58:48.202:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.202+0000 INIT [cadi] RegistrationProperty: default_name='%NS.%N' 2021-06-07 13:58:48.202:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.202+0000 INIT [cadi] RegistrationProperty: latitude='37.78187' 2021-06-07 13:58:48.203:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.203+0000 INIT [cadi] RegistrationProperty: longitude='-122.26147' 2021-06-07 13:58:48.203:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.203+0000 INIT [cadi] RegistrationProperty: default_fqdn='dev-message-router-0' 2021-06-07 13:58:48.203:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.203+0000 INIT [cadi] RegistrationProperty: default_container_ns='' 2021-06-07 13:58:48.203:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.203+0000 INIT [cadi] aaf_oauth2_token_url is not explicitly set 2021-06-07 13:58:48.203:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.203+0000 INIT [cadi] aaf_oauth2_introspect_url is not explicitly set 2021-06-07 13:58:48.203:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.203+0000 INIT [cadi] OAuth2 Lur disabled 2021-06-07 13:58:48.203:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.203+0000 INIT [cadi] aaf_url is set to https://aaf-locate.onap:8095/locate/onap.org.osaaf.aaf.service:2.1 2021-06-07 13:58:48.203:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.203+0000 INIT [cadi] aaf_lur_class is set to org.onap.aaf.cadi.aaf.v2_0.AAFLurPerm 2021-06-07 13:58:48.219:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.219+0000 INFO [cadi] loadLocator URL is https://aaf-locate.onap:8095/locate/onap.org.osaaf.aaf.service:2.1 2021-06-07 13:58:48.222:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.222+0000 INFO [cadi] AbsAAFLocator AAF URI is https://aaf-locate.onap:8095/locate 2021-06-07 13:58:48.222:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.222+0000 INFO [cadi] AbsAAFLocator name is https://aaf-locate.onap:8095/locate 2021-06-07 13:58:48.286:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.286+0000 INFO [cadi] AAFLocator [AAFLocator] enabled using https://aaf-locate.onap:8095 2021-06-07 13:58:48.287:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.287+0000 INFO [cadi] AAFCon has URL of https://aaf-locate.onap:8095/locate/onap.org.osaaf.aaf.service:2.1 2021-06-07 13:58:48.355:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.354+0000 INIT [cadi] aaf_id is not explicitly set 2021-06-07 13:58:48.365:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.365+0000 INIT [cadi] Cleaning Thread initialized with interval of 60000 ms and max objects of 1000 2021-06-07 13:58:48.367:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.367+0000 INIT [cadi] Both cadi-oauth jar and Property cadi_oauth2_url is required to initialize OAuth2 2021-06-07 13:58:48.367:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.367+0000 INIT [cadi] AAF LUR Configured to https://aaf-locate.onap:8095/locate/onap.org.osaaf.aaf.service:2.1 2021-06-07 13:58:48.368:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.368+0000 INIT [cadi] aaf_debug_ids is not explicitly set 2021-06-07 13:58:48.370:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.370+0000 INIT [cadi] aaf_url is set to https://aaf-locate.onap:8095/locate/onap.org.osaaf.aaf.service:2.1 2021-06-07 13:58:48.370:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.370+0000 INIT [cadi] hostname is not explicitly set 2021-06-07 13:58:48.370:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.370+0000 INIT [cadi] Hostname set to dev-message-router-0 2021-06-07 13:58:48.373:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.373+0000 INIT [cadi] cadi_truststore is set to /appl/dmaapMR1/bundleconfig/etc/sysprops/local/org.onap.dmaap.mr.trust.jks 2021-06-07 13:58:48.376:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.376+0000 INIT [cadi] Trusting Identity for Certificates signed by "CN=intermediateCA_1, OU=OSAAF, O=ONAP, C=US" 2021-06-07 13:58:48.377:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.377+0000 INIT [cadi] Trusting Identity for Certificates signed by "CN=intermediateCA_7, OU=OSAAF, O=ONAP, C=US" 2021-06-07 13:58:48.377:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.377+0000 INIT [cadi] Trusting Identity for Certificates signed by "CN=intermediateCA_9, OU=OSAAF, O=ONAP, C=US" 2021-06-07 13:58:48.518:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.518+0000 INIT [cadi] X509 Chain| 0)| Subject: C=US, O=ONAP, OU=OSAAF, OU=dmaapmr@mr.dmaap.onap.org:DEV, CN=dmaap-mr| Issuer : CN=intermediateCA_9, OU=OSAAF, O=ONAP, C=US| Expires: Tue Jun 07 13:58:06 GMT 2022| 1)| Subject: CN=intermediateCA_9, OU=OSAAF, O=ONAP, C=US| Issuer : C=US, O=ONAP, OU=OSAAF| Expires: Thu Aug 17 18:51:37 GMT 2023| 2021-06-07 13:58:48.519:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.519+0000 INIT [cadi] https.protocols loaded from System Properties 2021-06-07 13:58:48.519:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.519+0000 INIT [cadi] jdk.tls.client.protocols loaded from System Properties 2021-06-07 13:58:48.519:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.519+0000 INIT [cadi] Certificate Authorization enabled 2021-06-07 13:58:48.519:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.519+0000 INIT [cadi] basic_realm is not explicitly set 2021-06-07 13:58:48.520:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.520+0000 INIT [cadi] aaf_user_expires is set to 600000 2021-06-07 13:58:48.520:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.520+0000 INIT [cadi] Local Basic Authorization is disabled. Enable by setting basicRealm=
2021-06-07 13:58:48.520:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.520+0000 INIT [cadi] aaf_taf_class is set to org.onap.aaf.cadi.aaf.v2_0.AAFTaf 2021-06-07 13:58:48.524:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.524+0000 INIT [cadi] AAF TAF Configured to https://aaf-locate.onap:8095/locate/onap.org.osaaf.aaf.service:2.1 2021-06-07 13:58:48.524:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.524+0000 INIT [cadi] aaf_oauth2_token_url is not explicitly set 2021-06-07 13:58:48.524:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.524+0000 INIT [cadi] OAuth TAF is not configured 2021-06-07 13:58:48.525:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.525+0000 INIT [cadi] Tafs processed in this order:| org.onap.aaf.cadi.taf.dos.DenialOfServiceTaf(0)| org.onap.aaf.cadi.taf.cert.X509Taf(10)| org.onap.aaf.cadi.aaf.v2_0.AAFTaf(40)| 2021-06-07 13:58:48.526:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.526+0000 INFO [cadi] loadLocator URL is https://aaf-locate.onap:8095/locate/onap.org.osaaf.aaf.service:2.1 2021-06-07 13:58:48.526:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.526+0000 INFO [cadi] AbsAAFLocator AAF URI is https://aaf-locate.onap:8095/locate 2021-06-07 13:58:48.526:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.526+0000 INFO [cadi] AbsAAFLocator name is https://aaf-locate.onap:8095/locate 2021-06-07 13:58:48.531:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.531+0000 INFO [cadi] AAFLocator [AAFLocator] enabled using https://aaf-locate.onap:8095 2021-06-07 13:58:48.532:INFO:oejshC.ROOT:main: 2021-06-07T13:58:48.532+0000 INIT [cadi] cadi_loglevel is set to INFO 2021-06-07 13:58:48.565:INFO:oejshC.ROOT:main: Initializing Spring FrameworkServlet 'spring' 2021-06-07 13:58:48.701:INFO:oejsh.ContextHandler:main: Started o.e.j.w.WebAppContext@2b4a2ec7{/,file:///appl/dmaapMR1/jetty/webapps/ajsc-temp.dir7885904937650816729/webapp/,AVAILABLE}{/appl/dmaapMR1/lib/ajsc.war} 2021-06-07 13:58:48.703:INFO:oejdp.ScanningAppProvider:main: Deployment monitor [file:///appl/dmaapMR1/extApps/] at interval 10 2021-06-07 13:58:48.715:INFO:oejs.AbstractConnector:main: Started ServerConnector@32ca93bd{HTTP/1.1,[http/1.1]}{0.0.0.0:3904} 2021-06-07 13:58:48.717:INFO:oejus.SslContextFactory:main: x509=X509@36c64bd8(dmaapmr@mr.dmaap.onap.org,h=[dmaap-mr, dev-message-router-kafka-0.message-router-kafka.onap.svc.cluster.local, dev-message-router-kafka-1.message-router-kafka.onap.svc.cluster.local, dev-message-router-kafka-2.message-router-kafka.onap.svc.cluster.local, dmaap-mr dmaapmr.onap, dmaap-mr.onap, dmaap.mr.onap, dmaapmr dmaap.mr, message-router, message-router-kafka-0, message-router-kafka-0.onap, message-router-kafka-1, message-router-kafka-1.onap, message-router-kafka-2, message-router-kafka-2.onap, message-router.onap, mr.api.simpledemo.onap.org],w=[]) for SslContextFactory@50f771c6[provider=null,keyStore=file:///appl/dmaapMR1/bundleconfig/etc/sysprops/local/org.onap.dmaap.mr.jks,trustStore=null] 2021-06-07 13:58:48.731:INFO:oejs.AbstractConnector:main: Started ServerConnector@2126cfaf{SSL,[ssl, http/1.1]}{0.0.0.0:3905} 2021-06-07 13:58:48.731:INFO:oejs.Server:main: Started @23774ms "2021-06-07 13:59:45,221 [qtp1022308509-12] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "13:59:45.221 [qtp1022308509-12] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 13:59:45,353 [qtp1022308509-12] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "13:59:45.353 [qtp1022308509-12] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 13:59:55,467 [qtp1022308509-75] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "13:59:55.467 [qtp1022308509-75] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 13:59:55,471 [qtp1022308509-75] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "13:59:55.471 [qtp1022308509-75] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 13:59:56,148 [qtp1022308509-82] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "13:59:56.148 [qtp1022308509-82] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 13:59:56,153 [qtp1022308509-82] INFO org.onap.dmaap.service.EventsRestService - Publishing message to topic POLICY-PDP-PAP "13:59:56.153 [qtp1022308509-82] INFO org.onap.dmaap.service.EventsRestService - Publishing message to topic POLICY-PDP-PAP "2021-06-07 13:59:58,098 [qtp1022308509-80] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "13:59:58.098 [qtp1022308509-80] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 13:59:58,103 [qtp1022308509-80] INFO org.onap.dmaap.service.TopicRestService - Authenticating the user before fetching the topics "13:59:58.103 [qtp1022308509-80] INFO org.onap.dmaap.service.TopicRestService - Authenticating the user before fetching the topics "2021-06-07 13:59:58,104 [qtp1022308509-80] INFO org.onap.dmaap.service.TopicRestService - Fetching all Topics "13:59:58.104 [qtp1022308509-80] INFO org.onap.dmaap.service.TopicRestService - Fetching all Topics "2021-06-07 13:59:58,104 [qtp1022308509-80] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Fetching list of all the topics. "13:59:58.104 [qtp1022308509-80] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Fetching list of all the topics. "2021-06-07 13:59:58,105 [qtp1022308509-80] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving list of all the topics. "13:59:58.105 [qtp1022308509-80] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving list of all the topics. "2021-06-07 13:59:58,105 [qtp1022308509-80] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving all topics from root: /brokers/topics "13:59:58.105 [qtp1022308509-80] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving all topics from root: /brokers/topics "2021-06-07 14:00:00,388 [qtp1022308509-80] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Returning list of all the topics. "14:00:00.388 [qtp1022308509-80] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Returning list of all the topics. "2021-06-07 14:00:00,395 [qtp1022308509-80] INFO org.onap.dmaap.service.TopicRestService - Returning List of all Topics "14:00:00.395 [qtp1022308509-80] INFO org.onap.dmaap.service.TopicRestService - Returning List of all Topics "2021-06-07 14:00:05,508 [qtp1022308509-75] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:00:05.508 [qtp1022308509-75] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:00:05,514 [qtp1022308509-75] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:00:05.514 [qtp1022308509-75] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:00:08,421 [qtp1022308509-82] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - Published 3 msgs in 12262 ms for topic POLICY-PDP-PAP from server 10.242.168.26 "14:00:08.421 [qtp1022308509-82] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - Published 3 msgs in 12262 ms for topic POLICY-PDP-PAP from server 10.242.168.26 "2021-06-07 14:00:08,421 [qtp1022308509-82] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - Overall Response time - Published msgs in 12268 ms for topic POLICY-PDP-PAP "14:00:08.421 [qtp1022308509-82] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - Overall Response time - Published msgs in 12268 ms for topic POLICY-PDP-PAP "2021-06-07 14:00:10,585 [qtp1022308509-84] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:00:10.585 [qtp1022308509-84] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:00:10,590 [qtp1022308509-84] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:00:10.590 [qtp1022308509-84] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:00:15,546 [qtp1022308509-75] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:00:15.546 [qtp1022308509-75] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:00:15,554 [qtp1022308509-75] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:00:15.554 [qtp1022308509-75] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:00:20,600 [qtp1022308509-80] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:00:20.600 [qtp1022308509-80] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:00:20,605 [qtp1022308509-80] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:00:20.605 [qtp1022308509-80] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:00:24,273 [qtp1022308509-87] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:00:24.273 [qtp1022308509-87] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:00:24,278 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 3 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:00:24.278 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 3 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:00:24,283 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "14:00:24.283 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "2021-06-07 14:00:24,284 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 1.0 empty replies/minute. "14:00:24.284 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 1.0 empty replies/minute. "2021-06-07 14:00:24,284 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.beans.DMaaPKafkaConsumerFactory - ^Kafka consumer cache value POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0 =>null "14:00:24.284 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.beans.DMaaPKafkaConsumerFactory - ^Kafka consumer cache value POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0 =>null "2021-06-07 14:00:25,575 [qtp1022308509-88] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:00:25.575 [qtp1022308509-88] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:00:25,579 [qtp1022308509-88] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:00:25.579 [qtp1022308509-88] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:00:26,027 [qtp1022308509-87] WARN org.apache.curator.utils.ZKPaths - The version of ZooKeeper being used doesn't support Container nodes. CreateMode.PERSISTENT will be used instead. "14:00:26.027 [qtp1022308509-87] WARN org.apache.curator.utils.ZKPaths - The version of ZooKeeper being used doesn't support Container nodes. CreateMode.PERSISTENT will be used instead. "2021-06-07 14:00:27,877 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.beans.DMaaPKafkaConsumerFactory - Creating Kafka consumer for group [2e207fe6-0409-4359-83ce-db73395e0be3], consumer [dev-policy-apex-pdp-0], on topic [POLICY-PDP-PAP]. "14:00:27.877 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.beans.DMaaPKafkaConsumerFactory - Creating Kafka consumer for group [2e207fe6-0409-4359-83ce-db73395e0be3], consumer [dev-policy-apex-pdp-0], on topic [POLICY-PDP-PAP]. "2021-06-07 14:00:28,138 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - KeeperException.NoNodeException occured "org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /fe3c/cambria/consumerCache/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0 at org.apache.zookeeper.KeeperException.create(KeeperException.java:114) at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1336) at org.apache.curator.framework.imps.SetDataBuilderImpl$4.call(SetDataBuilderImpl.java:291) at org.apache.curator.framework.imps.SetDataBuilderImpl$4.call(SetDataBuilderImpl.java:287) at org.apache.curator.connection.StandardConnectionHandlingPolicy.callWithRetry(StandardConnectionHandlingPolicy.java:64) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:100) at org.apache.curator.framework.imps.SetDataBuilderImpl.pathInForeground(SetDataBuilderImpl.java:284) at org.apache.curator.framework.imps.SetDataBuilderImpl.forPath(SetDataBuilderImpl.java:270) at org.apache.curator.framework.imps.SetDataBuilderImpl.forPath(SetDataBuilderImpl.java:33) at org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache.signalOwnership(KafkaConsumerCache.java:644) at org.onap.dmaap.dmf.mr.beans.DMaaPKafkaConsumerFactory.getConsumerFor(DMaaPKafkaConsumerFactory.java:189) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:160) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 14:00:28.138 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - KeeperException.NoNodeException occured org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /fe3c/cambria/consumerCache/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0 at org.apache.zookeeper.KeeperException.create(KeeperException.java:114) at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1336) at org.apache.curator.framework.imps.SetDataBuilderImpl$4.call(SetDataBuilderImpl.java:291) at org.apache.curator.framework.imps.SetDataBuilderImpl$4.call(SetDataBuilderImpl.java:287) at org.apache.curator.connection.StandardConnectionHandlingPolicy.callWithRetry(StandardConnectionHandlingPolicy.java:64) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:100) at org.apache.curator.framework.imps.SetDataBuilderImpl.pathInForeground(SetDataBuilderImpl.java:284) at org.apache.curator.framework.imps.SetDataBuilderImpl.forPath(SetDataBuilderImpl.java:270) at org.apache.curator.framework.imps.SetDataBuilderImpl.forPath(SetDataBuilderImpl.java:33) at org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache.signalOwnership(KafkaConsumerCache.java:644) at org.onap.dmaap.dmf.mr.beans.DMaaPKafkaConsumerFactory.getConsumerFor(DMaaPKafkaConsumerFactory.java:189) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:160) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:00:28,318 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - dev-message-router-0.message-router.onap.svc.cluster.local:3904 successfully claimed ownership of consumer POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0 "14:00:28.318 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - dev-message-router-0.message-router.onap.svc.cluster.local:3904 successfully claimed ownership of consumer POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0 "2021-06-07 14:00:28,340 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - Backing off to give the Kafka broker time to clean up the ZK data for this consumer "14:00:28.340 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - Backing off to give the Kafka broker time to clean up the ZK data for this consumer "2021-06-07 14:00:28,368 [Curator-PathChildrenCache-0] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - dev-message-router-0.message-router.onap.svc.cluster.local:3904 started consumer POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0 "14:00:28.368 [Curator-PathChildrenCache-0] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - dev-message-router-0.message-router.onap.svc.cluster.local:3904 started consumer POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0 "2021-06-07 14:00:28,873 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.beans.DMaaPKafkaConsumerFactory - Setting [heartbeat.interval.ms] to 60000. "14:00:28.873 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.beans.DMaaPKafkaConsumerFactory - Setting [heartbeat.interval.ms] to 60000. "2021-06-07 14:00:28,874 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.beans.DMaaPKafkaConsumerFactory - Setting [session.timeout.ms] to 240000. "14:00:28.874 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.beans.DMaaPKafkaConsumerFactory - Setting [session.timeout.ms] to 240000. "2021-06-07 14:00:28,874 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.beans.DMaaPKafkaConsumerFactory - Setting [max.poll.interval.ms] to 300000. "14:00:28.874 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.beans.DMaaPKafkaConsumerFactory - Setting [max.poll.interval.ms] to 300000. "2021-06-07 14:00:28,874 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.beans.DMaaPKafkaConsumerFactory - Setting [max.poll.records] to 1000. "14:00:28.874 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.beans.DMaaPKafkaConsumerFactory - Setting [max.poll.records] to 1000. "2021-06-07 14:00:29,040 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.beans.DMaaPKafkaConsumerFactory - kafka stream created in 166 "14:00:29.040 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.beans.DMaaPKafkaConsumerFactory - kafka stream created in 166 "2021-06-07 14:00:29,040 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - ^@ Consumer Added to Cache Consumer KeyPOLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0 ApiIddev-message-router-0.message-router.onap.svc.cluster.local:3904 "14:00:29.040 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - ^@ Consumer Added to Cache Consumer KeyPOLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0 ApiIddev-message-router-0.message-router.onap.svc.cluster.local:3904 "2021-06-07 14:00:29,099 [qtp1022308509-89] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:00:29.099 [qtp1022308509-89] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:00:29,101 [qtp1022308509-89] INFO org.onap.dmaap.service.TopicRestService - Authenticating the user before fetching the topics "14:00:29.101 [qtp1022308509-89] INFO org.onap.dmaap.service.TopicRestService - Authenticating the user before fetching the topics "2021-06-07 14:00:29,102 [qtp1022308509-89] INFO org.onap.dmaap.service.TopicRestService - Fetching all Topics "14:00:29.102 [qtp1022308509-89] INFO org.onap.dmaap.service.TopicRestService - Fetching all Topics "2021-06-07 14:00:29,102 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Fetching list of all the topics. "14:00:29.102 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Fetching list of all the topics. "2021-06-07 14:00:29,102 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving list of all the topics. "14:00:29.102 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving list of all the topics. "2021-06-07 14:00:29,102 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving all topics from root: /brokers/topics "14:00:29.102 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving all topics from root: /brokers/topics "2021-06-07 14:00:29,732 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Returning list of all the topics. "14:00:29.732 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Returning list of all the topics. "2021-06-07 14:00:29,732 [qtp1022308509-89] INFO org.onap.dmaap.service.TopicRestService - Returning List of all Topics "14:00:29.732 [qtp1022308509-89] INFO org.onap.dmaap.service.TopicRestService - Returning List of all Topics "2021-06-07 14:00:29,736 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 5461 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:00:29.736 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 5461 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:00:30,612 [qtp1022308509-85] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:00:30.612 [qtp1022308509-85] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:00:31,095 [qtp1022308509-85] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:00:31.095 [qtp1022308509-85] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:00:35,600 [qtp1022308509-80] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:00:35.600 [qtp1022308509-80] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:00:35,849 [qtp1022308509-80] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:00:35.849 [qtp1022308509-80] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:00:41,107 [qtp1022308509-90] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:00:41.107 [qtp1022308509-90] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:00:41,111 [qtp1022308509-90] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:00:41.111 [qtp1022308509-90] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:00:45,866 [qtp1022308509-94] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:00:45.866 [qtp1022308509-94] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:00:45,871 [qtp1022308509-94] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:00:45.871 [qtp1022308509-94] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:00:46,741 [qtp1022308509-87] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:00:46,741 [qtp1022308509-87] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 14:00:46.741 [qtp1022308509-87] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:00:46,742 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "14:00:46.742 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "2021-06-07 14:00:47,514 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "14:00:47.514 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "2021-06-07 14:00:48,103 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 ****** dev-policy-apex-pdp-0 from Remote10.242.168.26 "14:00:48.103 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 ****** dev-policy-apex-pdp-0 from Remote10.242.168.26 "2021-06-07 14:00:48,103 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"07-06-2021::02:00:48:103", "topicId":"POLICY-PDP-PAP", "publisherId":"null", "publisherIp":"null", "subscriberId":"2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0", "subscriberIp":"10.242.168.26"} "14:00:48.103 [qtp1022308509-87] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"07-06-2021::02:00:48:103", "topicId":"POLICY-PDP-PAP", "publisherId":"null", "publisherIp":"null", "subscriberId":"2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0", "subscriberIp":"10.242.168.26"} "2021-06-07 14:00:48,104 [qtp1022308509-87] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:00:48.104 [qtp1022308509-87] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:00:48,121 [qtp1022308509-89] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:00:48.121 [qtp1022308509-89] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:00:48,125 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:00:48.125 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:00:48,126 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "14:00:48.126 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "2021-06-07 14:00:48,126 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 2.0 empty replies/minute. "14:00:48.126 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 2.0 empty replies/minute. "2021-06-07 14:00:48,127 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 4 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:00:48.127 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 4 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:00:51,118 [qtp1022308509-96] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:00:51.118 [qtp1022308509-96] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:00:51,361 [qtp1022308509-96] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:00:51.361 [qtp1022308509-96] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:00:55,889 [qtp1022308509-99] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:00:55.889 [qtp1022308509-99] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:00:55,892 [qtp1022308509-99] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:00:55.892 [qtp1022308509-99] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:00:59,737 [qtp1022308509-100] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:00:59.737 [qtp1022308509-100] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:00:59,740 [qtp1022308509-100] INFO org.onap.dmaap.service.TopicRestService - Authenticating the user before fetching the topics "14:00:59.740 [qtp1022308509-100] INFO org.onap.dmaap.service.TopicRestService - Authenticating the user before fetching the topics "2021-06-07 14:00:59,740 [qtp1022308509-100] INFO org.onap.dmaap.service.TopicRestService - Fetching all Topics "14:00:59.740 [qtp1022308509-100] INFO org.onap.dmaap.service.TopicRestService - Fetching all Topics "2021-06-07 14:00:59,740 [qtp1022308509-100] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Fetching list of all the topics. "14:00:59.740 [qtp1022308509-100] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Fetching list of all the topics. "2021-06-07 14:00:59,740 [qtp1022308509-100] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving list of all the topics. "14:00:59.740 [qtp1022308509-100] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving list of all the topics. "2021-06-07 14:00:59,740 [qtp1022308509-100] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving all topics from root: /brokers/topics "14:00:59.740 [qtp1022308509-100] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving all topics from root: /brokers/topics "2021-06-07 14:01:00,772 [qtp1022308509-100] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Returning list of all the topics. "14:01:00.772 [qtp1022308509-100] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Returning list of all the topics. "2021-06-07 14:01:00,772 [qtp1022308509-100] INFO org.onap.dmaap.service.TopicRestService - Returning List of all Topics "14:01:00.772 [qtp1022308509-100] INFO org.onap.dmaap.service.TopicRestService - Returning List of all Topics "2021-06-07 14:01:01,373 [qtp1022308509-101] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:01.373 [qtp1022308509-101] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:01,377 [qtp1022308509-101] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:01:01.377 [qtp1022308509-101] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:01:05,128 [qtp1022308509-89] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:01:05,128 [qtp1022308509-89] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 14:01:05.128 [qtp1022308509-89] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:01:05,129 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "14:01:05.129 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "2021-06-07 14:01:05,691 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "14:01:05.691 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "2021-06-07 14:01:05,915 [qtp1022308509-87] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:05.915 [qtp1022308509-87] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:06,018 [qtp1022308509-87] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:01:06.018 [qtp1022308509-87] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:01:06,892 [qtp1022308509-102] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:06.892 [qtp1022308509-102] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:06,898 [qtp1022308509-102] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:01:06.898 [qtp1022308509-102] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:01:06,924 [qtp1022308509-96] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:06.924 [qtp1022308509-96] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:06,926 [qtp1022308509-96] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:01:06.926 [qtp1022308509-96] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:01:06,932 [qtp1022308509-101] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:06.932 [qtp1022308509-101] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:06,934 [qtp1022308509-101] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:01:06.934 [qtp1022308509-101] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:01:06,939 [qtp1022308509-87] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:06.939 [qtp1022308509-87] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:06,941 [qtp1022308509-87] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:01:06.941 [qtp1022308509-87] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:01:06,945 [qtp1022308509-102] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:06.945 [qtp1022308509-102] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:06,947 [qtp1022308509-102] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:01:06.947 [qtp1022308509-102] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:01:06,951 [qtp1022308509-96] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:06.951 [qtp1022308509-96] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:06,954 [qtp1022308509-96] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:01:06.954 [qtp1022308509-96] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:01:06,958 [qtp1022308509-101] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:06.958 [qtp1022308509-101] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:06,961 [qtp1022308509-101] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:01:06.961 [qtp1022308509-101] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:01:07,382 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 ****** dev-policy-apex-pdp-0 from Remote10.242.168.26 "14:01:07.382 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 ****** dev-policy-apex-pdp-0 from Remote10.242.168.26 "2021-06-07 14:01:07,384 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"07-06-2021::02:01:07:383", "topicId":"POLICY-PDP-PAP", "publisherId":"null", "publisherIp":"null", "subscriberId":"2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0", "subscriberIp":"10.242.168.26"} "14:01:07.384 [qtp1022308509-89] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"07-06-2021::02:01:07:383", "topicId":"POLICY-PDP-PAP", "publisherId":"null", "publisherIp":"null", "subscriberId":"2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0", "subscriberIp":"10.242.168.26"} "2021-06-07 14:01:07,384 [qtp1022308509-89] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:01:07.384 [qtp1022308509-89] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:01:07,398 [qtp1022308509-100] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:07.398 [qtp1022308509-100] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:07,402 [qtp1022308509-100] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:01:07.402 [qtp1022308509-100] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:01:07,402 [qtp1022308509-100] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "14:01:07.402 [qtp1022308509-100] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "2021-06-07 14:01:07,402 [qtp1022308509-100] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 3.0 empty replies/minute. "14:01:07.402 [qtp1022308509-100] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 3.0 empty replies/minute. "2021-06-07 14:01:07,402 [qtp1022308509-100] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:01:07.402 [qtp1022308509-100] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:01:11,383 [qtp1022308509-87] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:11.383 [qtp1022308509-87] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:11,387 [qtp1022308509-87] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:01:11.387 [qtp1022308509-87] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:01:15,821 [qtp1022308509-101] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:15.821 [qtp1022308509-101] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:15,824 [qtp1022308509-101] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:01:15.824 [qtp1022308509-101] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:01:16,037 [qtp1022308509-87] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:16.037 [qtp1022308509-87] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:16,041 [qtp1022308509-87] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:01:16.041 [qtp1022308509-87] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:01:21,394 [qtp1022308509-101] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:21.394 [qtp1022308509-101] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:22,371 [qtp1022308509-101] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:01:22.371 [qtp1022308509-101] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:01:24,403 [qtp1022308509-100] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:01:24,403 [qtp1022308509-100] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 14:01:24.403 [qtp1022308509-100] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:01:24,404 [qtp1022308509-100] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "14:01:24.404 [qtp1022308509-100] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "2021-06-07 14:01:26,058 [qtp1022308509-107] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:26.058 [qtp1022308509-107] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:26,064 [qtp1022308509-107] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:01:26.064 [qtp1022308509-107] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:01:26,297 [qtp1022308509-100] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "14:01:26.297 [qtp1022308509-100] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "2021-06-07 14:01:30,740 [qtp1022308509-108] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:30.740 [qtp1022308509-108] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:30,744 [qtp1022308509-108] INFO org.onap.dmaap.service.TopicRestService - Authenticating the user before fetching the topics "14:01:30.744 [qtp1022308509-108] INFO org.onap.dmaap.service.TopicRestService - Authenticating the user before fetching the topics "2021-06-07 14:01:30,744 [qtp1022308509-108] INFO org.onap.dmaap.service.TopicRestService - Fetching all Topics "14:01:30.744 [qtp1022308509-108] INFO org.onap.dmaap.service.TopicRestService - Fetching all Topics "2021-06-07 14:01:30,744 [qtp1022308509-108] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Fetching list of all the topics. "14:01:30.744 [qtp1022308509-108] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Fetching list of all the topics. "2021-06-07 14:01:30,744 [qtp1022308509-108] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving list of all the topics. "14:01:30.744 [qtp1022308509-108] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving list of all the topics. "2021-06-07 14:01:30,744 [qtp1022308509-108] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving all topics from root: /brokers/topics "14:01:30.744 [qtp1022308509-108] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving all topics from root: /brokers/topics "2021-06-07 14:01:32,378 [qtp1022308509-109] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:32.378 [qtp1022308509-109] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:32,888 [qtp1022308509-109] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:01:32.888 [qtp1022308509-109] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:01:33,887 [qtp1022308509-108] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Returning list of all the topics. "14:01:33.887 [qtp1022308509-108] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Returning list of all the topics. "2021-06-07 14:01:33,888 [qtp1022308509-108] INFO org.onap.dmaap.service.TopicRestService - Returning List of all Topics "14:01:33.888 [qtp1022308509-108] INFO org.onap.dmaap.service.TopicRestService - Returning List of all Topics "2021-06-07 14:01:33,894 [qtp1022308509-100] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Sent 0 msgs in 26494 ms; committed to offset 0 for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 on to the server 10.242.168.26 "14:01:33.894 [qtp1022308509-100] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Sent 0 msgs in 26494 ms; committed to offset 0 for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 on to the server 10.242.168.26 "2021-06-07 14:01:33,900 [qtp1022308509-101] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:33.900 [qtp1022308509-101] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:33,904 [qtp1022308509-101] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:01:33.904 [qtp1022308509-101] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:01:33,905 [qtp1022308509-101] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "14:01:33.905 [qtp1022308509-101] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "2021-06-07 14:01:33,905 [qtp1022308509-101] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 4.0 empty replies/minute. "14:01:33.905 [qtp1022308509-101] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 4.0 empty replies/minute. "2021-06-07 14:01:33,905 [qtp1022308509-101] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 3 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:01:33.905 [qtp1022308509-101] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 3 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:01:34,043 [qtp1022308509-110] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:34.043 [qtp1022308509-110] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:34,046 [qtp1022308509-110] INFO org.onap.dmaap.service.EventsRestService - Publishing message to topic POLICY-PDP-PAP "14:01:34.046 [qtp1022308509-110] INFO org.onap.dmaap.service.EventsRestService - Publishing message to topic POLICY-PDP-PAP "2021-06-07 14:01:34,051 [qtp1022308509-110] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - Published 1 msgs in 1 ms for topic POLICY-PDP-PAP from server 10.242.168.26 "14:01:34.051 [qtp1022308509-110] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - Published 1 msgs in 1 ms for topic POLICY-PDP-PAP from server 10.242.168.26 "2021-06-07 14:01:34,052 [qtp1022308509-110] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - Overall Response time - Published msgs in 5 ms for topic POLICY-PDP-PAP "14:01:34.052 [qtp1022308509-110] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - Overall Response time - Published msgs in 5 ms for topic POLICY-PDP-PAP "2021-06-07 14:01:36,081 [qtp1022308509-96] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:36.081 [qtp1022308509-96] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:36,084 [qtp1022308509-96] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:01:36.084 [qtp1022308509-96] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:01:42,896 [qtp1022308509-100] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:42.896 [qtp1022308509-100] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:42,900 [qtp1022308509-100] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:01:42.900 [qtp1022308509-100] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:01:45,825 [qtp1022308509-109] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:45.825 [qtp1022308509-109] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:45,828 [qtp1022308509-109] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:01:45.828 [qtp1022308509-109] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:01:46,106 [qtp1022308509-111] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:46.106 [qtp1022308509-111] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:46,110 [qtp1022308509-111] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:01:46.110 [qtp1022308509-111] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:01:50,907 [qtp1022308509-101] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:01:50,907 [qtp1022308509-101] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 14:01:50.907 [qtp1022308509-101] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:01:50,908 [qtp1022308509-101] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "14:01:50.908 [qtp1022308509-101] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "2021-06-07 14:01:51,592 [qtp1022308509-101] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "14:01:51.592 [qtp1022308509-101] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "2021-06-07 14:01:52,557 [qtp1022308509-101] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Sent 0 msgs in 18655 ms; committed to offset 0 for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 on to the server 10.242.168.26 "14:01:52.557 [qtp1022308509-101] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Sent 0 msgs in 18655 ms; committed to offset 0 for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 on to the server 10.242.168.26 "2021-06-07 14:01:52,567 [qtp1022308509-109] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:52.567 [qtp1022308509-109] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:52,570 [qtp1022308509-109] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:01:52.570 [qtp1022308509-109] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:01:52,570 [qtp1022308509-109] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "14:01:52.570 [qtp1022308509-109] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "2021-06-07 14:01:52,570 [qtp1022308509-109] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 5.0 empty replies/minute. "14:01:52.570 [qtp1022308509-109] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 5.0 empty replies/minute. "2021-06-07 14:01:52,570 [qtp1022308509-109] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:01:52.570 [qtp1022308509-109] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:01:52,907 [qtp1022308509-100] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:52.907 [qtp1022308509-100] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:52,912 [qtp1022308509-100] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:01:52.912 [qtp1022308509-100] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:01:56,129 [qtp1022308509-101] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:01:56.129 [qtp1022308509-101] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:01:56,132 [qtp1022308509-101] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:01:56.132 [qtp1022308509-101] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:02:01,739 [qtp1022308509-119] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:02:01.739 [qtp1022308509-119] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:02:01,741 [qtp1022308509-119] INFO org.onap.dmaap.service.TopicRestService - Authenticating the user before fetching the topics "14:02:01.741 [qtp1022308509-119] INFO org.onap.dmaap.service.TopicRestService - Authenticating the user before fetching the topics "2021-06-07 14:02:01,741 [qtp1022308509-119] INFO org.onap.dmaap.service.TopicRestService - Fetching all Topics "14:02:01.741 [qtp1022308509-119] INFO org.onap.dmaap.service.TopicRestService - Fetching all Topics "2021-06-07 14:02:01,741 [qtp1022308509-119] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Fetching list of all the topics. "14:02:01.741 [qtp1022308509-119] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Fetching list of all the topics. "2021-06-07 14:02:01,741 [qtp1022308509-119] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving list of all the topics. "14:02:01.741 [qtp1022308509-119] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving list of all the topics. "2021-06-07 14:02:01,741 [qtp1022308509-119] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving all topics from root: /brokers/topics "14:02:01.741 [qtp1022308509-119] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving all topics from root: /brokers/topics "2021-06-07 14:02:02,918 [qtp1022308509-120] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:02:02.918 [qtp1022308509-120] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:02:04,957 [qtp1022308509-120] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:02:04.957 [qtp1022308509-120] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:02:04,958 [qtp1022308509-119] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Returning list of all the topics. "14:02:04.958 [qtp1022308509-119] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Returning list of all the topics. "2021-06-07 14:02:04,958 [qtp1022308509-119] INFO org.onap.dmaap.service.TopicRestService - Returning List of all Topics "14:02:04.958 [qtp1022308509-119] INFO org.onap.dmaap.service.TopicRestService - Returning List of all Topics "2021-06-07 14:02:06,149 [qtp1022308509-121] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:02:06.149 [qtp1022308509-121] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:02:06,152 [qtp1022308509-121] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:02:06.152 [qtp1022308509-121] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:02:09,571 [qtp1022308509-109] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:02:09,571 [qtp1022308509-109] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 14:02:09.571 [qtp1022308509-109] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:02:09,573 [qtp1022308509-109] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "14:02:09.573 [qtp1022308509-109] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "2021-06-07 14:02:10,167 [qtp1022308509-109] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "14:02:10.167 [qtp1022308509-109] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "2021-06-07 14:02:14,964 [qtp1022308509-119] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:02:14.964 [qtp1022308509-119] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:02:14,967 [qtp1022308509-119] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:02:14.967 [qtp1022308509-119] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:02:15,823 [qtp1022308509-110] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:02:15.823 [qtp1022308509-110] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:02:15,826 [qtp1022308509-110] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:02:15.826 [qtp1022308509-110] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:02:16,168 [qtp1022308509-120] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:02:16.168 [qtp1022308509-120] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:02:16,171 [qtp1022308509-120] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:02:16.171 [qtp1022308509-120] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:02:18,499 [qtp1022308509-109] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 ****** dev-policy-apex-pdp-0 from Remote10.242.168.26 "14:02:18.499 [qtp1022308509-109] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 ****** dev-policy-apex-pdp-0 from Remote10.242.168.26 "2021-06-07 14:02:18,501 [qtp1022308509-109] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"07-06-2021::02:02:18:500", "topicId":"POLICY-PDP-PAP", "publisherId":"null", "publisherIp":"null", "subscriberId":"2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0", "subscriberIp":"10.242.168.26"} "14:02:18.501 [qtp1022308509-109] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"07-06-2021::02:02:18:500", "topicId":"POLICY-PDP-PAP", "publisherId":"null", "publisherIp":"null", "subscriberId":"2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0", "subscriberIp":"10.242.168.26"} "2021-06-07 14:02:18,501 [qtp1022308509-109] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:02:18.501 [qtp1022308509-109] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:02:18,507 [qtp1022308509-122] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:02:18.507 [qtp1022308509-122] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:02:21,653 [qtp1022308509-122] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 3144 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:02:21.653 [qtp1022308509-122] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 3144 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:02:21,654 [qtp1022308509-122] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "14:02:21.654 [qtp1022308509-122] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "2021-06-07 14:02:21,654 [qtp1022308509-122] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 6.0 empty replies/minute. "14:02:21.654 [qtp1022308509-122] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 6.0 empty replies/minute. "2021-06-07 14:02:21,654 [qtp1022308509-122] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 3145 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:02:21.654 [qtp1022308509-122] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 3145 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:02:24,973 [qtp1022308509-110] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:02:24.973 [qtp1022308509-110] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:02:24,977 [qtp1022308509-110] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:02:24.977 [qtp1022308509-110] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:02:26,191 [qtp1022308509-109] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:02:26.191 [qtp1022308509-109] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:02:26,195 [qtp1022308509-109] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:02:26.195 [qtp1022308509-109] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:02:32,739 [qtp1022308509-127] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:02:32.739 [qtp1022308509-127] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:02:32,741 [qtp1022308509-127] INFO org.onap.dmaap.service.TopicRestService - Authenticating the user before fetching the topics "14:02:32.741 [qtp1022308509-127] INFO org.onap.dmaap.service.TopicRestService - Authenticating the user before fetching the topics "2021-06-07 14:02:32,741 [qtp1022308509-127] INFO org.onap.dmaap.service.TopicRestService - Fetching all Topics "14:02:32.741 [qtp1022308509-127] INFO org.onap.dmaap.service.TopicRestService - Fetching all Topics "2021-06-07 14:02:32,741 [qtp1022308509-127] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Fetching list of all the topics. "14:02:32.741 [qtp1022308509-127] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Fetching list of all the topics. "2021-06-07 14:02:32,741 [qtp1022308509-127] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving list of all the topics. "14:02:32.741 [qtp1022308509-127] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving list of all the topics. "2021-06-07 14:02:32,741 [qtp1022308509-127] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving all topics from root: /brokers/topics "14:02:32.741 [qtp1022308509-127] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving all topics from root: /brokers/topics "2021-06-07 14:02:32,744 [qtp1022308509-127] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Returning list of all the topics. "14:02:32.744 [qtp1022308509-127] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Returning list of all the topics. "2021-06-07 14:02:32,744 [qtp1022308509-127] INFO org.onap.dmaap.service.TopicRestService - Returning List of all Topics "14:02:32.744 [qtp1022308509-127] INFO org.onap.dmaap.service.TopicRestService - Returning List of all Topics "2021-06-07 14:02:34,983 [qtp1022308509-110] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:02:34.983 [qtp1022308509-110] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:02:34,986 [qtp1022308509-110] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:02:34.986 [qtp1022308509-110] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:02:36,217 [qtp1022308509-129] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:02:36.217 [qtp1022308509-129] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:02:36,220 [qtp1022308509-129] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:02:36.220 [qtp1022308509-129] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:02:38,655 [qtp1022308509-122] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:02:38,655 [qtp1022308509-122] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 14:02:38.655 [qtp1022308509-122] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:02:38,656 [qtp1022308509-122] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "14:02:38.656 [qtp1022308509-122] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "2021-06-07 14:02:39,974 [qtp1022308509-122] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "14:02:39.974 [qtp1022308509-122] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "2021-06-07 14:02:44,954 [qtp1022308509-122] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 ****** dev-policy-apex-pdp-0 from Remote10.242.168.26 "14:02:44.954 [qtp1022308509-122] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 ****** dev-policy-apex-pdp-0 from Remote10.242.168.26 "2021-06-07 14:02:44,954 [qtp1022308509-122] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"07-06-2021::02:02:44:954", "topicId":"POLICY-PDP-PAP", "publisherId":"null", "publisherIp":"null", "subscriberId":"2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0", "subscriberIp":"10.242.168.26"} "14:02:44.954 [qtp1022308509-122] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"07-06-2021::02:02:44:954", "topicId":"POLICY-PDP-PAP", "publisherId":"null", "publisherIp":"null", "subscriberId":"2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0", "subscriberIp":"10.242.168.26"} "2021-06-07 14:02:44,955 [qtp1022308509-122] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:02:44.955 [qtp1022308509-122] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:02:44,968 [qtp1022308509-131] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:02:44.968 [qtp1022308509-131] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:02:44,992 [qtp1022308509-110] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:02:44.992 [qtp1022308509-110] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:02:44,997 [qtp1022308509-110] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:02:44.997 [qtp1022308509-110] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:02:45,590 [qtp1022308509-131] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 620 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:02:45.590 [qtp1022308509-131] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 620 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:02:45,591 [qtp1022308509-131] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "14:02:45.591 [qtp1022308509-131] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "2021-06-07 14:02:45,591 [qtp1022308509-131] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 3.5 empty replies/minute. "14:02:45.591 [qtp1022308509-131] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 3.5 empty replies/minute. "2021-06-07 14:02:45,591 [qtp1022308509-131] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 621 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:02:45.591 [qtp1022308509-131] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 621 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:02:45,824 [qtp1022308509-115] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:02:45.824 [qtp1022308509-115] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:02:45,828 [qtp1022308509-115] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:02:45.828 [qtp1022308509-115] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:02:46,240 [qtp1022308509-127] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:02:46.240 [qtp1022308509-127] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:02:46,243 [qtp1022308509-127] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:02:46.243 [qtp1022308509-127] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:02:51,999 [qtp1022308509-122] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication ""2021-06-07 14:02:51,999 [qtp1022308509-115] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:02:51.999 [qtp1022308509-122] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication 14:02:51.999 [qtp1022308509-115] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:02:52,002 [qtp1022308509-122] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. ""2021-06-07 14:02:52,002 [qtp1022308509-115] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:02:52.002 [qtp1022308509-122] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. 14:02:52.002 [qtp1022308509-115] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:02:55,008 [qtp1022308509-135] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:02:55.008 [qtp1022308509-135] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:02:55,012 [qtp1022308509-135] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:02:55.012 [qtp1022308509-135] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:02:56,264 [qtp1022308509-122] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:02:56.264 [qtp1022308509-122] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:02:56,267 [qtp1022308509-122] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:02:56.267 [qtp1022308509-122] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:03:02,593 [qtp1022308509-131] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:03:02,593 [qtp1022308509-131] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 14:03:02.593 [qtp1022308509-131] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:03:02,594 [qtp1022308509-131] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "14:03:02.594 [qtp1022308509-131] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "2021-06-07 14:03:02,748 [qtp1022308509-110] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:03:02.748 [qtp1022308509-110] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:03:02,751 [qtp1022308509-110] INFO org.onap.dmaap.service.TopicRestService - Authenticating the user before fetching the topics "14:03:02.751 [qtp1022308509-110] INFO org.onap.dmaap.service.TopicRestService - Authenticating the user before fetching the topics "2021-06-07 14:03:02,751 [qtp1022308509-110] INFO org.onap.dmaap.service.TopicRestService - Fetching all Topics "14:03:02.751 [qtp1022308509-110] INFO org.onap.dmaap.service.TopicRestService - Fetching all Topics "2021-06-07 14:03:02,751 [qtp1022308509-110] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Fetching list of all the topics. "14:03:02.751 [qtp1022308509-110] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Fetching list of all the topics. "2021-06-07 14:03:02,751 [qtp1022308509-110] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving list of all the topics. "14:03:02.751 [qtp1022308509-110] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving list of all the topics. "2021-06-07 14:03:02,751 [qtp1022308509-110] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving all topics from root: /brokers/topics "14:03:02.751 [qtp1022308509-110] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving all topics from root: /brokers/topics "2021-06-07 14:03:05,020 [qtp1022308509-128] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:03:05.020 [qtp1022308509-128] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:03:05,452 [qtp1022308509-128] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:03:05.452 [qtp1022308509-128] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:03:05,453 [qtp1022308509-131] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "14:03:05.453 [qtp1022308509-131] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "2021-06-07 14:03:05,453 [qtp1022308509-110] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Returning list of all the topics. "14:03:05.453 [qtp1022308509-110] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Returning list of all the topics. "2021-06-07 14:03:05,453 [qtp1022308509-110] INFO org.onap.dmaap.service.TopicRestService - Returning List of all Topics "14:03:05.453 [qtp1022308509-110] INFO org.onap.dmaap.service.TopicRestService - Returning List of all Topics "2021-06-07 14:03:06,284 [qtp1022308509-136] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:03:06.284 [qtp1022308509-136] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:03:07,731 [qtp1022308509-136] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:03:07.731 [qtp1022308509-136] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:03:13,425 [qtp1022308509-131] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 ****** dev-policy-apex-pdp-0 from Remote10.242.168.26 "14:03:13.425 [qtp1022308509-131] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 ****** dev-policy-apex-pdp-0 from Remote10.242.168.26 "2021-06-07 14:03:13,426 [qtp1022308509-131] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"07-06-2021::02:03:13:426", "topicId":"POLICY-PDP-PAP", "publisherId":"null", "publisherIp":"null", "subscriberId":"2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0", "subscriberIp":"10.242.168.26"} "14:03:13.426 [qtp1022308509-131] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"07-06-2021::02:03:13:426", "topicId":"POLICY-PDP-PAP", "publisherId":"null", "publisherIp":"null", "subscriberId":"2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0", "subscriberIp":"10.242.168.26"} "2021-06-07 14:03:13,427 [qtp1022308509-131] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:03:13.427 [qtp1022308509-131] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:03:13,433 [qtp1022308509-138] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:03:13.433 [qtp1022308509-138] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:03:14,030 [qtp1022308509-138] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 595 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:03:14.030 [qtp1022308509-138] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 595 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:03:14,030 [qtp1022308509-138] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "14:03:14.030 [qtp1022308509-138] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "2021-06-07 14:03:14,031 [qtp1022308509-138] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 4.0 empty replies/minute. "14:03:14.031 [qtp1022308509-138] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 4.0 empty replies/minute. "2021-06-07 14:03:14,031 [qtp1022308509-138] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 596 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:03:14.031 [qtp1022308509-138] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 596 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:03:15,459 [qtp1022308509-110] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:03:15.459 [qtp1022308509-110] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:03:15,775 [qtp1022308509-110] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:03:15.775 [qtp1022308509-110] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:03:15,824 [qtp1022308509-137] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:03:15.824 [qtp1022308509-137] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:03:15,827 [qtp1022308509-137] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:03:15.827 [qtp1022308509-137] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:03:17,749 [qtp1022308509-128] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:03:17.749 [qtp1022308509-128] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:03:17,754 [qtp1022308509-128] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:03:17.754 [qtp1022308509-128] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:03:25,782 [qtp1022308509-137] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:03:25.782 [qtp1022308509-137] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:03:25,785 [qtp1022308509-137] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:03:25.785 [qtp1022308509-137] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:03:27,772 [qtp1022308509-143] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:03:27.772 [qtp1022308509-143] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:03:27,775 [qtp1022308509-143] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:03:27.775 [qtp1022308509-143] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:03:31,032 [qtp1022308509-138] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:03:31,032 [qtp1022308509-138] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 14:03:31.032 [qtp1022308509-138] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:03:31,033 [qtp1022308509-138] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "14:03:31.033 [qtp1022308509-138] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "2021-06-07 14:03:31,395 [qtp1022308509-138] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "14:03:31.395 [qtp1022308509-138] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "2021-06-07 14:03:33,707 [qtp1022308509-138] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 ****** dev-policy-apex-pdp-0 from Remote10.242.168.26 "14:03:33.707 [qtp1022308509-138] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 ****** dev-policy-apex-pdp-0 from Remote10.242.168.26 "2021-06-07 14:03:33,708 [qtp1022308509-138] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"07-06-2021::02:03:33:708", "topicId":"POLICY-PDP-PAP", "publisherId":"null", "publisherIp":"null", "subscriberId":"2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0", "subscriberIp":"10.242.168.26"} "14:03:33.708 [qtp1022308509-138] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"07-06-2021::02:03:33:708", "topicId":"POLICY-PDP-PAP", "publisherId":"null", "publisherIp":"null", "subscriberId":"2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0", "subscriberIp":"10.242.168.26"} "2021-06-07 14:03:33,709 [qtp1022308509-138] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:03:33.709 [qtp1022308509-138] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:03:33,717 [qtp1022308509-143] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:03:33.717 [qtp1022308509-143] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:03:33,721 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:03:33.721 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:03:33,721 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "14:03:33.721 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "2021-06-07 14:03:33,721 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 3.0 empty replies/minute. "14:03:33.721 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 3.0 empty replies/minute. "2021-06-07 14:03:33,721 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:03:33.721 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:03:33,749 [qtp1022308509-145] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:03:33.749 [qtp1022308509-145] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:03:33,750 [qtp1022308509-145] INFO org.onap.dmaap.service.TopicRestService - Authenticating the user before fetching the topics "14:03:33.750 [qtp1022308509-145] INFO org.onap.dmaap.service.TopicRestService - Authenticating the user before fetching the topics "2021-06-07 14:03:33,750 [qtp1022308509-145] INFO org.onap.dmaap.service.TopicRestService - Fetching all Topics "14:03:33.750 [qtp1022308509-145] INFO org.onap.dmaap.service.TopicRestService - Fetching all Topics "2021-06-07 14:03:33,750 [qtp1022308509-145] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Fetching list of all the topics. "14:03:33.750 [qtp1022308509-145] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Fetching list of all the topics. "2021-06-07 14:03:33,750 [qtp1022308509-145] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving list of all the topics. "14:03:33.750 [qtp1022308509-145] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving list of all the topics. "2021-06-07 14:03:33,751 [qtp1022308509-145] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving all topics from root: /brokers/topics "14:03:33.751 [qtp1022308509-145] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving all topics from root: /brokers/topics "2021-06-07 14:03:33,753 [qtp1022308509-145] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Returning list of all the topics. "14:03:33.753 [qtp1022308509-145] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Returning list of all the topics. "2021-06-07 14:03:33,753 [qtp1022308509-145] INFO org.onap.dmaap.service.TopicRestService - Returning List of all Topics "14:03:33.753 [qtp1022308509-145] INFO org.onap.dmaap.service.TopicRestService - Returning List of all Topics "2021-06-07 14:03:34,041 [qtp1022308509-110] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:03:34.041 [qtp1022308509-110] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:03:34,043 [qtp1022308509-110] INFO org.onap.dmaap.service.EventsRestService - Publishing message to topic POLICY-PDP-PAP "14:03:34.043 [qtp1022308509-110] INFO org.onap.dmaap.service.EventsRestService - Publishing message to topic POLICY-PDP-PAP "2021-06-07 14:03:34,046 [qtp1022308509-110] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - Published 1 msgs in 0 ms for topic POLICY-PDP-PAP from server 10.242.168.26 "14:03:34.046 [qtp1022308509-110] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - Published 1 msgs in 0 ms for topic POLICY-PDP-PAP from server 10.242.168.26 "2021-06-07 14:03:34,047 [qtp1022308509-110] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - Overall Response time - Published msgs in 3 ms for topic POLICY-PDP-PAP "14:03:34.047 [qtp1022308509-110] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - Overall Response time - Published msgs in 3 ms for topic POLICY-PDP-PAP "2021-06-07 14:03:35,791 [qtp1022308509-138] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:03:35.791 [qtp1022308509-138] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:03:36,004 [qtp1022308509-138] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:03:36.004 [qtp1022308509-138] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:03:37,791 [qtp1022308509-146] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:03:37.791 [qtp1022308509-146] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:03:37,795 [qtp1022308509-146] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:03:37.795 [qtp1022308509-146] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:03:45,821 [qtp1022308509-149] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:03:45.821 [qtp1022308509-149] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:03:45,859 [qtp1022308509-149] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:03:45.859 [qtp1022308509-149] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:03:46,011 [qtp1022308509-139] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:03:46.011 [qtp1022308509-139] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:03:46,014 [qtp1022308509-139] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:03:46.014 [qtp1022308509-139] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:03:47,812 [qtp1022308509-110] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:03:47.812 [qtp1022308509-110] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:03:47,815 [qtp1022308509-110] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:03:47.815 [qtp1022308509-110] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:03:50,722 [qtp1022308509-143] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:03:50,722 [qtp1022308509-143] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 14:03:50.722 [qtp1022308509-143] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:03:50,723 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "14:03:50.723 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "2021-06-07 14:03:52,037 [qtp1022308509-139] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:03:52.037 [qtp1022308509-139] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:03:52,037 [qtp1022308509-110] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:03:52.037 [qtp1022308509-110] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:03:53,079 [qtp1022308509-110] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. ""2021-06-07 14:03:53,079 [qtp1022308509-139] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:03:53.079 [qtp1022308509-110] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. 14:03:53.079 [qtp1022308509-139] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:03:53,081 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "14:03:53.081 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "2021-06-07 14:03:55,112 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 ****** dev-policy-apex-pdp-0 from Remote10.242.168.26 "14:03:55.112 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 ****** dev-policy-apex-pdp-0 from Remote10.242.168.26 "2021-06-07 14:03:55,113 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"07-06-2021::02:03:55:113", "topicId":"POLICY-PDP-PAP", "publisherId":"null", "publisherIp":"null", "subscriberId":"2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0", "subscriberIp":"10.242.168.26"} "14:03:55.113 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"07-06-2021::02:03:55:113", "topicId":"POLICY-PDP-PAP", "publisherId":"null", "publisherIp":"null", "subscriberId":"2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0", "subscriberIp":"10.242.168.26"} "2021-06-07 14:03:55,113 [qtp1022308509-143] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:03:55.113 [qtp1022308509-143] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:03:55,118 [qtp1022308509-152] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:03:55.118 [qtp1022308509-152] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:03:55,121 [qtp1022308509-152] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:03:55.121 [qtp1022308509-152] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:03:55,121 [qtp1022308509-152] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "14:03:55.121 [qtp1022308509-152] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "2021-06-07 14:03:55,121 [qtp1022308509-152] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 3.3333333333333335 empty replies/minute. "14:03:55.121 [qtp1022308509-152] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 3.3333333333333335 empty replies/minute. "2021-06-07 14:03:55,121 [qtp1022308509-152] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:03:55.121 [qtp1022308509-152] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:03:56,020 [qtp1022308509-153] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:03:56.020 [qtp1022308509-153] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:03:56,023 [qtp1022308509-153] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:03:56.023 [qtp1022308509-153] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:03:57,832 [qtp1022308509-146] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:03:57.832 [qtp1022308509-146] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:03:57,838 [qtp1022308509-146] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:03:57.838 [qtp1022308509-146] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:04:03,758 [qtp1022308509-153] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:04:03.758 [qtp1022308509-153] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:04:03,760 [qtp1022308509-153] INFO org.onap.dmaap.service.TopicRestService - Authenticating the user before fetching the topics "14:04:03.760 [qtp1022308509-153] INFO org.onap.dmaap.service.TopicRestService - Authenticating the user before fetching the topics "2021-06-07 14:04:03,760 [qtp1022308509-153] INFO org.onap.dmaap.service.TopicRestService - Fetching all Topics "14:04:03.760 [qtp1022308509-153] INFO org.onap.dmaap.service.TopicRestService - Fetching all Topics "2021-06-07 14:04:03,760 [qtp1022308509-153] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Fetching list of all the topics. "14:04:03.760 [qtp1022308509-153] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Fetching list of all the topics. "2021-06-07 14:04:03,760 [qtp1022308509-153] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving list of all the topics. "14:04:03.760 [qtp1022308509-153] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving list of all the topics. "2021-06-07 14:04:03,760 [qtp1022308509-153] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving all topics from root: /brokers/topics "14:04:03.760 [qtp1022308509-153] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving all topics from root: /brokers/topics "2021-06-07 14:04:03,763 [qtp1022308509-153] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Returning list of all the topics. "14:04:03.763 [qtp1022308509-153] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Returning list of all the topics. "2021-06-07 14:04:03,763 [qtp1022308509-153] INFO org.onap.dmaap.service.TopicRestService - Returning List of all Topics "14:04:03.763 [qtp1022308509-153] INFO org.onap.dmaap.service.TopicRestService - Returning List of all Topics "2021-06-07 14:04:06,029 [qtp1022308509-154] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:04:06.029 [qtp1022308509-154] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:04:06,032 [qtp1022308509-154] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:04:06.032 [qtp1022308509-154] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:04:07,857 [qtp1022308509-157] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:04:07.857 [qtp1022308509-157] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:04:07,862 [qtp1022308509-157] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:04:07.862 [qtp1022308509-157] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:04:12,123 [qtp1022308509-152] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:04:12,123 [qtp1022308509-152] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 14:04:12.123 [qtp1022308509-152] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:04:12,125 [qtp1022308509-152] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "14:04:12.125 [qtp1022308509-152] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "2021-06-07 14:04:15,833 [qtp1022308509-139] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:04:15.833 [qtp1022308509-139] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:04:16,038 [qtp1022308509-143] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:04:16.038 [qtp1022308509-143] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:04:16,276 [qtp1022308509-143] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. ""2021-06-07 14:04:16,276 [qtp1022308509-139] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:04:16.276 [qtp1022308509-143] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. 14:04:16.276 [qtp1022308509-139] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:04:16,277 [qtp1022308509-152] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "14:04:16.277 [qtp1022308509-152] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "2021-06-07 14:04:17,878 [qtp1022308509-110] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:04:17.878 [qtp1022308509-110] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:04:18,168 [qtp1022308509-110] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:04:18.168 [qtp1022308509-110] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:04:20,451 [qtp1022308509-152] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 ****** dev-policy-apex-pdp-0 from Remote10.242.168.26 "14:04:20.451 [qtp1022308509-152] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 ****** dev-policy-apex-pdp-0 from Remote10.242.168.26 "2021-06-07 14:04:20,452 [qtp1022308509-152] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"07-06-2021::02:04:20:451", "topicId":"POLICY-PDP-PAP", "publisherId":"null", "publisherIp":"null", "subscriberId":"2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0", "subscriberIp":"10.242.168.26"} "14:04:20.452 [qtp1022308509-152] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"07-06-2021::02:04:20:451", "topicId":"POLICY-PDP-PAP", "publisherId":"null", "publisherIp":"null", "subscriberId":"2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0", "subscriberIp":"10.242.168.26"} "2021-06-07 14:04:20,452 [qtp1022308509-152] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:04:20.452 [qtp1022308509-152] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:04:20,463 [qtp1022308509-143] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:04:20.463 [qtp1022308509-143] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:04:20,466 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:04:20.466 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:04:20,467 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "14:04:20.467 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "2021-06-07 14:04:20,467 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 3.6666666666666665 empty replies/minute. "14:04:20.467 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 3.6666666666666665 empty replies/minute. "2021-06-07 14:04:20,467 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 3 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:04:20.467 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 3 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:04:26,283 [qtp1022308509-139] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:04:26.283 [qtp1022308509-139] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:04:26,287 [qtp1022308509-139] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:04:26.287 [qtp1022308509-139] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:04:28,188 [qtp1022308509-152] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:04:28.188 [qtp1022308509-152] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:04:28,192 [qtp1022308509-152] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:04:28.192 [qtp1022308509-152] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:04:33,768 [qtp1022308509-139] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:04:33.768 [qtp1022308509-139] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:04:33,770 [qtp1022308509-139] INFO org.onap.dmaap.service.TopicRestService - Authenticating the user before fetching the topics "14:04:33.770 [qtp1022308509-139] INFO org.onap.dmaap.service.TopicRestService - Authenticating the user before fetching the topics "2021-06-07 14:04:33,770 [qtp1022308509-139] INFO org.onap.dmaap.service.TopicRestService - Fetching all Topics "14:04:33.770 [qtp1022308509-139] INFO org.onap.dmaap.service.TopicRestService - Fetching all Topics "2021-06-07 14:04:33,770 [qtp1022308509-139] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Fetching list of all the topics. "14:04:33.770 [qtp1022308509-139] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Fetching list of all the topics. "2021-06-07 14:04:33,770 [qtp1022308509-139] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving list of all the topics. "14:04:33.770 [qtp1022308509-139] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving list of all the topics. "2021-06-07 14:04:33,770 [qtp1022308509-139] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving all topics from root: /brokers/topics "14:04:33.770 [qtp1022308509-139] INFO org.onap.dmaap.dmf.mr.utils.ConfigurationReader - Retrieving all topics from root: /brokers/topics "2021-06-07 14:04:33,773 [qtp1022308509-139] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Returning list of all the topics. "14:04:33.773 [qtp1022308509-139] INFO org.onap.dmaap.dmf.mr.service.impl.TopicServiceImpl - Returning list of all the topics. "2021-06-07 14:04:33,773 [qtp1022308509-139] INFO org.onap.dmaap.service.TopicRestService - Returning List of all Topics "14:04:33.773 [qtp1022308509-139] INFO org.onap.dmaap.service.TopicRestService - Returning List of all Topics "2021-06-07 14:04:36,293 [qtp1022308509-164] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:04:36.293 [qtp1022308509-164] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:04:36,296 [qtp1022308509-164] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:04:36.296 [qtp1022308509-164] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:04:37,468 [qtp1022308509-143] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:04:37,468 [qtp1022308509-143] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 14:04:37.468 [qtp1022308509-143] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:04:37,469 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "14:04:37.469 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "2021-06-07 14:04:38,213 [qtp1022308509-165] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:04:38.213 [qtp1022308509-165] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:04:38,279 [qtp1022308509-165] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:04:38.279 [qtp1022308509-165] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:04:38,280 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "14:04:38.280 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "2021-06-07 14:04:38,592 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 ****** dev-policy-apex-pdp-0 from Remote10.242.168.26 "14:04:38.592 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 ****** dev-policy-apex-pdp-0 from Remote10.242.168.26 "2021-06-07 14:04:38,593 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"07-06-2021::02:04:38:593", "topicId":"POLICY-PDP-PAP", "publisherId":"null", "publisherIp":"null", "subscriberId":"2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0", "subscriberIp":"10.242.168.26"} "14:04:38.593 [qtp1022308509-143] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"07-06-2021::02:04:38:593", "topicId":"POLICY-PDP-PAP", "publisherId":"null", "publisherIp":"null", "subscriberId":"2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0", "subscriberIp":"10.242.168.26"} "2021-06-07 14:04:38,594 [qtp1022308509-143] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:04:38.594 [qtp1022308509-143] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:04:38,602 [qtp1022308509-159] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:04:38.602 [qtp1022308509-159] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:04:38,605 [qtp1022308509-159] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:04:38.605 [qtp1022308509-159] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:04:38,605 [qtp1022308509-159] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "14:04:38.605 [qtp1022308509-159] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "2021-06-07 14:04:38,605 [qtp1022308509-159] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 3.0 empty replies/minute. "14:04:38.605 [qtp1022308509-159] INFO org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3::dev-policy-apex-pdp-0: 3.0 empty replies/minute. "2021-06-07 14:04:38,605 [qtp1022308509-159] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:04:38.605 [qtp1022308509-159] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents getConsumerFor 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:04:45,823 [qtp1022308509-157] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:04:45.823 [qtp1022308509-157] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:04:45,827 [qtp1022308509-157] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:04:45.827 [qtp1022308509-157] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:04:46,306 [qtp1022308509-165] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:04:46.306 [qtp1022308509-165] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:04:46,310 [qtp1022308509-165] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:04:46.310 [qtp1022308509-165] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:04:48,297 [qtp1022308509-139] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:04:48.297 [qtp1022308509-139] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:04:48,300 [qtp1022308509-139] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:04:48.300 [qtp1022308509-139] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:04:53,096 [qtp1022308509-165] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:04:53.096 [qtp1022308509-165] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:04:53,099 [qtp1022308509-171] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:04:53.099 [qtp1022308509-171] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:04:53,374 [qtp1022308509-171] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. ""2021-06-07 14:04:53,374 [qtp1022308509-165] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:04:53.374 [qtp1022308509-171] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. 14:04:53.374 [qtp1022308509-165] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:04:55,606 [qtp1022308509-159] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:04:55,606 [qtp1022308509-159] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer "java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) 14:04:55.606 [qtp1022308509-159] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - TimeoutException in in Kafka consumer java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) at org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer.nextMessage(Kafka011Consumer.java:155) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.forEachMessage(CambriaOutboundEventStream.java:400) at org.onap.dmaap.dmf.mr.resources.CambriaOutboundEventStream.write(CambriaOutboundEventStream.java:266) at org.onap.dmaap.dmf.mr.utils.DMaaPResponseBuilder.respondOkWithStream(DMaaPResponseBuilder.java:134) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.respondOkWithStream(EventsServiceImpl.java:259) at org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl.getEvents(EventsServiceImpl.java:172) at org.onap.dmaap.service.EventsRestService.getEvents(EventsRestService.java:132) at sun.reflect.GeneratedMethodAccessor126.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:179) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192) at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:103) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:59) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:96) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) at org.apache.camel.component.cxf.cxfbean.CxfBeanDestination.process(CxfBeanDestination.java:83) at org.apache.camel.impl.ProcessorEndpoint.onExchange(ProcessorEndpoint.java:103) at org.apache.camel.impl.ProcessorEndpoint$1.process(ProcessorEndpoint.java:71) at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.Pipeline.process(Pipeline.java:138) at org.apache.camel.processor.Pipeline.process(Pipeline.java:101) at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:97) at org.apache.camel.http.common.CamelServlet.doService(CamelServlet.java:208) at org.apache.camel.http.common.CamelServlet.service(CamelServlet.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at ajsc.filter.PassthruFilter.doFilter(PassthruFilter.java:26) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at com.att.ajsc.csi.writeablerequestfilter.WriteableRequestFilter.doFilter(WriteableRequestFilter.java:41) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.onap.dmaap.util.DMaaPAuthFilter.doFilter(DMaaPAuthFilter.java:69) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:531) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:422) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:306) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:160) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680) at java.lang.Thread.run(Thread.java:748) "2021-06-07 14:04:55,607 [qtp1022308509-159] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "14:04:55.607 [qtp1022308509-159] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3] now, "2021-06-07 14:04:55,699 [qtp1022308509-159] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "14:04:55.699 [qtp1022308509-159] INFO org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Writing groupName POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 to path /live-lock-avoid/unstick-tasks/looming-hummingbird-message-router-757568cc6c-zfpj4:3904/POLICY-PDP-PAP::2e207fe6-0409-4359-83ce-db73395e0be3 "2021-06-07 14:04:55,902 [qtp1022308509-159] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 ****** dev-policy-apex-pdp-0 from Remote10.242.168.26 "14:04:55.902 [qtp1022308509-159] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 ****** dev-policy-apex-pdp-0 from Remote10.242.168.26 "2021-06-07 14:04:55,903 [qtp1022308509-159] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"07-06-2021::02:04:55:903", "topicId":"POLICY-PDP-PAP", "publisherId":"null", "publisherIp":"null", "subscriberId":"2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0", "subscriberIp":"10.242.168.26"} "14:04:55.903 [qtp1022308509-159] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"07-06-2021::02:04:55:903", "topicId":"POLICY-PDP-PAP", "publisherId":"null", "publisherIp":"null", "subscriberId":"2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0", "subscriberIp":"10.242.168.26"} "2021-06-07 14:04:55,904 [qtp1022308509-159] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "14:04:55.904 [qtp1022308509-159] INFO org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper.. "2021-06-07 14:04:55,909 [qtp1022308509-139] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "14:04:55.909 [qtp1022308509-139] INFO org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication "2021-06-07 14:04:55,913 [qtp1022308509-139] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "14:04:55.913 [qtp1022308509-139] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] Time taken in getEvents Authorization 2 ms for POLICY-PDP-PAP 2e207fe6-0409-4359-83ce-db73395e0be3 dev-policy-apex-pdp-0 "2021-06-07 14:04:55,913 [qtp1022308509-139] INFO org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POLICY-PDP-PAP/2e207fe6-0409-4359-83ce-db73395e0be3/dev-policy-apex-pdp-0] fetch: timeout=15000, limit=0, filter= from Remote host 10.242.168.26 "14:04:55.913 [qtp1022308509-139] INFO org.onap.dmaap.dmf.mr.service.imp