By type
*** Starting uWSGI 2.0.19.1 (64bit) on [Thu Mar 10 04:30:37 2022] ***
compiled with version: 9.3.0 on 29 July 2021 10:04:23
os: Linux-4.19.0-17-cloud-amd64 #1 SMP Debian 4.19.194-3 (2021-07-18)
nodename: onap-oof-has-api-6cd96d9485-cc5fc
machine: x86_64
clock source: unix
pcre jit disabled
detected number of CPU cores: 16
current working directory: /app
writing pidfile to /run/conductor/conductor-uwsgi.pid
detected binary path: /usr/local/bin/uwsgi
your memory page size is 4096 bytes
detected max file descriptor number: 1048576
lock engine: pthread robust mutexes
thunder lock: disabled (you can enable it with --thunder-lock)
uwsgi socket 0 bound to UNIX address /run/conductor/uwsgi.sock fd 3
uwsgi socket 1 bound to TCP address 0.0.0.0:8080 fd 4
Python version: 3.9.1 (default, Dec 11 2020, 14:29:41) [GCC 9.3.0]
Python main interpreter initialized at 0x557177426120
python threads support enabled
your server socket listen backlog is limited to 100 connections
your mercy for graceful operations on workers is 60 seconds
mapped 510440 bytes (498 KB) for 6 cores
*** Operational MODE: preforking ***
2022-03-10 04:30:40,731||140243836554568|INFO|app|conductor.api.app: [-] Full WSGI config used: /usr/local/etc/conductor/api_paste.ini
WSGI app 0 (mountpoint='') ready in 10 seconds on interpreter 0x557177426120 pid: 1 (default app)
spawned uWSGI master process (pid: 1)
spawned uWSGI worker 1 (pid: 147, cores: 1)
spawned uWSGI worker 2 (pid: 148, cores: 1)
spawned uWSGI worker 3 (pid: 149, cores: 1)
spawned uWSGI worker 4 (pid: 150, cores: 1)
spawned uWSGI worker 5 (pid: 151, cores: 1)
spawned uWSGI worker 6 (pid: 152, cores: 1)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 5 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 153)
Respawned uWSGI worker 2 (new pid: 154)
Respawned uWSGI worker 3 (new pid: 155)
Respawned uWSGI worker 4 (new pid: 156)
Respawned uWSGI worker 5 (new pid: 157)
Respawned uWSGI worker 6 (new pid: 158)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 5 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 159)
Respawned uWSGI worker 2 (new pid: 160)
Respawned uWSGI worker 3 (new pid: 161)
Respawned uWSGI worker 4 (new pid: 162)
Respawned uWSGI worker 5 (new pid: 163)
Respawned uWSGI worker 6 (new pid: 164)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 5 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 165)
Respawned uWSGI worker 2 (new pid: 166)
Respawned uWSGI worker 3 (new pid: 167)
Respawned uWSGI worker 4 (new pid: 168)
Respawned uWSGI worker 5 (new pid: 169)
Respawned uWSGI worker 6 (new pid: 170)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 5 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 171)
Respawned uWSGI worker 2 (new pid: 172)
Respawned uWSGI worker 3 (new pid: 173)
Respawned uWSGI worker 4 (new pid: 174)
Respawned uWSGI worker 5 (new pid: 175)
Respawned uWSGI worker 6 (new pid: 176)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 5 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 177)
Respawned uWSGI worker 2 (new pid: 178)
Respawned uWSGI worker 3 (new pid: 179)
Respawned uWSGI worker 4 (new pid: 180)
Respawned uWSGI worker 5 (new pid: 181)
Respawned uWSGI worker 6 (new pid: 182)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 5 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 183)
Respawned uWSGI worker 2 (new pid: 184)
Respawned uWSGI worker 3 (new pid: 185)
Respawned uWSGI worker 4 (new pid: 186)
Respawned uWSGI worker 5 (new pid: 187)
Respawned uWSGI worker 6 (new pid: 188)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 5 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 189)
Respawned uWSGI worker 2 (new pid: 190)
Respawned uWSGI worker 3 (new pid: 191)
Respawned uWSGI worker 4 (new pid: 192)
Respawned uWSGI worker 6 (new pid: 193)
Respawned uWSGI worker 5 (new pid: 194)
worker 1 lifetime reached, it was running for 302 second(s)
worker 2 lifetime reached, it was running for 302 second(s)
worker 3 lifetime reached, it was running for 302 second(s)
worker 4 lifetime reached, it was running for 302 second(s)
worker 6 lifetime reached, it was running for 302 second(s)
Respawned uWSGI worker 1 (new pid: 195)
Respawned uWSGI worker 2 (new pid: 196)
Respawned uWSGI worker 3 (new pid: 197)
Respawned uWSGI worker 4 (new pid: 198)
Respawned uWSGI worker 6 (new pid: 199)
worker 5 lifetime reached, it was running for 302 second(s)
Respawned uWSGI worker 5 (new pid: 200)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 201)
Respawned uWSGI worker 2 (new pid: 202)
Respawned uWSGI worker 3 (new pid: 203)
Respawned uWSGI worker 4 (new pid: 204)
Respawned uWSGI worker 6 (new pid: 205)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 206)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 207)
Respawned uWSGI worker 2 (new pid: 208)
Respawned uWSGI worker 3 (new pid: 209)
Respawned uWSGI worker 4 (new pid: 210)
Respawned uWSGI worker 6 (new pid: 211)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 212)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 213)
Respawned uWSGI worker 2 (new pid: 214)
Respawned uWSGI worker 3 (new pid: 215)
Respawned uWSGI worker 4 (new pid: 216)
Respawned uWSGI worker 6 (new pid: 217)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 218)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 219)
Respawned uWSGI worker 2 (new pid: 220)
Respawned uWSGI worker 3 (new pid: 221)
Respawned uWSGI worker 4 (new pid: 222)
Respawned uWSGI worker 6 (new pid: 223)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 224)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 225)
Respawned uWSGI worker 2 (new pid: 226)
Respawned uWSGI worker 3 (new pid: 227)
Respawned uWSGI worker 4 (new pid: 228)
Respawned uWSGI worker 6 (new pid: 229)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 230)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 231)
Respawned uWSGI worker 2 (new pid: 232)
Respawned uWSGI worker 3 (new pid: 233)
Respawned uWSGI worker 4 (new pid: 234)
Respawned uWSGI worker 6 (new pid: 235)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 236)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 237)
Respawned uWSGI worker 2 (new pid: 238)
Respawned uWSGI worker 3 (new pid: 239)
Respawned uWSGI worker 4 (new pid: 240)
Respawned uWSGI worker 6 (new pid: 241)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 242)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 243)
Respawned uWSGI worker 2 (new pid: 244)
Respawned uWSGI worker 3 (new pid: 245)
Respawned uWSGI worker 4 (new pid: 246)
Respawned uWSGI worker 6 (new pid: 247)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 248)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 249)
Respawned uWSGI worker 2 (new pid: 250)
Respawned uWSGI worker 3 (new pid: 251)
Respawned uWSGI worker 4 (new pid: 252)
Respawned uWSGI worker 6 (new pid: 253)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 254)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 255)
Respawned uWSGI worker 2 (new pid: 256)
Respawned uWSGI worker 3 (new pid: 257)
Respawned uWSGI worker 4 (new pid: 258)
Respawned uWSGI worker 6 (new pid: 259)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 260)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 261)
Respawned uWSGI worker 2 (new pid: 262)
Respawned uWSGI worker 3 (new pid: 263)
Respawned uWSGI worker 4 (new pid: 264)
Respawned uWSGI worker 6 (new pid: 265)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 266)
2022-03-10 06:07:16,951||140243836554568|INFO|component|conductor.common.music.messaging.component: [-] Message 197538f2-d931-414b-b553-108fd4dc7862 on topic controller enqueued.
[pid: 266|app: 0|req: 1/1] 10.233.69.240 () {46 vars in 589 bytes} [Thu Mar 10 06:07:05 2022] GET /v1/plans/healthcheck => generated 159 bytes in 53093 msecs (HTTP/1.1 200) 5 headers in 134 bytes (2 switches on core 0)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 310)
Respawned uWSGI worker 2 (new pid: 311)
Respawned uWSGI worker 3 (new pid: 312)
Respawned uWSGI worker 4 (new pid: 313)
Respawned uWSGI worker 6 (new pid: 314)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 315)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 316)
Respawned uWSGI worker 2 (new pid: 317)
Respawned uWSGI worker 3 (new pid: 318)
Respawned uWSGI worker 4 (new pid: 319)
Respawned uWSGI worker 6 (new pid: 320)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 321)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 322)
Respawned uWSGI worker 2 (new pid: 323)
Respawned uWSGI worker 3 (new pid: 324)
Respawned uWSGI worker 4 (new pid: 325)
Respawned uWSGI worker 6 (new pid: 326)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 327)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 331)
Respawned uWSGI worker 2 (new pid: 332)
Respawned uWSGI worker 3 (new pid: 333)
Respawned uWSGI worker 4 (new pid: 334)
Respawned uWSGI worker 6 (new pid: 335)
worker 5 lifetime reached, it was running for 301 second(s)
2022-03-10 06:26:19,878||140243836554568|INFO|component|conductor.common.music.messaging.component: [-] Message 49029b8c-8936-4ddf-ada5-898c1b1c4b55 on topic controller enqueued.
[pid: 327|app: 0|req: 2/2] 10.233.69.208 () {46 vars in 589 bytes} [Thu Mar 10 06:26:11 2022] GET /v1/plans/healthcheck => generated 159 bytes in 56058 msecs (HTTP/1.1 200) 5 headers in 134 bytes (1 switches on core 0)
Respawned uWSGI worker 5 (new pid: 384)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 385)
Respawned uWSGI worker 2 (new pid: 386)
Respawned uWSGI worker 3 (new pid: 387)
Respawned uWSGI worker 4 (new pid: 388)
Respawned uWSGI worker 6 (new pid: 389)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 390)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 391)
Respawned uWSGI worker 2 (new pid: 392)
Respawned uWSGI worker 3 (new pid: 393)
Respawned uWSGI worker 4 (new pid: 394)
Respawned uWSGI worker 6 (new pid: 395)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 396)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 397)
Respawned uWSGI worker 2 (new pid: 398)
Respawned uWSGI worker 3 (new pid: 399)
Respawned uWSGI worker 4 (new pid: 400)
Respawned uWSGI worker 6 (new pid: 401)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 402)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 403)
Respawned uWSGI worker 2 (new pid: 404)
Respawned uWSGI worker 3 (new pid: 405)
Respawned uWSGI worker 4 (new pid: 406)
Respawned uWSGI worker 6 (new pid: 407)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 408)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 409)
Respawned uWSGI worker 2 (new pid: 410)
Respawned uWSGI worker 3 (new pid: 411)
Respawned uWSGI worker 4 (new pid: 412)
Respawned uWSGI worker 6 (new pid: 413)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 414)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 415)
Respawned uWSGI worker 2 (new pid: 416)
Respawned uWSGI worker 3 (new pid: 417)
Respawned uWSGI worker 4 (new pid: 418)
Respawned uWSGI worker 6 (new pid: 419)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 420)
2022-03-10 07:01:00,252||140243836554568|INFO|component|conductor.common.music.messaging.component: [-] Message 0376f0e9-3ded-4144-bb9f-c231454e1316 on topic controller enqueued.
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 4 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 444)
Respawned uWSGI worker 2 (new pid: 445)
Respawned uWSGI worker 3 (new pid: 446)
Respawned uWSGI worker 6 (new pid: 447)
[pid: 418|app: 0|req: 1/3] 10.233.69.90 () {46 vars in 586 bytes} [Thu Mar 10 07:00:50 2022] GET /v1/plans/healthcheck => generated 159 bytes in 54409 msecs (HTTP/1.1 200) 5 headers in 134 bytes (1 switches on core 0)
Respawned uWSGI worker 4 (new pid: 494)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 495)
2022-03-10 07:02:36,153||140243836554568|INFO|component|conductor.common.music.messaging.component: [-] Message 1e0318d9-91a8-496f-80d9-1407f16cb71e on topic controller enqueued.
[pid: 495|app: 0|req: 3/4] 10.233.69.84 () {46 vars in 586 bytes} [Thu Mar 10 07:02:29 2022] GET /v1/plans/healthcheck => generated 159 bytes in 37206 msecs (HTTP/1.1 200) 5 headers in 134 bytes (2 switches on core 0)
2022-03-10 07:04:02,652||140243836554568|INFO|component|conductor.common.music.messaging.component: [-] Message d88691c2-0835-4418-ae20-347675d22287 on topic controller enqueued.
[pid: 444|app: 0|req: 1/5] 10.233.69.15 () {46 vars in 586 bytes} [Thu Mar 10 07:03:57 2022] GET /v1/plans/healthcheck => generated 159 bytes in 60763 msecs (HTTP/1.1 200) 5 headers in 134 bytes (1 switches on core 0)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 3 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 587)
Respawned uWSGI worker 2 (new pid: 588)
Respawned uWSGI worker 6 (new pid: 589)
2022-03-10 07:06:25,151||140243836554568|INFO|component|conductor.common.music.messaging.component: [-] Message 2863d2e3-5284-489c-9512-a9f801471159 on topic controller enqueued.
2022-03-10 07:06:46,238||140243836554568|CRITICAL|log|conductor: [-] Unhandled error
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/pecan/routing.py", line 141, in lookup_controller
obj, remainder = find_object(obj, remainder, notfound_handlers,
File "/usr/local/lib/python3.9/site-packages/pecan/routing.py", line 197, in find_object
raise PecanNotFound
pecan.routing.PecanNotFound
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/webob/dec.py", line 129, in __call__
resp = self.call_func(req, *args, **kw)
File "/usr/local/lib/python3.9/site-packages/webob/dec.py", line 193, in call_func
return self.func(req, *args, **kwargs)
File "/usr/local/lib/python3.9/site-packages/oslo_middleware/base.py", line 124, in __call__
response = req.get_response(self.application)
File "/usr/local/lib/python3.9/site-packages/webob/request.py", line 1313, in send
status, headers, app_iter = self.call_application(
File "/usr/local/lib/python3.9/site-packages/webob/request.py", line 1278, in call_application
app_iter = application(self.environ, start_response)
File "/usr/local/lib/python3.9/site-packages/webob/dec.py", line 129, in __call__
resp = self.call_func(req, *args, **kw)
File "/usr/local/lib/python3.9/site-packages/webob/dec.py", line 193, in call_func
return self.func(req, *args, **kwargs)
File "/usr/local/lib/python3.9/site-packages/oslo_middleware/base.py", line 124, in __call__
response = req.get_response(self.application)
File "/usr/local/lib/python3.9/site-packages/webob/request.py", line 1313, in send
status, headers, app_iter = self.call_application(
File "/usr/local/lib/python3.9/site-packages/webob/request.py", line 1278, in call_application
app_iter = application(self.environ, start_response)
File "/usr/local/lib/python3.9/site-packages/pecan/middleware/recursive.py", line 56, in __call__
return self.application(environ, start_response)
File "/opt/has/conductor/conductor/api/middleware.py", line 130, in __call__
app_iter = self.app(environ, replacement_start_response)
File "/usr/local/lib/python3.9/site-packages/pecan/core.py", line 852, in __call__
return super(Pecan, self).__call__(environ, start_response)
File "/usr/local/lib/python3.9/site-packages/pecan/core.py", line 692, in __call__
controller, args, kwargs = self.find_controller(state)
File "/usr/local/lib/python3.9/site-packages/pecan/core.py", line 870, in find_controller
controller, args, kw = super(Pecan, self).find_controller(_state)
File "/usr/local/lib/python3.9/site-packages/pecan/core.py", line 460, in find_controller
controller, remainder = self.route(req, self.root, path)
File "/usr/local/lib/python3.9/site-packages/pecan/core.py", line 293, in route
node, remainder = lookup_controller(node, path, req)
File "/usr/local/lib/python3.9/site-packages/pecan/routing.py", line 158, in lookup_controller
result = handle_lookup_traversal(obj, remainder)
File "/usr/local/lib/python3.9/site-packages/pecan/routing.py", line 175, in handle_lookup_traversal
result = obj(*args)
File "/opt/has/conductor/conductor/api/controllers/v1/plans.py", line 311, in _lookup
return PlansItemController(uuid4), remainder
File "/opt/has/conductor/conductor/api/controllers/v1/plans.py", line 190, in __init__
self.plan = self.plans_get(plan_id=self.uuid)
File "/opt/has/conductor/conductor/api/controllers/v1/plans.py", line 95, in plans_get
return self.plan_getid(plan_id)
File "/opt/has/conductor/conductor/api/controllers/v1/plans.py", line 110, in plan_getid
result = client.call(ctx, method, args)
File "/opt/has/conductor/conductor/common/music/messaging/component.py", line 211, in call
rpc = fut.result()
File "/usr/local/lib/python3.9/concurrent/futures/_base.py", line 440, in result
return self.__get_result()
File "/usr/local/lib/python3.9/concurrent/futures/_base.py", line 389, in __get_result
raise self._exception
File "/usr/local/lib/python3.9/site-packages/futurist/_utils.py", line 49, in run
result = self.fn(*self.args, **self.kwargs)
File "/opt/has/conductor/conductor/common/music/messaging/component.py", line 152, in __check_rpc_status
rpc = self.RPC.query.one(rpc_id)
File "/opt/has/conductor/conductor/common/music/model/search.py", line 73, in one
rows = db_backend.DB_API.row_read(
File "/opt/has/conductor/conductor/common/etcd/api.py", line 133, in row_read
return {pk_value: self.get_value(key)}
File "/opt/has/conductor/conductor/common/etcd/api.py", line 75, in get_value
raw_value = self.get_raw_value(key)
File "/opt/has/conductor/conductor/common/etcd/api.py", line 72, in get_raw_value
return self.get_client().get(key)[0]
File "/opt/has/conductor/conductor/common/etcd/api.py", line 69, in get_client
raise EtcdClientException("Failed to establish connection with ETCD. GRPC {}".format(rpc_error.code()))
conductor.common.etcd.utils.EtcdClientException: Failed to establish connection with ETCD. GRPC StatusCode.UNAVAILABLE
[pid: 446|app: 0|req: 1/6] 10.233.69.74 () {46 vars in 586 bytes} [Thu Mar 10 07:06:18 2022] GET /v1/plans/healthcheck => generated 0 bytes in 27667 msecs (HTTP/1.1 500) 0 headers in 0 bytes (1 switches on core 0)
Respawned uWSGI worker 3 (new pid: 610)
worker 4 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 4 (new pid: 611)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 612)
2022-03-10 07:07:47,351||140243836554568|INFO|component|conductor.common.music.messaging.component: [-] Message f137f781-01ff-4c60-810e-9f48e06ab850 on topic controller enqueued.
[pid: 612|app: 0|req: 4/7] 10.233.69.79 () {46 vars in 586 bytes} [Thu Mar 10 07:07:37 2022] GET /v1/plans/healthcheck => generated 159 bytes in 58575 msecs (HTTP/1.1 200) 5 headers in 134 bytes (2 switches on core 0)
2022-03-10 07:10:21,984||140243836554568|INFO|component|conductor.common.music.messaging.component: [-] Message 0e98444e-6119-40ef-942b-6a39b9e61221 on topic controller enqueued.
[pid: 610|app: 0|req: 2/8] 10.233.69.219 () {46 vars in 589 bytes} [Thu Mar 10 07:10:16 2022] GET /v1/plans/healthcheck => generated 159 bytes in 62881 msecs (HTTP/1.1 200) 5 headers in 134 bytes (2 switches on core 0)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 710)
Respawned uWSGI worker 2 (new pid: 711)
Respawned uWSGI worker 6 (new pid: 712)
worker 3 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 3 (new pid: 713)
worker 4 lifetime reached, it was running for 302 second(s)
Respawned uWSGI worker 4 (new pid: 714)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 715)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 716)
Respawned uWSGI worker 2 (new pid: 717)
Respawned uWSGI worker 6 (new pid: 718)
worker 3 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 3 (new pid: 719)
worker 4 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 4 (new pid: 720)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 721)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 722)
Respawned uWSGI worker 2 (new pid: 723)
Respawned uWSGI worker 6 (new pid: 724)
worker 3 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 3 (new pid: 725)
worker 4 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 4 (new pid: 726)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 727)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 728)
Respawned uWSGI worker 2 (new pid: 729)
Respawned uWSGI worker 6 (new pid: 730)
worker 3 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 3 (new pid: 731)
worker 4 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 4 (new pid: 732)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 733)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 734)
Respawned uWSGI worker 2 (new pid: 735)
Respawned uWSGI worker 6 (new pid: 736)
worker 3 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 3 (new pid: 737)
worker 4 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 4 (new pid: 738)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 739)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 740)
Respawned uWSGI worker 2 (new pid: 741)
Respawned uWSGI worker 6 (new pid: 742)
worker 3 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 3 (new pid: 743)
worker 4 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 4 (new pid: 744)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 745)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 746)
Respawned uWSGI worker 2 (new pid: 747)
Respawned uWSGI worker 6 (new pid: 748)
worker 3 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 3 (new pid: 749)
worker 4 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 4 (new pid: 750)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 751)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 752)
Respawned uWSGI worker 2 (new pid: 753)
Respawned uWSGI worker 6 (new pid: 754)
worker 3 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 3 (new pid: 755)
worker 4 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 4 (new pid: 756)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 757)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 758)
Respawned uWSGI worker 2 (new pid: 759)
Respawned uWSGI worker 6 (new pid: 760)
worker 3 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 3 (new pid: 761)
worker 4 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 4 (new pid: 762)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 763)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 764)
Respawned uWSGI worker 2 (new pid: 765)
Respawned uWSGI worker 6 (new pid: 766)
worker 3 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 3 (new pid: 767)
worker 4 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 4 (new pid: 768)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 769)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 770)
Respawned uWSGI worker 2 (new pid: 771)
Respawned uWSGI worker 6 (new pid: 772)
worker 3 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 3 (new pid: 773)
worker 4 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 4 (new pid: 774)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 775)
[pid: 773|app: 0|req: 3/9] 10.233.66.14 () {42 vars in 580 bytes} [Thu Mar 10 08:06:28 2022] GET /nmaplowercheck1646899587 => generated 77 bytes in 8 msecs (HTTP/1.1 404) 8 headers in 202 bytes (2 switches on core 0)
[pid: 774|app: 0|req: 2/10] 10.233.66.14 () {42 vars in 542 bytes} [Thu Mar 10 08:06:28 2022] GET /HNAP1 => generated 77 bytes in 10 msecs (HTTP/1.1 404) 8 headers in 202 bytes (1 switches on core 0)
[pid: 773|app: 0|req: 4/11] 10.233.66.14 () {42 vars in 552 bytes} [Thu Mar 10 08:06:28 2022] GET /evox/about => generated 77 bytes in 76 msecs (HTTP/1.1 404) 8 headers in 202 bytes (1 switches on core 0)
[pid: 775|app: 0|req: 5/12] 10.233.66.14 () {44 vars in 568 bytes} [Thu Mar 10 08:06:28 2022] POST /sdk => generated 77 bytes in 10 msecs (HTTP/1.1 404) 8 headers in 202 bytes (2 switches on core 0)
worker 1 lifetime reached, it was running for 301 second(s)
worker 2 lifetime reached, it was running for 301 second(s)
worker 6 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 1 (new pid: 776)
Respawned uWSGI worker 2 (new pid: 777)
Respawned uWSGI worker 6 (new pid: 778)
[pid: 775|app: 0|req: 6/13] 10.233.66.14 () {36 vars in 374 bytes} [Thu Mar 10 08:06:35 2022] GET / => generated 750 bytes in 68 msecs (HTTP/1.0 200) 5 headers in 134 bytes (1 switches on core 0)
[pid: 777|app: 0|req: 1/14] 10.233.66.14 () {38 vars in 404 bytes} [Thu Mar 10 08:06:35 2022] GET / => generated 754 bytes in 11 msecs (HTTP/1.1 200) 5 headers in 134 bytes (2 switches on core 0)
worker 3 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 3 (new pid: 784)
worker 4 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 4 (new pid: 785)
worker 5 lifetime reached, it was running for 301 second(s)
Respawned uWSGI worker 5 (new pid: 786)
invalid request block size: 22340 (max 4096)...skip
[pid: 786|app: 0|req: 7/15] 10.233.66.14 () {42 vars in 580 bytes} [Thu Mar 10 08:09:28 2022] GET /nmaplowercheck1646899768 => generated 77 bytes in 10 msecs (HTTP/1.1 404) 8 headers in 202 bytes (2 switches on core 0)
[pid: 785|app: 0|req: 3/16] 10.233.66.14 () {44 vars in 568 bytes} [Thu Mar 10 08:09:28 2022] POST /sdk => generated 77 bytes in 11 msecs (HTTP/1.1 404) 8 headers in 202 bytes (2 switches on core 0)
[pid: 777|app: 0|req: 2/17] 10.233.66.14 () {42 vars in 552 bytes} [Thu Mar 10 08:09:28 2022] GET /evox/about => generated 77 bytes in 87 msecs (HTTP/1.1 404) 8 headers in 202 bytes (1 switches on core 0)
[pid: 786|app: 0|req: 8/18] 10.233.66.14 () {42 vars in 542 bytes} [Thu Mar 10 08:09:29 2022] GET /HNAP1 => generated 77 bytes in 97 msecs (HTTP/1.1 404) 8 headers in 202 bytes (1 switches on core 0)
[pid: 786|app: 0|req: 9/19] 10.233.66.14 () {36 vars in 374 bytes} [Thu Mar 10 08:09:35 2022] GET / => generated 750 bytes in 2 msecs (HTTP/1.0 200) 5 headers in 134 bytes (2 switches on core 0)
[pid: 786|app: 0|req: 10/20] 10.233.66.14 () {38 vars in 404 bytes} [Thu Mar 10 08:09:35 2022] GET / => generated 754 bytes in 1 msecs (HTTP/1.1 200) 5 headers in 134 bytes (1 switches on core 0)