2022/05/29 01:40:05 Starting Kubernetes Multicloud API 2022/05/29 01:40:05 Error Getting TLS Configuration. Starting without TLS... {"level":"info","msg":"Restoring status subscription notifications","time":"2022-05-29T01:40:15Z"} {"error":"Listing Instances: Did not find any objects with tag: instance","level":"error","msg":"Error reading instance list","time":"2022-05-29T01:40:15Z"} 10.233.72.27 - - [29/May/2022:02:19:36 +0000] "GET /v1/instance HTTP/1.1" 500 63 {"error":"Listing Instances: Did not find any objects with tag: instance","level":"error","msg":"Error listing instances","profile-name":"","rb-name":"","rb-version":"","time":"2022-05-29T02:19:36Z"} 10.233.71.56 - - [29/May/2022:03:11:24 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0 10.233.71.56 - - [29/May/2022:03:13:16 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0 10.233.71.56 - - [29/May/2022:03:14:40 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0 10.233.71.56 - - [29/May/2022:03:16:58 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0 10.233.71.56 - - [29/May/2022:03:18:21 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0 10.233.71.56 - - [29/May/2022:03:23:40 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0 10.233.71.56 - - [29/May/2022:03:29:40 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0 10.233.71.56 - - [29/May/2022:03:43:42 +0000] "GET /v1/connectivity-info/k8sregion-cds HTTP/1.1" 500 74 10.233.71.56 - - [29/May/2022:03:43:42 +0000] "POST /v1/connectivity-info HTTP/1.1" 201 7665 10.233.71.56 - - [29/May/2022:03:43:42 +0000] "GET /v1/connectivity-info/k8sregion-cds HTTP/1.1" 200 7665 10.233.71.56 - - [29/May/2022:03:43:42 +0000] "POST /v1/rb/definition HTTP/1.1" 201 124 10.233.71.56 - - [29/May/2022:03:43:43 +0000] "GET /v1/rb/definition/cds-ms-rb-02590bb4-6111-4c8c-bfd0-5e8acf5ee120/v1 HTTP/1.1" 200 124 10.233.71.56 - - [29/May/2022:03:43:43 +0000] "POST /v1/rb/definition/cds-ms-rb-02590bb4-6111-4c8c-bfd0-5e8acf5ee120/v1/content HTTP/1.1" 200 0 10.233.71.56 - - [29/May/2022:03:43:43 +0000] "GET /v1/rb/definition/cds-ms-rb-02590bb4-6111-4c8c-bfd0-5e8acf5ee120/v1 HTTP/1.1" 200 138 10.233.71.56 - - [29/May/2022:03:43:43 +0000] "POST /v1/rb/definition/cds-ms-rb-02590bb4-6111-4c8c-bfd0-5e8acf5ee120/v1/profile HTTP/1.1" 201 305 10.233.71.56 - - [29/May/2022:03:43:43 +0000] "GET /v1/rb/definition/cds-ms-rb-02590bb4-6111-4c8c-bfd0-5e8acf5ee120/v1/profile/cds-ms-prof-03a99c28-771b-4995-a470-be3e30d31170 HTTP/1.1" 200 305 10.233.71.56 - - [29/May/2022:03:43:43 +0000] "POST /v1/rb/definition/cds-ms-rb-02590bb4-6111-4c8c-bfd0-5e8acf5ee120/v1/profile/cds-ms-prof-03a99c28-771b-4995-a470-be3e30d31170/content HTTP/1.1" 200 0 2022/05/29 03:43:43 Error reading name cache from Database: Error finding master table: mongo: no documents in result 2022/05/29 03:43:43 Error Reading from DB: Reading cache from DB: Error finding master table: mongo: no documents in result 2022/05/29 03:43:43 Main rss info 2022/05/29 03:43:43 Path: /tmp/helm-tmpl-258641510/manifest-0 2022/05/29 03:43:43 Kind: Service 2022/05/29 03:43:43 Path: /tmp/helm-tmpl-258641510/manifest-1 2022/05/29 03:43:43 Kind: Deployment 2022/05/29 03:43:43 Crd rss info 2022/05/29 03:43:43 Hook info {"level":"info","msg":"Creating Namespace","namespace":"onap-tests","time":"2022-05-29T03:43:43Z"} 2022/05/29 03:43:43 Namespace (onap-tests) created {"filepath":"/tmp/helm-tmpl-258641510/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2022-05-29T03:43:43Z"} {"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"cds-regression-mockserver","time":"2022-05-29T03:43:43Z"} {"filepath":"/tmp/helm-tmpl-258641510/manifest-1","level":"info","msg":"Processing Kubernetes Resource","time":"2022-05-29T03:43:43Z"} 2022/05/29 03:43:43 No plugin for kind Deployment found. Using generic Plugin {"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"info","msg":"Created Kubernetes Resource","resource":"cds-cds-mockserver","time":"2022-05-29T03:43:44Z"} 10.233.71.56 - - [29/May/2022:03:43:43 +0000] "POST /v1/instance HTTP/1.1" 201 543 2022/05/29 03:45:01 [Config Cleanup] Instance laughing_keller 2022/05/29 03:45:01 [scheduleResources]: START thread 2022/05/29 03:45:06 Stop config thread for laughing_keller {"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"warning","msg":"Deleting Resource","resource":"cds-cds-mockserver","time":"2022-05-29T03:45:06Z"} 2022/05/29 03:45:06 [scheduleResources]: STOP thread 2022/05/29 03:45:06 No plugin for kind Deployment found. Using generic Plugin {"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"warning","msg":"Deleting Resource","resource":"cds-regression-mockserver","time":"2022-05-29T03:45:06Z"} 2022/05/29 03:45:06 Deleting service: cds-regression-mockserver {"instance":"laughing_keller","level":"info","msg":"[START] status notify thread for ","time":"2022-05-29T03:45:06Z"} {"instance":"laughing_keller","level":"info","msg":"[STOP] status notify thread for ","time":"2022-05-29T03:45:11Z"} 2022/05/29 03:45:11 Deleted Obj with ID ObjectID("6292ebefc0f65a0285ee3820") 10.233.71.56 - - [29/May/2022:03:45:01 +0000] "DELETE /v1/instance/laughing_keller HTTP/1.1" 202 0 2022/05/29 03:45:11 Deleted Obj with ID ObjectID("6292ebefbd53ffd3cd976c20") 10.233.71.56 - - [29/May/2022:03:45:11 +0000] "GET /v1/connectivity-info/k8sregion-cds HTTP/1.1" 200 7665 2022/05/29 03:45:11 Deleted Obj with ID ObjectID("6292ebeec0f65a0285ee3817") 10.233.71.56 - - [29/May/2022:03:45:11 +0000] "DELETE /v1/connectivity-info/k8sregion-cds HTTP/1.1" 204 0 2022/05/29 03:45:11 Deleted Obj with ID ObjectID("6292ebeebd53ffd3cd976be2") 10.233.71.56 - - [29/May/2022:03:49:47 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 500 74 10.233.71.56 - - [29/May/2022:03:49:47 +0000] "POST /v1/connectivity-info HTTP/1.1" 201 7661 10.233.71.56 - - [29/May/2022:03:49:47 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 200 7661 10.233.71.56 - - [29/May/2022:04:15:44 +0000] "GET /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 500 74 10.233.71.56 - - [29/May/2022:04:15:44 +0000] "POST /v1/connectivity-info HTTP/1.1" 201 7671 10.233.71.56 - - [29/May/2022:04:15:44 +0000] "GET /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 200 7671 10.233.71.56 - - [29/May/2022:04:15:45 +0000] "POST /v1/rb/definition HTTP/1.1" 201 125 10.233.71.56 - - [29/May/2022:04:15:45 +0000] "GET /v1/rb/definition/pnf-cnf-rb-c321f859-e8ce-434e-a32e-7b9b26d84102/v1 HTTP/1.1" 200 125 10.233.71.56 - - [29/May/2022:04:15:45 +0000] "POST /v1/rb/definition/pnf-cnf-rb-c321f859-e8ce-434e-a32e-7b9b26d84102/v1/content HTTP/1.1" 200 0 10.233.71.56 - - [29/May/2022:04:15:45 +0000] "GET /v1/rb/definition/pnf-cnf-rb-c321f859-e8ce-434e-a32e-7b9b26d84102/v1 HTTP/1.1" 200 138 10.233.71.56 - - [29/May/2022:04:15:45 +0000] "POST /v1/rb/definition/pnf-cnf-rb-c321f859-e8ce-434e-a32e-7b9b26d84102/v1/profile HTTP/1.1" 201 314 10.233.71.56 - - [29/May/2022:04:15:45 +0000] "GET /v1/rb/definition/pnf-cnf-rb-c321f859-e8ce-434e-a32e-7b9b26d84102/v1/profile/pnf-cnf-profile-611eddc9-e1f5-4f5b-a7c8-84ab893d2c8f HTTP/1.1" 200 314 10.233.71.56 - - [29/May/2022:04:15:45 +0000] "POST /v1/rb/definition/pnf-cnf-rb-c321f859-e8ce-434e-a32e-7b9b26d84102/v1/profile/pnf-cnf-profile-611eddc9-e1f5-4f5b-a7c8-84ab893d2c8f/content HTTP/1.1" 200 0 2022/05/29 04:15:45 Main rss info 2022/05/29 04:15:45 Path: /tmp/helm-tmpl-244648697/manifest-0 2022/05/29 04:15:45 Kind: Service 2022/05/29 04:15:45 Path: /tmp/helm-tmpl-244648697/manifest-1 2022/05/29 04:15:45 Kind: Service 2022/05/29 04:15:45 Path: /tmp/helm-tmpl-244648697/manifest-2 2022/05/29 04:15:45 Kind: Pod 2022/05/29 04:15:45 Path: /tmp/helm-tmpl-244648697/manifest-3 2022/05/29 04:15:45 Kind: Deployment 2022/05/29 04:15:45 Crd rss info 2022/05/29 04:15:45 Hook info {"filepath":"/tmp/helm-tmpl-244648697/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2022-05-29T04:15:45Z"} {"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator-mongo","time":"2022-05-29T04:15:45Z"} {"filepath":"/tmp/helm-tmpl-244648697/manifest-1","level":"info","msg":"Processing Kubernetes Resource","time":"2022-05-29T04:15:45Z"} {"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator","time":"2022-05-29T04:15:45Z"} {"filepath":"/tmp/helm-tmpl-244648697/manifest-2","level":"info","msg":"Processing Kubernetes Resource","time":"2022-05-29T04:15:45Z"} 2022/05/29 04:15:45 No plugin for kind Pod found. Using generic Plugin 2022/05/29 04:15:45 Error converting template to map {"gvk":{"Group":"","Version":"v1","Kind":"Pod"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator","time":"2022-05-29T04:15:46Z"} {"filepath":"/tmp/helm-tmpl-244648697/manifest-3","level":"info","msg":"Processing Kubernetes Resource","time":"2022-05-29T04:15:46Z"} 2022/05/29 04:15:46 No plugin for kind Deployment found. Using generic Plugin {"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator-mongo","time":"2022-05-29T04:15:46Z"} 10.233.71.56 - - [29/May/2022:04:15:45 +0000] "POST /v1/instance HTTP/1.1" 201 746 10.233.71.56 - - [29/May/2022:04:22:35 +0000] "GET /v1/connectivity-info/k8sregion-cnf-macro HTTP/1.1" 500 74 10.233.71.56 - - [29/May/2022:04:22:35 +0000] "POST /v1/connectivity-info HTTP/1.1" 201 7678 10.233.71.56 - - [29/May/2022:04:22:35 +0000] "GET /v1/connectivity-info/k8sregion-cnf-macro HTTP/1.1" 200 7678 2022/05/29 04:30:18 [Config Cleanup] Instance blissful_khayyam 2022/05/29 04:30:18 [scheduleResources]: START thread 2022/05/29 04:30:23 Stop config thread for blissful_khayyam 2022/05/29 04:30:23 [scheduleResources]: STOP thread {"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"warning","msg":"Deleting Resource","resource":"pnf-macro-test-simulator-mongo","time":"2022-05-29T04:30:23Z"} 2022/05/29 04:30:23 No plugin for kind Deployment found. Using generic Plugin {"gvk":{"Group":"","Version":"v1","Kind":"Pod"},"level":"warning","msg":"Deleting Resource","resource":"pnf-macro-test-simulator","time":"2022-05-29T04:30:23Z"} 2022/05/29 04:30:23 No plugin for kind Pod found. Using generic Plugin {"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"warning","msg":"Deleting Resource","resource":"pnf-macro-test-simulator","time":"2022-05-29T04:30:23Z"} 2022/05/29 04:30:23 Deleting service: pnf-macro-test-simulator {"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"warning","msg":"Deleting Resource","resource":"pnf-macro-test-simulator-mongo","time":"2022-05-29T04:30:23Z"} 2022/05/29 04:30:23 Deleting service: pnf-macro-test-simulator-mongo {"instance":"blissful_khayyam","level":"info","msg":"[START] status notify thread for ","time":"2022-05-29T04:30:23Z"} {"instance":"blissful_khayyam","level":"info","msg":"[STOP] status notify thread for ","time":"2022-05-29T04:30:28Z"} 2022/05/29 04:30:28 Deleted Obj with ID ObjectID("6292f371c0f65a0285ee382a") 2022/05/29 04:30:28 Deleted Obj with ID ObjectID("6292f371bd53ffd3cd977121") 10.233.71.56 - - [29/May/2022:04:30:18 +0000] "DELETE /v1/instance/blissful_khayyam HTTP/1.1" 202 0 10.233.71.56 - - [29/May/2022:04:30:28 +0000] "GET /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 200 7671 2022/05/29 04:30:28 Deleted Obj with ID ObjectID("6292f370c0f65a0285ee3822") 2022/05/29 04:30:28 Deleted Obj with ID ObjectID("6292f370bd53ffd3cd9770e6") 10.233.71.56 - - [29/May/2022:04:30:28 +0000] "DELETE /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 204 0 10.233.71.56 - - [29/May/2022:04:35:55 +0000] "GET /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 500 74 10.233.71.56 - - [29/May/2022:04:35:55 +0000] "POST /v1/connectivity-info HTTP/1.1" 201 7671 10.233.71.56 - - [29/May/2022:04:35:55 +0000] "GET /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 200 7671 10.233.71.56 - - [29/May/2022:04:35:55 +0000] "POST /v1/rb/definition HTTP/1.1" 201 125 10.233.71.56 - - [29/May/2022:04:35:55 +0000] "GET /v1/rb/definition/pnf-cnf-rb-597fcb2c-c728-4a67-b556-da1756cb6575/v1 HTTP/1.1" 200 125 10.233.71.56 - - [29/May/2022:04:35:55 +0000] "POST /v1/rb/definition/pnf-cnf-rb-597fcb2c-c728-4a67-b556-da1756cb6575/v1/content HTTP/1.1" 200 0 10.233.71.56 - - [29/May/2022:04:35:55 +0000] "GET /v1/rb/definition/pnf-cnf-rb-597fcb2c-c728-4a67-b556-da1756cb6575/v1 HTTP/1.1" 200 138 10.233.71.56 - - [29/May/2022:04:35:55 +0000] "POST /v1/rb/definition/pnf-cnf-rb-597fcb2c-c728-4a67-b556-da1756cb6575/v1/profile HTTP/1.1" 201 314 10.233.71.56 - - [29/May/2022:04:35:55 +0000] "GET /v1/rb/definition/pnf-cnf-rb-597fcb2c-c728-4a67-b556-da1756cb6575/v1/profile/pnf-cnf-profile-9dedcd82-35ab-4093-9f26-a433da539bda HTTP/1.1" 200 314 10.233.71.56 - - [29/May/2022:04:35:55 +0000] "POST /v1/rb/definition/pnf-cnf-rb-597fcb2c-c728-4a67-b556-da1756cb6575/v1/profile/pnf-cnf-profile-9dedcd82-35ab-4093-9f26-a433da539bda/content HTTP/1.1" 200 0 2022/05/29 04:35:55 Main rss info 2022/05/29 04:35:55 Path: /tmp/helm-tmpl-996089613/manifest-0 2022/05/29 04:35:55 Kind: Service 2022/05/29 04:35:55 Path: /tmp/helm-tmpl-996089613/manifest-1 2022/05/29 04:35:55 Kind: Service 2022/05/29 04:35:55 Path: /tmp/helm-tmpl-996089613/manifest-2 2022/05/29 04:35:55 Kind: Pod 2022/05/29 04:35:55 Path: /tmp/helm-tmpl-996089613/manifest-3 2022/05/29 04:35:55 Kind: Deployment 2022/05/29 04:35:55 Crd rss info 2022/05/29 04:35:55 Hook info {"filepath":"/tmp/helm-tmpl-996089613/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2022-05-29T04:35:55Z"} {"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator-mongo","time":"2022-05-29T04:35:55Z"} {"filepath":"/tmp/helm-tmpl-996089613/manifest-1","level":"info","msg":"Processing Kubernetes Resource","time":"2022-05-29T04:35:55Z"} {"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator","time":"2022-05-29T04:35:55Z"} {"filepath":"/tmp/helm-tmpl-996089613/manifest-2","level":"info","msg":"Processing Kubernetes Resource","time":"2022-05-29T04:35:55Z"} 2022/05/29 04:35:55 No plugin for kind Pod found. Using generic Plugin 2022/05/29 04:35:55 Error converting template to map {"gvk":{"Group":"","Version":"v1","Kind":"Pod"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator","time":"2022-05-29T04:35:55Z"} {"filepath":"/tmp/helm-tmpl-996089613/manifest-3","level":"info","msg":"Processing Kubernetes Resource","time":"2022-05-29T04:35:55Z"} 2022/05/29 04:35:55 No plugin for kind Deployment found. Using generic Plugin {"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator-mongo","time":"2022-05-29T04:35:55Z"} 10.233.71.56 - - [29/May/2022:04:35:55 +0000] "POST /v1/instance HTTP/1.1" 201 744 2022/05/29 04:48:22 [Config Cleanup] Instance hardcore_haibt 2022/05/29 04:48:22 [scheduleResources]: START thread 2022/05/29 04:48:27 Stop config thread for hardcore_haibt 2022/05/29 04:48:27 [scheduleResources]: STOP thread {"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"warning","msg":"Deleting Resource","resource":"pnf-macro-test-simulator-mongo","time":"2022-05-29T04:48:27Z"} 2022/05/29 04:48:27 No plugin for kind Deployment found. Using generic Plugin {"gvk":{"Group":"","Version":"v1","Kind":"Pod"},"level":"warning","msg":"Deleting Resource","resource":"pnf-macro-test-simulator","time":"2022-05-29T04:48:27Z"} 2022/05/29 04:48:27 No plugin for kind Pod found. Using generic Plugin {"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"warning","msg":"Deleting Resource","resource":"pnf-macro-test-simulator","time":"2022-05-29T04:48:27Z"} 2022/05/29 04:48:27 Deleting service: pnf-macro-test-simulator {"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"warning","msg":"Deleting Resource","resource":"pnf-macro-test-simulator-mongo","time":"2022-05-29T04:48:27Z"} 2022/05/29 04:48:27 Deleting service: pnf-macro-test-simulator-mongo {"instance":"hardcore_haibt","level":"info","msg":"[START] status notify thread for ","time":"2022-05-29T04:48:27Z"} {"instance":"hardcore_haibt","level":"info","msg":"[STOP] status notify thread for ","time":"2022-05-29T04:48:32Z"} 2022/05/29 04:48:32 Deleted Obj with ID ObjectID("6292f82bc0f65a0285ee3834") 2022/05/29 04:48:32 Deleted Obj with ID ObjectID("6292f82bbd53ffd3cd97746a") 10.233.71.56 - - [29/May/2022:04:48:22 +0000] "DELETE /v1/instance/hardcore_haibt HTTP/1.1" 202 0 10.233.71.56 - - [29/May/2022:04:48:32 +0000] "GET /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 200 7671 2022/05/29 04:48:32 Deleted Obj with ID ObjectID("6292f82bc0f65a0285ee382c") 2022/05/29 04:48:32 Deleted Obj with ID ObjectID("6292f82bbd53ffd3cd97742f") 10.233.71.56 - - [29/May/2022:04:48:32 +0000] "DELETE /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 204 0