2022/07/04 03:04:22 Starting Kubernetes Multicloud API 2022/07/04 03:04:22 Error Getting TLS Configuration. Starting without TLS... {"level":"info","msg":"Restoring status subscription notifications","time":"2022-07-04T03:04:32Z"} {"error":"Listing Instances: Did not find any objects with tag: instance","level":"error","msg":"Error reading instance list","time":"2022-07-04T03:04:32Z"} {"error":"Listing Instances: Did not find any objects with tag: instance","level":"error","msg":"Error listing instances","profile-name":"","rb-name":"","rb-version":"","time":"2022-07-04T03:42:35Z"} 10.233.72.83 - - [04/Jul/2022:03:42:35 +0000] "GET /v1/instance HTTP/1.1" 500 63 10.233.71.181 - - [04/Jul/2022:04:31:07 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0 127.0.0.1 - - [04/Jul/2022:04:37:20 +0000] "POST /v1/rb/definition HTTP/1.1" 201 270 127.0.0.1 - - [04/Jul/2022:04:42:47 +0000] "POST /v1/rb/definition HTTP/1.1" 201 278 10.233.71.181 - - [04/Jul/2022:04:51:06 +0000] "GET /v1/connectivity-info/k8sregion-cds HTTP/1.1" 500 74 10.233.71.181 - - [04/Jul/2022:04:51:06 +0000] "POST /v1/connectivity-info HTTP/1.1" 201 7673 10.233.71.181 - - [04/Jul/2022:04:51:06 +0000] "GET /v1/connectivity-info/k8sregion-cds HTTP/1.1" 200 7673 10.233.71.181 - - [04/Jul/2022:04:51:06 +0000] "POST /v1/rb/definition HTTP/1.1" 201 124 10.233.71.181 - - [04/Jul/2022:04:51:06 +0000] "GET /v1/rb/definition/cds-ms-rb-076d766b-6af4-4cb9-ae7c-1fcd5fe9fadc/v1 HTTP/1.1" 200 124 10.233.71.181 - - [04/Jul/2022:04:51:06 +0000] "POST /v1/rb/definition/cds-ms-rb-076d766b-6af4-4cb9-ae7c-1fcd5fe9fadc/v1/content HTTP/1.1" 200 0 10.233.71.181 - - [04/Jul/2022:04:51:06 +0000] "GET /v1/rb/definition/cds-ms-rb-076d766b-6af4-4cb9-ae7c-1fcd5fe9fadc/v1 HTTP/1.1" 200 138 10.233.71.181 - - [04/Jul/2022:04:51:06 +0000] "POST /v1/rb/definition/cds-ms-rb-076d766b-6af4-4cb9-ae7c-1fcd5fe9fadc/v1/profile HTTP/1.1" 201 305 10.233.71.181 - - [04/Jul/2022:04:51:06 +0000] "GET /v1/rb/definition/cds-ms-rb-076d766b-6af4-4cb9-ae7c-1fcd5fe9fadc/v1/profile/cds-ms-prof-b0fbd571-cc28-492f-9adf-068010a943f7 HTTP/1.1" 200 305 10.233.71.181 - - [04/Jul/2022:04:51:06 +0000] "POST /v1/rb/definition/cds-ms-rb-076d766b-6af4-4cb9-ae7c-1fcd5fe9fadc/v1/profile/cds-ms-prof-b0fbd571-cc28-492f-9adf-068010a943f7/content HTTP/1.1" 200 0 2022/07/04 04:51:06 Error reading name cache from Database: Error finding master table: mongo: no documents in result 2022/07/04 04:51:06 Error Reading from DB: Reading cache from DB: Error finding master table: mongo: no documents in result 2022/07/04 04:51:06 Main rss info 2022/07/04 04:51:06 Path: /tmp/helm-tmpl-345531718/manifest-0 2022/07/04 04:51:06 Kind: Service 2022/07/04 04:51:06 Path: /tmp/helm-tmpl-345531718/manifest-1 2022/07/04 04:51:06 Kind: Deployment 2022/07/04 04:51:06 Crd rss info 2022/07/04 04:51:06 Hook info {"level":"info","msg":"Creating Namespace","namespace":"onap-tests","time":"2022-07-04T04:51:06Z"} 2022/07/04 04:51:06 Namespace (onap-tests) created {"filepath":"/tmp/helm-tmpl-345531718/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2022-07-04T04:51:06Z"} {"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"cds-regression-mockserver","time":"2022-07-04T04:51:06Z"} {"filepath":"/tmp/helm-tmpl-345531718/manifest-1","level":"info","msg":"Processing Kubernetes Resource","time":"2022-07-04T04:51:06Z"} 2022/07/04 04:51:06 No plugin for kind Deployment found. Using generic Plugin {"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"info","msg":"Created Kubernetes Resource","resource":"cds-cds-mockserver","time":"2022-07-04T04:51:06Z"} 10.233.71.181 - - [04/Jul/2022:04:51:06 +0000] "POST /v1/instance HTTP/1.1" 201 543 2022/07/04 04:52:26 [Config Cleanup] Instance vigilant_shamir 2022/07/04 04:52:26 [scheduleResources]: START thread 2022/07/04 04:52:31 Stop config thread for vigilant_shamir {"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"warning","msg":"Deleting Resource","resource":"cds-cds-mockserver","time":"2022-07-04T04:52:31Z"} 2022/07/04 04:52:31 No plugin for kind Deployment found. Using generic Plugin 2022/07/04 04:52:31 [scheduleResources]: STOP thread {"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"warning","msg":"Deleting Resource","resource":"cds-regression-mockserver","time":"2022-07-04T04:52:31Z"} 2022/07/04 04:52:31 Deleting service: cds-regression-mockserver {"instance":"vigilant_shamir","level":"info","msg":"[START] status notify thread for ","time":"2022-07-04T04:52:31Z"} {"instance":"vigilant_shamir","level":"info","msg":"[STOP] status notify thread for ","time":"2022-07-04T04:52:36Z"} 2022/07/04 04:52:36 Deleted Obj with ID ObjectID("62c271ba4cb5edf628c9ea08") 2022/07/04 04:52:36 Deleted Obj with ID ObjectID("62c271bab2d165bcbb85743e") 10.233.71.181 - - [04/Jul/2022:04:52:25 +0000] "DELETE /v1/instance/vigilant_shamir HTTP/1.1" 202 0 10.233.71.181 - - [04/Jul/2022:04:52:36 +0000] "GET /v1/connectivity-info/k8sregion-cds HTTP/1.1" 200 7673 2022/07/04 04:52:36 Deleted Obj with ID ObjectID("62c271ba4cb5edf628c9e9ff") 2022/07/04 04:52:36 Deleted Obj with ID ObjectID("62c271b9b2d165bcbb857400") 10.233.71.181 - - [04/Jul/2022:04:52:36 +0000] "DELETE /v1/connectivity-info/k8sregion-cds HTTP/1.1" 204 0 10.233.71.181 - - [04/Jul/2022:04:52:43 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 500 74 10.233.71.181 - - [04/Jul/2022:04:52:43 +0000] "POST /v1/connectivity-info HTTP/1.1" 201 7669 10.233.71.181 - - [04/Jul/2022:04:52:43 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 200 7669 127.0.0.1 - - [04/Jul/2022:04:53:03 +0000] "POST /v1/rb/definition HTTP/1.1" 201 265 127.0.0.1 - - [04/Jul/2022:04:53:03 +0000] "POST /v1/rb/definition/622541ab-77ff-43c3-a66e-115c536218bd/8c4814d8-a2cf-4aca-8248-352688176d23/content HTTP/1.1" 200 0 127.0.0.1 - - [04/Jul/2022:04:53:20 +0000] "POST /v1/rb/definition HTTP/1.1" 201 267 10.233.71.181 - - [04/Jul/2022:04:58:30 +0000] "GET /v1/rb/definition/622541ab-77ff-43c3-a66e-115c536218bd/8c4814d8-a2cf-4aca-8248-352688176d23 HTTP/1.1" 200 270 10.233.71.181 - - [04/Jul/2022:04:58:30 +0000] "GET /v1/rb/definition/622541ab-77ff-43c3-a66e-115c536218bd/8c4814d8-a2cf-4aca-8248-352688176d23/profile/cnftest HTTP/1.1" 404 87 10.233.71.181 - - [04/Jul/2022:04:58:30 +0000] "POST /v1/rb/definition/622541ab-77ff-43c3-a66e-115c536218bd/8c4814d8-a2cf-4aca-8248-352688176d23/profile HTTP/1.1" 201 240 10.233.71.181 - - [04/Jul/2022:04:58:30 +0000] "GET /v1/rb/definition/622541ab-77ff-43c3-a66e-115c536218bd/8c4814d8-a2cf-4aca-8248-352688176d23/profile/cnftest HTTP/1.1" 200 240 10.233.71.181 - - [04/Jul/2022:04:58:30 +0000] "POST /v1/rb/definition/622541ab-77ff-43c3-a66e-115c536218bd/8c4814d8-a2cf-4aca-8248-352688176d23/profile/cnftest/content HTTP/1.1" 200 0 10.233.71.181 - - [04/Jul/2022:04:58:51 +0000] "GET /basicnf-owner/k8sregion/infra_workload?name=basic_cnf-5fd50086-0397-4f7a-899f-1dec9a029e38 HTTP/1.1" 200 114 {"level":"info","msg":"Broker API Response","response":{"template_type":"heat","workload_id":"","workload_status":"GET_COMPLETE","workload_status_reason":{"stacks":[]}},"time":"2022-07-04T04:58:51Z"} {"Body":{},"Payload":{"generic-vnf-id":"96481d1b-1bf1-4f34-954b-5b141b234b25","vf-module-id":"487307d4-de37-4fd9-be0d-c86341eab819","vf-module-model-invariant-id":"622541ab-77ff-43c3-a66e-115c536218bd","vf-module-model-version-id":"6d722f25-d33c-4474-92cb-97db13e29dc5","vf-module-model-customization-id":"8c4814d8-a2cf-4aca-8248-352688176d23","oof_directives":{"attributes":null},"sdnc_directives":{"attributes":[{"attribute_name":"k8s-rb-profile-name","attribute_value":"cnftest"},{"attribute_name":"k8s-rb-profile-namespace","attribute_value":"k8s"},{"attribute_name":"availability_zone_0","attribute_value":"basicnf-availability-zone"},{"attribute_name":"dummy_name_0","attribute_value":"dummy_name"}]},"user_directives":{"attributes":null},"template_type":"","template_data":{"stack_name":"basic_cnf-5fd50086-0397-4f7a-899f-1dec9a029e38"}},"level":"info","msg":"Broker API Payload","time":"2022-07-04T04:58:52Z"} {"level":"info","msg":"Instance API Payload","payload":{"rb-name":"622541ab-77ff-43c3-a66e-115c536218bd","rb-version":"8c4814d8-a2cf-4aca-8248-352688176d23","profile-name":"cnftest","release-name":"487307d4-de37-4fd9-be0d-c86341eab819","cloud-region":"k8sregion","labels":{"stack-name":"basic_cnf-5fd50086-0397-4f7a-899f-1dec9a029e38"},"override-values":{"availability_zone_0":"basicnf-availability-zone","dummy_name_0":"dummy_name","k8s-rb-profile-name":"cnftest","k8s-rb-profile-namespace":"k8s"}},"time":"2022-07-04T04:58:52Z"} 2022/07/04 04:58:52 Main rss info 2022/07/04 04:58:52 Path: /tmp/helm-tmpl-294619805/manifest-0 2022/07/04 04:58:52 Kind: Service 2022/07/04 04:58:52 Path: /tmp/helm-tmpl-294619805/manifest-1 2022/07/04 04:58:52 Kind: Deployment 2022/07/04 04:58:52 Crd rss info 2022/07/04 04:58:52 Hook info {"level":"info","msg":"Creating Namespace","namespace":"k8s","time":"2022-07-04T04:58:52Z"} 2022/07/04 04:58:52 Namespace (k8s) created {"filepath":"/tmp/helm-tmpl-294619805/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2022-07-04T04:58:52Z"} {"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"cnftest-nginx","time":"2022-07-04T04:58:52Z"} {"filepath":"/tmp/helm-tmpl-294619805/manifest-1","level":"info","msg":"Processing Kubernetes Resource","time":"2022-07-04T04:58:52Z"} 2022/07/04 04:58:52 No plugin for kind Deployment found. Using generic Plugin {"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"info","msg":"Created Kubernetes Resource","resource":"cnftest-nginx","time":"2022-07-04T04:58:52Z"} {"level":"info","msg":"Broker API Response","response":{"template_type":"heat","workload_id":"gallant_morse","template_response":[{"GVK":{"Group":"","Version":"v1","Kind":"Service"},"Name":"cnftest-nginx"},{"GVK":{"Group":"apps","Version":"v1","Kind":"Deployment"},"Name":"cnftest-nginx"}],"workload_status":"CREATE_COMPLETE","workload_status_reason":null},"time":"2022-07-04T04:58:52Z"} 10.233.71.181 - - [04/Jul/2022:04:58:52 +0000] "POST /basicnf-owner/k8sregion/infra_workload HTTP/1.1" 201 302 10.233.71.181 - - [04/Jul/2022:04:58:52 +0000] "GET /basicnf-owner/k8sregion/infra_workload/gallant_morse HTTP/1.1" 200 121 {"level":"info","msg":"Broker API Response","response":{"template_type":"heat","workload_id":"gallant_morse","workload_status":"CREATE_COMPLETE","workload_status_reason":null},"time":"2022-07-04T04:58:52Z"} 10.233.71.181 - - [04/Jul/2022:04:58:52 +0000] "POST /basicnf-owner/k8sregion/infra_workload/gallant_morse HTTP/1.1" 405 0 10.233.71.181 - - [04/Jul/2022:04:59:26 +0000] "GET /basicnf-owner/k8sregion/infra_workload/gallant_morse HTTP/1.1" 200 121 {"level":"info","msg":"Broker API Response","response":{"template_type":"heat","workload_id":"gallant_morse","workload_status":"CREATE_COMPLETE","workload_status_reason":null},"time":"2022-07-04T04:59:26Z"} 2022/07/04 04:59:26 [Config Cleanup] Instance gallant_morse 2022/07/04 04:59:26 [scheduleResources]: START thread 2022/07/04 04:59:31 Stop config thread for gallant_morse {"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"warning","msg":"Deleting Resource","resource":"cnftest-nginx","time":"2022-07-04T04:59:31Z"} 2022/07/04 04:59:31 [scheduleResources]: STOP thread 2022/07/04 04:59:31 No plugin for kind Deployment found. Using generic Plugin {"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"warning","msg":"Deleting Resource","resource":"cnftest-nginx","time":"2022-07-04T04:59:31Z"} 2022/07/04 04:59:31 Deleting service: cnftest-nginx {"instance":"gallant_morse","level":"info","msg":"[START] status notify thread for ","time":"2022-07-04T04:59:31Z"} {"instance":"gallant_morse","level":"info","msg":"[STOP] status notify thread for ","time":"2022-07-04T04:59:36Z"} 2022/07/04 04:59:36 Deleted Obj with ID ObjectID("62c2738c4cb5edf628c9ea14") 10.233.71.181 - - [04/Jul/2022:04:59:26 +0000] "DELETE /basicnf-owner/k8sregion/infra_workload/gallant_morse HTTP/1.1" 202 121 2022/07/04 04:59:36 Deleted Obj with ID ObjectID("62c2738bb2d165bcbb8575c4") {"level":"info","msg":"Broker API Response","response":{"template_type":"heat","workload_id":"gallant_morse","workload_status":"DELETE_COMPLETE","workload_status_reason":null},"time":"2022-07-04T04:59:36Z"} 10.233.71.181 - - [04/Jul/2022:04:59:52 +0000] "GET /v1/rb/definition/622541ab-77ff-43c3-a66e-115c536218bd/8c4814d8-a2cf-4aca-8248-352688176d23 HTTP/1.1" 200 270 10.233.71.181 - - [04/Jul/2022:04:59:52 +0000] "GET /v1/rb/definition/622541ab-77ff-43c3-a66e-115c536218bd/8c4814d8-a2cf-4aca-8248-352688176d23/profile/cnftest HTTP/1.1" 200 240 2022/07/04 04:59:52 Deleted Obj with ID ObjectID("62c273764cb5edf628c9ea12") 2022/07/04 04:59:52 Deleted Obj with ID ObjectID("62c273764cb5edf628c9ea13") 2022/07/04 04:59:52 Deleted Obj with ID ObjectID("62c27376b2d165bcbb85759c") 10.233.71.181 - - [04/Jul/2022:04:59:52 +0000] "DELETE /v1/rb/definition/622541ab-77ff-43c3-a66e-115c536218bd/8c4814d8-a2cf-4aca-8248-352688176d23/profile/cnftest HTTP/1.1" 204 0 10.233.71.181 - - [04/Jul/2022:05:00:23 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 200 7669 2022/07/04 05:00:23 Deleted Obj with ID ObjectID("62c2721b4cb5edf628c9ea09") 2022/07/04 05:00:23 Deleted Obj with ID ObjectID("62c2721bb2d165bcbb857498") 10.233.71.181 - - [04/Jul/2022:05:00:23 +0000] "DELETE /v1/connectivity-info/k8sregion HTTP/1.1" 204 0 10.233.71.181 - - [04/Jul/2022:05:12:52 +0000] "GET /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 500 74 10.233.71.181 - - [04/Jul/2022:05:12:52 +0000] "POST /v1/connectivity-info HTTP/1.1" 201 7679 10.233.71.181 - - [04/Jul/2022:05:12:52 +0000] "GET /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 200 7679 10.233.71.181 - - [04/Jul/2022:05:12:52 +0000] "POST /v1/rb/definition HTTP/1.1" 201 125 10.233.71.181 - - [04/Jul/2022:05:12:52 +0000] "GET /v1/rb/definition/pnf-cnf-rb-98528844-6ab5-4872-a02a-e69b91f8bf58/v1 HTTP/1.1" 200 125 10.233.71.181 - - [04/Jul/2022:05:12:52 +0000] "POST /v1/rb/definition/pnf-cnf-rb-98528844-6ab5-4872-a02a-e69b91f8bf58/v1/content HTTP/1.1" 200 0 10.233.71.181 - - [04/Jul/2022:05:12:52 +0000] "GET /v1/rb/definition/pnf-cnf-rb-98528844-6ab5-4872-a02a-e69b91f8bf58/v1 HTTP/1.1" 200 138 10.233.71.181 - - [04/Jul/2022:05:12:53 +0000] "POST /v1/rb/definition/pnf-cnf-rb-98528844-6ab5-4872-a02a-e69b91f8bf58/v1/profile HTTP/1.1" 201 314 10.233.71.181 - - [04/Jul/2022:05:12:53 +0000] "GET /v1/rb/definition/pnf-cnf-rb-98528844-6ab5-4872-a02a-e69b91f8bf58/v1/profile/pnf-cnf-profile-7ffadf22-b6c8-4621-8bf1-244e0f50eb85 HTTP/1.1" 200 314 10.233.71.181 - - [04/Jul/2022:05:12:53 +0000] "POST /v1/rb/definition/pnf-cnf-rb-98528844-6ab5-4872-a02a-e69b91f8bf58/v1/profile/pnf-cnf-profile-7ffadf22-b6c8-4621-8bf1-244e0f50eb85/content HTTP/1.1" 200 0 2022/07/04 05:12:53 Main rss info 2022/07/04 05:12:53 Path: /tmp/helm-tmpl-429304315/manifest-0 2022/07/04 05:12:53 Kind: Service 2022/07/04 05:12:53 Path: /tmp/helm-tmpl-429304315/manifest-1 2022/07/04 05:12:53 Kind: Service 2022/07/04 05:12:53 Path: /tmp/helm-tmpl-429304315/manifest-2 2022/07/04 05:12:53 Kind: Pod 2022/07/04 05:12:53 Path: /tmp/helm-tmpl-429304315/manifest-3 2022/07/04 05:12:53 Kind: Deployment 2022/07/04 05:12:53 Crd rss info 2022/07/04 05:12:53 Hook info {"filepath":"/tmp/helm-tmpl-429304315/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2022-07-04T05:12:53Z"} {"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator-mongo","time":"2022-07-04T05:12:53Z"} {"filepath":"/tmp/helm-tmpl-429304315/manifest-1","level":"info","msg":"Processing Kubernetes Resource","time":"2022-07-04T05:12:53Z"} {"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator","time":"2022-07-04T05:12:53Z"} {"filepath":"/tmp/helm-tmpl-429304315/manifest-2","level":"info","msg":"Processing Kubernetes Resource","time":"2022-07-04T05:12:53Z"} 2022/07/04 05:12:53 No plugin for kind Pod found. Using generic Plugin 2022/07/04 05:12:53 Error converting template to map {"gvk":{"Group":"","Version":"v1","Kind":"Pod"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator","time":"2022-07-04T05:12:53Z"} {"filepath":"/tmp/helm-tmpl-429304315/manifest-3","level":"info","msg":"Processing Kubernetes Resource","time":"2022-07-04T05:12:53Z"} 2022/07/04 05:12:53 No plugin for kind Deployment found. Using generic Plugin {"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator-mongo","time":"2022-07-04T05:12:53Z"} 10.233.71.181 - - [04/Jul/2022:05:12:53 +0000] "POST /v1/instance HTTP/1.1" 201 741 10.233.71.181 - - [04/Jul/2022:05:15:09 +0000] "GET /v1/connectivity-info/k8sregion-cnf-macro HTTP/1.1" 500 74 10.233.71.181 - - [04/Jul/2022:05:15:09 +0000] "POST /v1/connectivity-info HTTP/1.1" 201 7686 10.233.71.181 - - [04/Jul/2022:05:15:09 +0000] "GET /v1/connectivity-info/k8sregion-cnf-macro HTTP/1.1" 200 7686 127.0.0.1 - - [04/Jul/2022:05:15:24 +0000] "POST /v1/rb/definition HTTP/1.1" 201 286 127.0.0.1 - - [04/Jul/2022:05:15:24 +0000] "POST /v1/rb/definition HTTP/1.1" 201 271 127.0.0.1 - - [04/Jul/2022:05:15:24 +0000] "POST /v1/rb/definition/1470e1a7-fea9-44f6-9ffe-28223627f3ae/dee1f884-64ef-4022-993c-e9fbe48c38db/content HTTP/1.1" 200 0 127.0.0.1 - - [04/Jul/2022:05:15:41 +0000] "POST /v1/rb/definition HTTP/1.1" 201 272 10.233.70.192 - - [04/Jul/2022:05:19:40 +0000] "GET /v1/rb/definition/1470e1a7-fea9-44f6-9ffe-28223627f3ae/dee1f884-64ef-4022-993c-e9fbe48c38db HTTP/1.1" 200 277 10.233.70.192 - - [04/Jul/2022:05:19:40 +0000] "GET /v1/rb/definition/1470e1a7-fea9-44f6-9ffe-28223627f3ae/dee1f884-64ef-4022-993c-e9fbe48c38db/profile/node-port-profile HTTP/1.1" 404 87 10.233.70.192 - - [04/Jul/2022:05:19:40 +0000] "POST /v1/rb/definition/1470e1a7-fea9-44f6-9ffe-28223627f3ae/dee1f884-64ef-4022-993c-e9fbe48c38db/profile HTTP/1.1" 201 270 10.233.70.192 - - [04/Jul/2022:05:19:40 +0000] "POST /v1/rb/definition/1470e1a7-fea9-44f6-9ffe-28223627f3ae/dee1f884-64ef-4022-993c-e9fbe48c38db/profile/node-port-profile/content HTTP/1.1" 200 0 10.233.70.192 - - [04/Jul/2022:05:19:54 +0000] "GET /v1/rb/definition/1470e1a7-fea9-44f6-9ffe-28223627f3ae/dee1f884-64ef-4022-993c-e9fbe48c38db HTTP/1.1" 200 277 10.233.70.192 - - [04/Jul/2022:05:19:54 +0000] "GET /v1/rb/definition/1470e1a7-fea9-44f6-9ffe-28223627f3ae/dee1f884-64ef-4022-993c-e9fbe48c38db/config-template/replica-count-template HTTP/1.1" 500 78 2022/07/04 05:19:54 [ConfigiTemplate]: create 1470e1a7-fea9-44f6-9ffe-28223627f3ae 10.233.70.192 - - [04/Jul/2022:05:19:54 +0000] "POST /v1/rb/definition/1470e1a7-fea9-44f6-9ffe-28223627f3ae/dee1f884-64ef-4022-993c-e9fbe48c38db/config-template HTTP/1.1" 201 113 2022/07/04 05:19:54 [ConfigTemplate]: Upload replica-count-template 10.233.70.192 - - [04/Jul/2022:05:19:54 +0000] "POST /v1/rb/definition/1470e1a7-fea9-44f6-9ffe-28223627f3ae/dee1f884-64ef-4022-993c-e9fbe48c38db/config-template/replica-count-template/content HTTP/1.1" 200 0 2022/07/04 05:20:00 Main rss info 2022/07/04 05:20:00 Path: /tmp/helm-tmpl-187760270/manifest-0 2022/07/04 05:20:00 Kind: Service 2022/07/04 05:20:00 Path: /tmp/helm-tmpl-187760270/manifest-1 2022/07/04 05:20:00 Kind: Deployment 2022/07/04 05:20:00 Crd rss info 2022/07/04 05:20:00 Hook info {"filepath":"/tmp/helm-tmpl-187760270/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2022-07-04T05:20:00Z"} {"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"rel-1-apache","time":"2022-07-04T05:20:00Z"} {"filepath":"/tmp/helm-tmpl-187760270/manifest-1","level":"info","msg":"Processing Kubernetes Resource","time":"2022-07-04T05:20:00Z"} 2022/07/04 05:20:00 No plugin for kind Deployment found. Using generic Plugin {"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"info","msg":"Created Kubernetes Resource","resource":"rel-1-apache","time":"2022-07-04T05:20:00Z"} 10.233.72.83 - - [04/Jul/2022:05:20:00 +0000] "POST /v1/instance HTTP/1.1" 201 1282 2022/07/04 05:20:02 Deployment is not ready: onap-tests/rel-1-apache. 0 out of 1 expected pods are ready 10.233.72.83 - - [04/Jul/2022:05:20:02 +0000] "GET /v1/instance/infallible_bell/status HTTP/1.1" 200 14547 {"instance":"infallible_bell","level":"info","msg":"[START] status notify thread for ","time":"2022-07-04T05:20:45Z"} {"instance":"infallible_bell","level":"info","msg":"REFRESH WATCHERS","subscription":"infallible_bell-cnf-adapter","time":"2022-07-04T05:20:50Z"} {"Instance":"infallible_bell","Kind":"Pod","Subscription":"infallible_bell-cnf-adapter","level":"info","msg":"[START] Watcher","time":"2022-07-04T05:20:50Z"} {"Instance":"infallible_bell","Kind":"Service","Subscription":"infallible_bell-cnf-adapter","level":"info","msg":"[START] Watcher","time":"2022-07-04T05:20:50Z"} {"Instance":"infallible_bell","Kind":"Deployment","Subscription":"infallible_bell-cnf-adapter","level":"info","msg":"[START] Watcher","time":"2022-07-04T05:20:50Z"} 10.233.72.83 - - [04/Jul/2022:05:20:45 +0000] "POST /v1/instance/infallible_bell/status/subscription HTTP/1.1" 201 651 {"InstanceId":"infallible_bell","SubscriptionName":"infallible_bell-cnf-adapter","level":"info","msg":"Successfully created Status Subscription","time":"2022-07-04T05:20:50Z"} {"InstanceId":"infallible_bell","SubscriptionName":"infallible_bell-cnf-adapter","level":"info","msg":"[START] status verification thread","time":"2022-07-04T05:20:55Z"} 10.233.70.192 - - [04/Jul/2022:05:21:06 +0000] "GET /v1/instance/infallible_bell/status HTTP/1.1" 200 14702 2022/07/04 05:21:06 [scheduleResources]: START thread 10.233.70.192 - - [04/Jul/2022:05:21:06 +0000] "GET /v1/instance/infallible_bell/config/replica-count-change HTTP/1.1" 500 60 2022/07/04 05:21:11 [Config Create] Instance infallible_bell 2022/07/04 05:21:11 [ConfigTemplate]: Download replica-count-template 2022/07/04 05:21:11 Before Sent to goroutine {1470e1a7-fea9-44f6-9ffe-28223627f3ae dee1f884-64ef-4022-993c-e9fbe48c38db node-port-profile node-port-profile onap-tests 1.19.0 map[] []} 2022/07/04 05:21:11 Message Sent to goroutine {1470e1a7-fea9-44f6-9ffe-28223627f3ae dee1f884-64ef-4022-993c-e9fbe48c38db node-port-profile node-port-profile onap-tests 1.19.0 map[] []} 2022/07/04 05:21:11 [scheduleResources]: POST {1470e1a7-fea9-44f6-9ffe-28223627f3ae dee1f884-64ef-4022-993c-e9fbe48c38db node-port-profile node-port-profile onap-tests 1.19.0 map[] []} [{apps/v1, Kind=Deployment /tmp/helm-tmpl-610036445/manifest-0}] {"filepath":"/tmp/helm-tmpl-610036445/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2022-07-04T05:21:11Z"} 2022/07/04 05:21:11 No plugin for kind Deployment found. Using generic Plugin {"error":"Create object error: deployments.apps \"rel-1-apache\" already exists","filepath":"/tmp/helm-tmpl-610036445/manifest-0","gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"error","msg":"Error Creating Resource","time":"2022-07-04T05:21:11Z"} {"filepath":"/tmp/helm-tmpl-610036445/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2022-07-04T05:21:11Z"} 2022/07/04 05:21:11 No plugin for kind Deployment found. Using generic Plugin {"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"info","msg":"Updated Kubernetes Resource","resource":"rel-1-apache","time":"2022-07-04T05:21:11Z"} 2022/07/04 05:21:11 POST result: [{{apps/v1, Kind=Deployment rel-1-apache} UPDATED}] 10.233.70.192 - - [04/Jul/2022:05:21:11 +0000] "POST /v1/instance/infallible_bell/config HTTP/1.1" 201 267 2022/07/04 05:21:12 Deployment is not ready: onap-tests/rel-1-apache. 1 out of 2 expected pods are ready 10.233.70.192 - - [04/Jul/2022:05:21:12 +0000] "GET /v1/instance/infallible_bell/status HTTP/1.1" 200 19580 2022/07/04 05:21:22 Deployment is not ready: onap-tests/rel-1-apache. 1 out of 2 expected pods are ready 10.233.70.192 - - [04/Jul/2022:05:21:22 +0000] "GET /v1/instance/infallible_bell/status HTTP/1.1" 200 20949 {"Instance":"infallible_bell","Subscription":"infallible_bell-cnf-adapter","level":"info","msg":"CHANGE DETECTED","time":"2022-07-04T05:21:30Z"} {"Kind":"Pod","Name":"rel-1-apache-5b64b8fb59-6pl6l","level":"info","msg":"CREATED","time":"2022-07-04T05:21:30Z"} {"Kind":"Deployment","Name":"rel-1-apache","level":"info","msg":"MODIFIED","time":"2022-07-04T05:21:30Z"} 2022/07/04 05:21:31 Deployment is not ready: onap-tests/rel-1-apache. 1 out of 2 expected pods are ready 10.233.72.83 - - [04/Jul/2022:05:21:30 +0000] "GET /v1/instance/infallible_bell/status HTTP/1.1" 200 21292 2022/07/04 05:21:32 Deployment is not ready: onap-tests/rel-1-apache. 1 out of 2 expected pods are ready 10.233.70.192 - - [04/Jul/2022:05:21:32 +0000] "GET /v1/instance/infallible_bell/status HTTP/1.1" 200 21292 {"InstanceId":"infallible_bell","Result":202,"SubscriptionName":"infallible_bell-cnf-adapter","level":"info","msg":"Notification sent","time":"2022-07-04T05:21:35Z"} 2022/07/04 05:21:42 Deployment is not ready: onap-tests/rel-1-apache. 1 out of 2 expected pods are ready 10.233.70.192 - - [04/Jul/2022:05:21:42 +0000] "GET /v1/instance/infallible_bell/status HTTP/1.1" 200 21292 2022/07/04 05:21:52 Deployment is not ready: onap-tests/rel-1-apache. 1 out of 2 expected pods are ready 10.233.70.192 - - [04/Jul/2022:05:21:52 +0000] "GET /v1/instance/infallible_bell/status HTTP/1.1" 200 21292 10.233.70.192 - - [04/Jul/2022:05:22:02 +0000] "GET /v1/instance/infallible_bell/status HTTP/1.1" 200 21000 {"Instance":"infallible_bell","Subscription":"infallible_bell-cnf-adapter","level":"info","msg":"CHANGE DETECTED","time":"2022-07-04T05:22:05Z"} {"Kind":"Deployment","Name":"rel-1-apache","level":"info","msg":"MODIFIED","time":"2022-07-04T05:22:05Z"} {"Kind":"Pod","Name":"rel-1-apache-5b64b8fb59-6pl6l","level":"info","msg":"MODIFIED","time":"2022-07-04T05:22:05Z"} 10.233.72.83 - - [04/Jul/2022:05:22:05 +0000] "GET /v1/instance/infallible_bell/status HTTP/1.1" 200 21000 {"InstanceId":"infallible_bell","Result":202,"SubscriptionName":"infallible_bell-cnf-adapter","level":"info","msg":"Notification sent","time":"2022-07-04T05:22:10Z"} 2022/07/04 05:22:22 [Config Cleanup] Instance dreamy_nash 2022/07/04 05:22:22 [scheduleResources]: START thread 2022/07/04 05:22:27 Stop config thread for dreamy_nash {"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"warning","msg":"Deleting Resource","resource":"pnf-macro-test-simulator-mongo","time":"2022-07-04T05:22:27Z"} 2022/07/04 05:22:27 No plugin for kind Deployment found. Using generic Plugin 2022/07/04 05:22:27 [scheduleResources]: STOP thread {"gvk":{"Group":"","Version":"v1","Kind":"Pod"},"level":"warning","msg":"Deleting Resource","resource":"pnf-macro-test-simulator","time":"2022-07-04T05:22:27Z"} 2022/07/04 05:22:27 No plugin for kind Pod found. Using generic Plugin {"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"warning","msg":"Deleting Resource","resource":"pnf-macro-test-simulator","time":"2022-07-04T05:22:27Z"} 2022/07/04 05:22:27 Deleting service: pnf-macro-test-simulator {"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"warning","msg":"Deleting Resource","resource":"pnf-macro-test-simulator-mongo","time":"2022-07-04T05:22:27Z"} 2022/07/04 05:22:27 Deleting service: pnf-macro-test-simulator-mongo {"instance":"dreamy_nash","level":"info","msg":"[START] status notify thread for ","time":"2022-07-04T05:22:27Z"} {"instance":"dreamy_nash","level":"info","msg":"[STOP] status notify thread for ","time":"2022-07-04T05:22:32Z"} 2022/07/04 05:22:32 Deleted Obj with ID ObjectID("62c276d54cb5edf628c9ea1d") 10.233.71.181 - - [04/Jul/2022:05:22:22 +0000] "DELETE /v1/instance/dreamy_nash HTTP/1.1" 202 0 2022/07/04 05:22:32 Deleted Obj with ID ObjectID("62c276d4b2d165bcbb857831") 10.233.71.181 - - [04/Jul/2022:05:22:32 +0000] "GET /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 200 7679 2022/07/04 05:22:32 Deleted Obj with ID ObjectID("62c276d44cb5edf628c9ea15") 2022/07/04 05:22:32 Deleted Obj with ID ObjectID("62c276d4b2d165bcbb8577f6") 10.233.71.181 - - [04/Jul/2022:05:22:32 +0000] "DELETE /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 204 0 {"Instance":"infallible_bell","Kind":"Deployment","Subscription":"infallible_bell-cnf-adapter","level":"info","msg":"[STOP] Watcher","time":"2022-07-04T05:22:41Z"} {"Instance":"infallible_bell","Kind":"Pod","Subscription":"infallible_bell-cnf-adapter","level":"info","msg":"[STOP] Watcher","time":"2022-07-04T05:22:41Z"} {"Instance":"infallible_bell","Kind":"Service","Subscription":"infallible_bell-cnf-adapter","level":"info","msg":"[STOP] Watcher","time":"2022-07-04T05:22:41Z"} 2022/07/04 05:22:41 Deleted Obj with ID ObjectID("62c278b24cb5edf628c9ea30") 2022/07/04 05:22:41 Deleted Obj with ID ObjectID("62c278b2b2d165bcbb8579e1") 10.233.72.83 - - [04/Jul/2022:05:22:41 +0000] "DELETE /v1/instance/infallible_bell/status/subscription/infallible_bell-cnf-adapter HTTP/1.1" 202 0 2022/07/04 05:22:41 [Config Cleanup] Instance infallible_bell 2022/07/04 05:22:41 [Config Delete] Instance infallible_bell Config replica-count-change 2022/07/04 05:22:41 [ConfigTemplate]: Download replica-count-template 2022/07/04 05:22:41 Before Sent to goroutine {1470e1a7-fea9-44f6-9ffe-28223627f3ae dee1f884-64ef-4022-993c-e9fbe48c38db node-port-profile node-port-profile onap-tests 1.19.0 map[] []} 2022/07/04 05:22:41 Message Sent to goroutine {1470e1a7-fea9-44f6-9ffe-28223627f3ae dee1f884-64ef-4022-993c-e9fbe48c38db node-port-profile node-port-profile onap-tests 1.19.0 map[] []} 2022/07/04 05:22:41 [scheduleResources]: DELETE {1470e1a7-fea9-44f6-9ffe-28223627f3ae dee1f884-64ef-4022-993c-e9fbe48c38db node-port-profile node-port-profile onap-tests 1.19.0 map[] []} [{{apps/v1, Kind=Deployment rel-1-apache} UPDATED}] {"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"warning","msg":"Deleting Resource","resource":"rel-1-apache","time":"2022-07-04T05:22:41Z"} 2022/07/04 05:22:41 No plugin for kind Deployment found. Using generic Plugin 2022/07/04 05:22:41 DELETE resources: [[{{apps/v1, Kind=Deployment rel-1-apache} UPDATED}]] 2022/07/04 05:22:41 [Config Delete All] Instance infallible_bell Config replica-count-change 2022/07/04 05:22:41 Stop config thread for infallible_bell {"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"warning","msg":"Deleting Resource","resource":"rel-1-apache","time":"2022-07-04T05:22:41Z"} 2022/07/04 05:22:41 No plugin for kind Deployment found. Using generic Plugin 2022/07/04 05:22:41 [scheduleResources]: STOP thread {"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"warning","msg":"Resource already does not exist","resource":"rel-1-apache","time":"2022-07-04T05:22:41Z"} {"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"warning","msg":"Deleting Resource","resource":"rel-1-apache","time":"2022-07-04T05:22:41Z"} 2022/07/04 05:22:41 Deleting service: rel-1-apache {"instance":"infallible_bell","level":"info","msg":"[STOP] status notify thread for ","time":"2022-07-04T05:22:41Z"} 2022/07/04 05:22:41 Deleted Obj with ID ObjectID("62c278804cb5edf628c9ea2f") 2022/07/04 05:22:41 Deleted Obj with ID ObjectID("62c27880b2d165bcbb8579ad") 10.233.72.83 - - [04/Jul/2022:05:22:41 +0000] "DELETE /v1/instance/infallible_bell HTTP/1.1" 202 0 {"instance":"infallible_bell","level":"info","msg":"[START] status notify thread for ","time":"2022-07-04T05:23:10Z"} 10.233.71.181 - - [04/Jul/2022:05:23:14 +0000] "GET /v1/connectivity-info/k8sregion-cnf-macro HTTP/1.1" 200 7686 2022/07/04 05:23:14 Deleted Obj with ID ObjectID("62c2775d4cb5edf628c9ea1e") 2022/07/04 05:23:14 Deleted Obj with ID ObjectID("62c2775cb2d165bcbb857895") 10.233.71.181 - - [04/Jul/2022:05:23:14 +0000] "DELETE /v1/connectivity-info/k8sregion-cnf-macro HTTP/1.1" 204 0 {"InstanceId":"infallible_bell","SubscriptionName":"infallible_bell-cnf-adapter","level":"info","msg":"[STOP] status verification thread","time":"2022-07-04T05:23:15Z"}