2022/03/26 02:41:32 Starting Kubernetes Multicloud API
2022/03/26 02:41:32 Error Getting TLS Configuration. Starting without TLS...
10.233.67.50 - - [26/Mar/2022:03:42:30 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0
10.233.67.50 - - [26/Mar/2022:03:43:09 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0
127.0.0.1 - - [26/Mar/2022:03:45:49 +0000] "POST /v1/rb/definition HTTP/1.1" 201 278
10.233.67.50 - - [26/Mar/2022:03:45:57 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0
127.0.0.1 - - [26/Mar/2022:03:47:36 +0000] "POST /v1/rb/definition HTTP/1.1" 201 270
127.0.0.1 - - [26/Mar/2022:03:51:08 +0000] "POST /v1/rb/definition HTTP/1.1" 201 270
10.233.67.50 - - [26/Mar/2022:03:59:07 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 500 74
10.233.67.50 - - [26/Mar/2022:03:59:07 +0000] "POST /v1/connectivity-info HTTP/1.1" 201 7661
10.233.67.50 - - [26/Mar/2022:03:59:07 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 200 7661
10.233.67.50 - - [26/Mar/2022:03:59:07 +0000] "POST /v1/rb/definition HTTP/1.1" 201 125
10.233.67.50 - - [26/Mar/2022:03:59:07 +0000] "GET /v1/rb/definition/pnf-cnf-rb-680cfb4f-e9f9-4339-b938-f9dd0e8f047e/v1 HTTP/1.1" 200 125
10.233.67.50 - - [26/Mar/2022:03:59:07 +0000] "POST /v1/rb/definition/pnf-cnf-rb-680cfb4f-e9f9-4339-b938-f9dd0e8f047e/v1/content HTTP/1.1" 200 0
10.233.67.50 - - [26/Mar/2022:03:59:07 +0000] "GET /v1/rb/definition/pnf-cnf-rb-680cfb4f-e9f9-4339-b938-f9dd0e8f047e/v1 HTTP/1.1" 200 138
10.233.67.50 - - [26/Mar/2022:03:59:07 +0000] "POST /v1/rb/definition/pnf-cnf-rb-680cfb4f-e9f9-4339-b938-f9dd0e8f047e/v1/profile HTTP/1.1" 201 308
10.233.67.50 - - [26/Mar/2022:03:59:07 +0000] "GET /v1/rb/definition/pnf-cnf-rb-680cfb4f-e9f9-4339-b938-f9dd0e8f047e/v1/profile/pnf-cnf-profile-31e4b5a9-93e0-4d22-91d8-cf157c5827f6 HTTP/1.1" 200 308
10.233.67.50 - - [26/Mar/2022:03:59:07 +0000] "POST /v1/rb/definition/pnf-cnf-rb-680cfb4f-e9f9-4339-b938-f9dd0e8f047e/v1/profile/pnf-cnf-profile-31e4b5a9-93e0-4d22-91d8-cf157c5827f6/content HTTP/1.1" 200 0
2022/03/26 03:59:07 Error reading name cache from Database:  Error finding master table: mongo: no documents in result
2022/03/26 03:59:07 Error Reading from DB:  Reading cache from DB: Error finding master table: mongo: no documents in result
2022/03/26 03:59:07 Main rss info
2022/03/26 03:59:07   Path: /tmp/helm-tmpl-899678006/manifest-0
2022/03/26 03:59:07     Kind: Service
2022/03/26 03:59:07   Path: /tmp/helm-tmpl-899678006/manifest-1
2022/03/26 03:59:07     Kind: Service
2022/03/26 03:59:07   Path: /tmp/helm-tmpl-899678006/manifest-2
2022/03/26 03:59:07     Kind: Pod
2022/03/26 03:59:07   Path: /tmp/helm-tmpl-899678006/manifest-3
2022/03/26 03:59:07     Kind: Deployment
2022/03/26 03:59:07 Crd rss info
2022/03/26 03:59:07 Hook info
{"filepath":"/tmp/helm-tmpl-899678006/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2022-03-26T03:59:07Z"}
{"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator-mongo","time":"2022-03-26T03:59:07Z"}
{"filepath":"/tmp/helm-tmpl-899678006/manifest-1","level":"info","msg":"Processing Kubernetes Resource","time":"2022-03-26T03:59:07Z"}
{"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator","time":"2022-03-26T03:59:07Z"}
{"filepath":"/tmp/helm-tmpl-899678006/manifest-2","level":"info","msg":"Processing Kubernetes Resource","time":"2022-03-26T03:59:07Z"}
2022/03/26 03:59:07 No plugin for kind Pod found. Using generic Plugin
2022/03/26 03:59:07 Error converting template to map
{"gvk":{"Group":"","Version":"v1","Kind":"Pod"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator","time":"2022-03-26T03:59:07Z"}
{"filepath":"/tmp/helm-tmpl-899678006/manifest-3","level":"info","msg":"Processing Kubernetes Resource","time":"2022-03-26T03:59:07Z"}
2022/03/26 03:59:07 No plugin for kind Deployment found. Using generic Plugin
{"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator-mongo","time":"2022-03-26T03:59:07Z"}
10.233.67.50 - - [26/Mar/2022:03:59:07 +0000] "POST /v1/instance HTTP/1.1" 201 731
127.0.0.1 - - [26/Mar/2022:04:01:50 +0000] "POST /v1/rb/definition HTTP/1.1" 201 267
10.233.67.50 - - [26/Mar/2022:04:01:57 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 200 7661
127.0.0.1 - - [26/Mar/2022:04:02:13 +0000] "POST /v1/rb/definition HTTP/1.1" 201 265
127.0.0.1 - - [26/Mar/2022:04:02:13 +0000] "POST /v1/rb/definition/9e97a9e7-0e75-437c-8a7a-ec4e8ee0e8c0/bdb05b25-a8a9-4c91-be05-4c73e7f3cbdb/content HTTP/1.1" 200 0
127.0.0.1 - - [26/Mar/2022:04:02:30 +0000] "POST /v1/rb/definition HTTP/1.1" 201 270
127.0.0.1 - - [26/Mar/2022:04:02:44 +0000] "POST /v1/rb/definition HTTP/1.1" 201 272
10.233.67.50 - - [26/Mar/2022:04:09:32 +0000] "GET /v1/rb/definition/9e97a9e7-0e75-437c-8a7a-ec4e8ee0e8c0/bdb05b25-a8a9-4c91-be05-4c73e7f3cbdb HTTP/1.1" 200 270
10.233.67.50 - - [26/Mar/2022:04:09:32 +0000] "GET /v1/rb/definition/9e97a9e7-0e75-437c-8a7a-ec4e8ee0e8c0/bdb05b25-a8a9-4c91-be05-4c73e7f3cbdb/profile/cnftest HTTP/1.1" 404 87
10.233.67.50 - - [26/Mar/2022:04:09:32 +0000] "POST /v1/rb/definition/9e97a9e7-0e75-437c-8a7a-ec4e8ee0e8c0/bdb05b25-a8a9-4c91-be05-4c73e7f3cbdb/profile HTTP/1.1" 201 240
10.233.67.50 - - [26/Mar/2022:04:09:32 +0000] "GET /v1/rb/definition/9e97a9e7-0e75-437c-8a7a-ec4e8ee0e8c0/bdb05b25-a8a9-4c91-be05-4c73e7f3cbdb/profile/cnftest HTTP/1.1" 200 240
10.233.67.50 - - [26/Mar/2022:04:09:32 +0000] "POST /v1/rb/definition/9e97a9e7-0e75-437c-8a7a-ec4e8ee0e8c0/bdb05b25-a8a9-4c91-be05-4c73e7f3cbdb/profile/cnftest/content HTTP/1.1" 200 0
{"level":"info","msg":"Broker API Response","response":{"template_type":"heat","workload_id":"","workload_status":"GET_COMPLETE","workload_status_reason":{"stacks":[]}},"time":"2022-03-26T04:09:48Z"}
10.233.67.50 - - [26/Mar/2022:04:09:48 +0000] "GET /basicnf-owner/k8sregion/infra_workload?name=basic_cnf-c11e11f2-ea2c-4b34-b9a6-9ca644d282da HTTP/1.1" 200 114
{"Body":{},"Payload":{"generic-vnf-id":"36a898b5-31f8-4562-803b-0ac6ddb32ffc","vf-module-id":"6bc66147-ead5-467a-b7e6-d31b7737d477","vf-module-model-invariant-id":"9e97a9e7-0e75-437c-8a7a-ec4e8ee0e8c0","vf-module-model-version-id":"9d1e15ab-3f79-4729-86da-27f28b032618","vf-module-model-customization-id":"bdb05b25-a8a9-4c91-be05-4c73e7f3cbdb","oof_directives":{"attributes":null},"sdnc_directives":{"attributes":[{"attribute_name":"k8s-rb-profile-name","attribute_value":"cnftest"},{"attribute_name":"k8s-rb-profile-namespace","attribute_value":"k8s"},{"attribute_name":"availability_zone_0","attribute_value":"basicnf-availability-zone"},{"attribute_name":"dummy_name_0","attribute_value":"dummy_name"}]},"user_directives":{"attributes":null},"template_type":"","template_data":{"stack_name":"basic_cnf-c11e11f2-ea2c-4b34-b9a6-9ca644d282da"}},"level":"info","msg":"Broker API Payload","time":"2022-03-26T04:09:48Z"}
{"level":"info","msg":"Instance API Payload","payload":{"rb-name":"9e97a9e7-0e75-437c-8a7a-ec4e8ee0e8c0","rb-version":"bdb05b25-a8a9-4c91-be05-4c73e7f3cbdb","profile-name":"cnftest","release-name":"6bc66147-ead5-467a-b7e6-d31b7737d477","cloud-region":"k8sregion","labels":{"stack-name":"basic_cnf-c11e11f2-ea2c-4b34-b9a6-9ca644d282da"},"override-values":{"availability_zone_0":"basicnf-availability-zone","dummy_name_0":"dummy_name","k8s-rb-profile-name":"cnftest","k8s-rb-profile-namespace":"k8s"}},"time":"2022-03-26T04:09:48Z"}
2022/03/26 04:09:48 Main rss info
2022/03/26 04:09:48   Path: /tmp/helm-tmpl-251790162/manifest-0
2022/03/26 04:09:48     Kind: Service
2022/03/26 04:09:48   Path: /tmp/helm-tmpl-251790162/manifest-1
2022/03/26 04:09:48     Kind: Deployment
2022/03/26 04:09:48 Crd rss info
2022/03/26 04:09:48 Hook info
{"level":"info","msg":"Creating Namespace","namespace":"k8s","time":"2022-03-26T04:09:48Z"}
2022/03/26 04:09:48 Namespace (k8s) created
{"filepath":"/tmp/helm-tmpl-251790162/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2022-03-26T04:09:48Z"}
{"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"cnftest-nginx","time":"2022-03-26T04:09:48Z"}
{"filepath":"/tmp/helm-tmpl-251790162/manifest-1","level":"info","msg":"Processing Kubernetes Resource","time":"2022-03-26T04:09:48Z"}
2022/03/26 04:09:48 No plugin for kind Deployment found. Using generic Plugin
{"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"info","msg":"Created Kubernetes Resource","resource":"cnftest-nginx","time":"2022-03-26T04:09:48Z"}
{"level":"info","msg":"Broker API Response","response":{"template_type":"heat","workload_id":"affectionate_merkle","template_response":[{"GVK":{"Group":"","Version":"v1","Kind":"Service"},"Name":"cnftest-nginx"},{"GVK":{"Group":"apps","Version":"v1","Kind":"Deployment"},"Name":"cnftest-nginx"}],"workload_status":"CREATE_COMPLETE","workload_status_reason":null},"time":"2022-03-26T04:09:48Z"}
10.233.67.50 - - [26/Mar/2022:04:09:48 +0000] "POST /basicnf-owner/k8sregion/infra_workload HTTP/1.1" 201 308
10.233.67.50 - - [26/Mar/2022:04:09:49 +0000] "GET /basicnf-owner/k8sregion/infra_workload/affectionate_merkle HTTP/1.1" 200 127
{"level":"info","msg":"Broker API Response","response":{"template_type":"heat","workload_id":"affectionate_merkle","workload_status":"CREATE_COMPLETE","workload_status_reason":null},"time":"2022-03-26T04:09:49Z"}
10.233.67.50 - - [26/Mar/2022:04:09:49 +0000] "POST /basicnf-owner/k8sregion/infra_workload/affectionate_merkle HTTP/1.1" 405 0
{"level":"info","msg":"Broker API Response","response":{"template_type":"heat","workload_id":"affectionate_merkle","workload_status":"CREATE_COMPLETE","workload_status_reason":null},"time":"2022-03-26T04:10:51Z"}
10.233.67.50 - - [26/Mar/2022:04:10:51 +0000] "GET /basicnf-owner/k8sregion/infra_workload/affectionate_merkle HTTP/1.1" 200 127
2022/03/26 04:10:51 [Config Cleanup] Instance affectionate_merkle
2022/03/26 04:10:51 [scheduleResources]: START thread
2022/03/26 04:10:56 Stop config thread for affectionate_merkle
{"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"warning","msg":"Deleting Resource","resource":"cnftest-nginx","time":"2022-03-26T04:10:56Z"}
2022/03/26 04:10:56 No plugin for kind Deployment found. Using generic Plugin
2022/03/26 04:10:56 [scheduleResources]: STOP thread
{"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"warning","msg":"Deleting Resource","resource":"cnftest-nginx","time":"2022-03-26T04:10:56Z"}
2022/03/26 04:10:56 Deleting service: cnftest-nginx
10.233.67.50 - - [26/Mar/2022:04:10:51 +0000] "DELETE /basicnf-owner/k8sregion/infra_workload/affectionate_merkle HTTP/1.1" 202 127
2022/03/26 04:10:56 Deleted Obj with ID ObjectID("623e920c80515ae1ce6b2a76")
2022/03/26 04:10:56 Deleted Obj with ID ObjectID("623e920c3cebde3699b598c5")
{"level":"info","msg":"Broker API Response","response":{"template_type":"heat","workload_id":"affectionate_merkle","workload_status":"DELETE_COMPLETE","workload_status_reason":null},"time":"2022-03-26T04:10:56Z"}
10.233.67.50 - - [26/Mar/2022:04:11:13 +0000] "GET /v1/rb/definition/9e97a9e7-0e75-437c-8a7a-ec4e8ee0e8c0/bdb05b25-a8a9-4c91-be05-4c73e7f3cbdb HTTP/1.1" 200 270
10.233.67.50 - - [26/Mar/2022:04:11:13 +0000] "GET /v1/rb/definition/9e97a9e7-0e75-437c-8a7a-ec4e8ee0e8c0/bdb05b25-a8a9-4c91-be05-4c73e7f3cbdb/profile/cnftest HTTP/1.1" 200 240
2022/03/26 04:11:13 Deleted Obj with ID ObjectID("623e91fc80515ae1ce6b2a74")
2022/03/26 04:11:13 Deleted Obj with ID ObjectID("623e91fc80515ae1ce6b2a75")
2022/03/26 04:11:13 Deleted Obj with ID ObjectID("623e91fc3cebde3699b5989d")
10.233.67.50 - - [26/Mar/2022:04:11:13 +0000] "DELETE /v1/rb/definition/9e97a9e7-0e75-437c-8a7a-ec4e8ee0e8c0/bdb05b25-a8a9-4c91-be05-4c73e7f3cbdb/profile/cnftest HTTP/1.1" 204 0
10.233.67.50 - - [26/Mar/2022:04:11:44 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 200 7661
2022/03/26 04:11:44 Deleted Obj with ID ObjectID("623e8f8b80515ae1ce6b2a5c")
2022/03/26 04:11:44 Deleted Obj with ID ObjectID("623e8f8b3cebde3699b59695")
10.233.67.50 - - [26/Mar/2022:04:11:44 +0000] "DELETE /v1/connectivity-info/k8sregion HTTP/1.1" 204 0
{"error":"Getting CloudRegion Information: Get kubeconfig file: Downloading kubeconfig: Getting Connection info: Get Connection: Error finding master table: mongo: no documents in result","level":"error","msg":"Error Deleting Instance","time":"2022-03-26T04:12:31Z"}
10.233.67.50 - - [26/Mar/2022:04:12:31 +0000] "DELETE /v1/instance/priceless_germain HTTP/1.1" 500 177
10.233.67.50 - - [26/Mar/2022:04:15:39 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 500 74
10.233.67.50 - - [26/Mar/2022:04:15:39 +0000] "POST /v1/connectivity-info HTTP/1.1" 201 7661
10.233.67.50 - - [26/Mar/2022:04:15:39 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 200 7661
10.233.67.50 - - [26/Mar/2022:04:15:40 +0000] "POST /v1/rb/definition HTTP/1.1" 201 125
10.233.67.50 - - [26/Mar/2022:04:15:40 +0000] "GET /v1/rb/definition/pnf-cnf-rb-ab790224-699b-4a7f-a835-33a3a18bde64/v1 HTTP/1.1" 200 125
10.233.67.50 - - [26/Mar/2022:04:15:40 +0000] "POST /v1/rb/definition/pnf-cnf-rb-ab790224-699b-4a7f-a835-33a3a18bde64/v1/content HTTP/1.1" 200 0
10.233.67.50 - - [26/Mar/2022:04:15:40 +0000] "GET /v1/rb/definition/pnf-cnf-rb-ab790224-699b-4a7f-a835-33a3a18bde64/v1 HTTP/1.1" 200 138
10.233.67.50 - - [26/Mar/2022:04:15:40 +0000] "POST /v1/rb/definition/pnf-cnf-rb-ab790224-699b-4a7f-a835-33a3a18bde64/v1/profile HTTP/1.1" 201 308
10.233.67.50 - - [26/Mar/2022:04:15:40 +0000] "GET /v1/rb/definition/pnf-cnf-rb-ab790224-699b-4a7f-a835-33a3a18bde64/v1/profile/pnf-cnf-profile-a8bd929f-4b65-42a8-bc11-bbba064bdf5a HTTP/1.1" 200 308
10.233.67.50 - - [26/Mar/2022:04:15:40 +0000] "POST /v1/rb/definition/pnf-cnf-rb-ab790224-699b-4a7f-a835-33a3a18bde64/v1/profile/pnf-cnf-profile-a8bd929f-4b65-42a8-bc11-bbba064bdf5a/content HTTP/1.1" 200 0
2022/03/26 04:15:40 Main rss info
2022/03/26 04:15:40   Path: /tmp/helm-tmpl-727724597/manifest-0
2022/03/26 04:15:40     Kind: Service
2022/03/26 04:15:40   Path: /tmp/helm-tmpl-727724597/manifest-1
2022/03/26 04:15:40     Kind: Service
2022/03/26 04:15:40   Path: /tmp/helm-tmpl-727724597/manifest-2
2022/03/26 04:15:40     Kind: Pod
2022/03/26 04:15:40   Path: /tmp/helm-tmpl-727724597/manifest-3
2022/03/26 04:15:40     Kind: Deployment
2022/03/26 04:15:40 Crd rss info
2022/03/26 04:15:40 Hook info
{"filepath":"/tmp/helm-tmpl-727724597/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2022-03-26T04:15:40Z"}
{"error":"Create Service error: services \"pnf-macro-test-simulator-mongo\" already exists","filepath":"/tmp/helm-tmpl-727724597/manifest-0","gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"error","msg":"Error Creating Resource","time":"2022-03-26T04:15:40Z"}
2022/03/26 04:15:40   Instance: gracious_hodgkin, Main rss are failed, skip post-install and remove instance in DB
2022/03/26 04:15:40 Deleted Obj with ID ObjectID("623e936c80515ae1ce6b2a7f")
2022/03/26 04:15:40 Deleted Obj with ID ObjectID("623e936c3cebde3699b59a03")
{"error":"Create Kubernetes Resources: Error creating kind: /v1, Kind=Service: Error in plugin Service plugin: Create Service error: services \"pnf-macro-test-simulator-mongo\" already exists","level":"error","msg":"Error Creating Resource","resource":{"rb-name":"pnf-cnf-rb-ab790224-699b-4a7f-a835-33a3a18bde64","rb-version":"v1","profile-name":"pnf-cnf-profile-a8bd929f-4b65-42a8-bc11-bbba064bdf5a","release-name":"","cloud-region":"k8sregion","labels":{},"override-values":{}},"time":"2022-03-26T04:15:40Z"}
10.233.67.50 - - [26/Mar/2022:04:15:40 +0000] "POST /v1/instance HTTP/1.1" 500 180