2022/01/15 02:39:35 Starting Kubernetes Multicloud API
2022/01/15 02:39:35 Error Getting TLS Configuration. Starting without TLS...
127.0.0.1 - - [15/Jan/2022:04:48:07 +0000] "POST /v1/rb/definition HTTP/1.1" 201 270
10.233.73.132 - - [15/Jan/2022:04:51:28 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0
127.0.0.1 - - [15/Jan/2022:04:53:03 +0000] "POST /v1/rb/definition HTTP/1.1" 201 270
10.233.73.132 - - [15/Jan/2022:04:54:32 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 500 74
10.233.73.132 - - [15/Jan/2022:04:54:32 +0000] "POST /v1/connectivity-info HTTP/1.1" 201 7565
10.233.73.132 - - [15/Jan/2022:04:54:32 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 200 7565
10.233.73.132 - - [15/Jan/2022:04:54:32 +0000] "POST /v1/rb/definition HTTP/1.1" 201 125
10.233.73.132 - - [15/Jan/2022:04:54:32 +0000] "GET /v1/rb/definition/pnf-cnf-rb-95919552-1d82-4924-bbc8-2371801076e6/v1 HTTP/1.1" 200 125
10.233.73.132 - - [15/Jan/2022:04:54:32 +0000] "POST /v1/rb/definition/pnf-cnf-rb-95919552-1d82-4924-bbc8-2371801076e6/v1/content HTTP/1.1" 200 0
10.233.73.132 - - [15/Jan/2022:04:54:32 +0000] "GET /v1/rb/definition/pnf-cnf-rb-95919552-1d82-4924-bbc8-2371801076e6/v1 HTTP/1.1" 200 138
10.233.73.132 - - [15/Jan/2022:04:54:32 +0000] "POST /v1/rb/definition/pnf-cnf-rb-95919552-1d82-4924-bbc8-2371801076e6/v1/profile HTTP/1.1" 201 314
10.233.73.132 - - [15/Jan/2022:04:54:33 +0000] "GET /v1/rb/definition/pnf-cnf-rb-95919552-1d82-4924-bbc8-2371801076e6/v1/profile/pnf-cnf-profile-397d9be0-7619-441e-8a23-ba9d47ef4618 HTTP/1.1" 200 314
10.233.73.132 - - [15/Jan/2022:04:54:33 +0000] "POST /v1/rb/definition/pnf-cnf-rb-95919552-1d82-4924-bbc8-2371801076e6/v1/profile/pnf-cnf-profile-397d9be0-7619-441e-8a23-ba9d47ef4618/content HTTP/1.1" 200 0
2022/01/15 04:54:33 Error reading name cache from Database:  Error finding master table: mongo: no documents in result
2022/01/15 04:54:33 Error Reading from DB:  Reading cache from DB: Error finding master table: mongo: no documents in result
2022/01/15 04:54:33 Main rss info
2022/01/15 04:54:33   Path: /tmp/helm-tmpl-813314188/manifest-0
2022/01/15 04:54:33     Kind: Service
2022/01/15 04:54:33   Path: /tmp/helm-tmpl-813314188/manifest-1
2022/01/15 04:54:33     Kind: Service
2022/01/15 04:54:33   Path: /tmp/helm-tmpl-813314188/manifest-2
2022/01/15 04:54:33     Kind: Pod
2022/01/15 04:54:33   Path: /tmp/helm-tmpl-813314188/manifest-3
2022/01/15 04:54:33     Kind: Deployment
2022/01/15 04:54:33 Crd rss info
2022/01/15 04:54:33 Hook info
{"level":"info","msg":"Creating Namespace","namespace":"onap-tests","time":"2022-01-15T04:54:33Z"}
2022/01/15 04:54:33 Namespace (onap-tests) created
{"filepath":"/tmp/helm-tmpl-813314188/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2022-01-15T04:54:33Z"}
{"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator-mongo","time":"2022-01-15T04:54:33Z"}
{"filepath":"/tmp/helm-tmpl-813314188/manifest-1","level":"info","msg":"Processing Kubernetes Resource","time":"2022-01-15T04:54:33Z"}
{"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator","time":"2022-01-15T04:54:33Z"}
{"filepath":"/tmp/helm-tmpl-813314188/manifest-2","level":"info","msg":"Processing Kubernetes Resource","time":"2022-01-15T04:54:33Z"}
2022/01/15 04:54:33 No plugin for kind Pod found. Using generic Plugin
2022/01/15 04:54:34 Error converting template to map
{"gvk":{"Group":"","Version":"v1","Kind":"Pod"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator","time":"2022-01-15T04:54:34Z"}
{"filepath":"/tmp/helm-tmpl-813314188/manifest-3","level":"info","msg":"Processing Kubernetes Resource","time":"2022-01-15T04:54:34Z"}
2022/01/15 04:54:34 No plugin for kind Deployment found. Using generic Plugin
{"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator-mongo","time":"2022-01-15T04:54:35Z"}
10.233.73.132 - - [15/Jan/2022:04:54:33 +0000] "POST /v1/instance HTTP/1.1" 201 734
10.233.73.132 - - [15/Jan/2022:04:54:44 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0
10.233.73.132 - - [15/Jan/2022:04:54:46 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0
127.0.0.1 - - [15/Jan/2022:04:56:45 +0000] "POST /v1/rb/definition HTTP/1.1" 201 270
127.0.0.1 - - [15/Jan/2022:04:57:01 +0000] "POST /v1/rb/definition HTTP/1.1" 201 272
127.0.0.1 - - [15/Jan/2022:04:59:00 +0000] "POST /v1/rb/definition HTTP/1.1" 201 267
10.233.73.132 - - [15/Jan/2022:05:03:18 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 200 7565
127.0.0.1 - - [15/Jan/2022:05:03:29 +0000] "POST /v1/rb/definition HTTP/1.1" 201 265
127.0.0.1 - - [15/Jan/2022:05:03:29 +0000] "POST /v1/rb/definition/6e5516db-947c-4b90-8a0a-4c9f7091040d/1ca391c2-643a-4774-83be-e52d5e8a8215/content HTTP/1.1" 200 0
10.233.73.132 - - [15/Jan/2022:05:03:34 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0
10.233.73.132 - - [15/Jan/2022:05:06:24 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0
10.233.73.132 - - [15/Jan/2022:05:06:49 +0000] "GET /v1/rb/definition/6e5516db-947c-4b90-8a0a-4c9f7091040d/1ca391c2-643a-4774-83be-e52d5e8a8215 HTTP/1.1" 200 270
10.233.73.132 - - [15/Jan/2022:05:06:49 +0000] "GET /v1/rb/definition/6e5516db-947c-4b90-8a0a-4c9f7091040d/1ca391c2-643a-4774-83be-e52d5e8a8215/profile/cnftest HTTP/1.1" 404 87
10.233.73.132 - - [15/Jan/2022:05:06:49 +0000] "POST /v1/rb/definition/6e5516db-947c-4b90-8a0a-4c9f7091040d/1ca391c2-643a-4774-83be-e52d5e8a8215/profile HTTP/1.1" 201 240
10.233.73.132 - - [15/Jan/2022:05:06:49 +0000] "GET /v1/rb/definition/6e5516db-947c-4b90-8a0a-4c9f7091040d/1ca391c2-643a-4774-83be-e52d5e8a8215/profile/cnftest HTTP/1.1" 200 240
10.233.73.132 - - [15/Jan/2022:05:06:49 +0000] "POST /v1/rb/definition/6e5516db-947c-4b90-8a0a-4c9f7091040d/1ca391c2-643a-4774-83be-e52d5e8a8215/profile/cnftest/content HTTP/1.1" 200 0
{"level":"info","msg":"Broker API Response","response":{"template_type":"heat","workload_id":"","workload_status":"GET_COMPLETE","workload_status_reason":{"stacks":[]}},"time":"2022-01-15T05:06:56Z"}
10.233.73.132 - - [15/Jan/2022:05:06:56 +0000] "GET /basicnf-owner/k8sregion/infra_workload?name=basic_cnf-0aa74ff5-ea3e-424d-bc83-5f6794907a16 HTTP/1.1" 200 114
{"Body":{},"Payload":{"generic-vnf-id":"7c417d94-5e7f-4c94-8bf8-8cd5aa7441a8","vf-module-id":"5be94afa-6f4a-45ab-9652-242d9e414b33","vf-module-model-invariant-id":"6e5516db-947c-4b90-8a0a-4c9f7091040d","vf-module-model-version-id":"84051b99-3ee8-4d63-8bf5-2442c87aa5e1","vf-module-model-customization-id":"1ca391c2-643a-4774-83be-e52d5e8a8215","oof_directives":{"attributes":null},"sdnc_directives":{"attributes":[{"attribute_name":"k8s-rb-profile-name","attribute_value":"cnftest"},{"attribute_name":"k8s-rb-profile-namespace","attribute_value":"k8s"},{"attribute_name":"availability_zone_0","attribute_value":"basicnf-availability-zone"},{"attribute_name":"dummy_name_0","attribute_value":"dummy_name"}]},"user_directives":{"attributes":null},"template_type":"","template_data":{"stack_name":"basic_cnf-0aa74ff5-ea3e-424d-bc83-5f6794907a16"}},"level":"info","msg":"Broker API Payload","time":"2022-01-15T05:06:56Z"}
{"level":"info","msg":"Instance API Payload","payload":{"rb-name":"6e5516db-947c-4b90-8a0a-4c9f7091040d","rb-version":"1ca391c2-643a-4774-83be-e52d5e8a8215","profile-name":"cnftest","release-name":"5be94afa-6f4a-45ab-9652-242d9e414b33","cloud-region":"k8sregion","labels":{"stack-name":"basic_cnf-0aa74ff5-ea3e-424d-bc83-5f6794907a16"},"override-values":{"availability_zone_0":"basicnf-availability-zone","dummy_name_0":"dummy_name","k8s-rb-profile-name":"cnftest","k8s-rb-profile-namespace":"k8s"}},"time":"2022-01-15T05:06:56Z"}
2022/01/15 05:06:56 Main rss info
2022/01/15 05:06:56   Path: /tmp/helm-tmpl-630335915/manifest-0
2022/01/15 05:06:56     Kind: Service
2022/01/15 05:06:56   Path: /tmp/helm-tmpl-630335915/manifest-1
2022/01/15 05:06:56     Kind: Deployment
2022/01/15 05:06:56 Crd rss info
2022/01/15 05:06:56 Hook info
{"level":"info","msg":"Creating Namespace","namespace":"k8s","time":"2022-01-15T05:06:56Z"}
2022/01/15 05:06:57 Namespace (k8s) created
{"filepath":"/tmp/helm-tmpl-630335915/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2022-01-15T05:06:57Z"}
{"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"cnftest-nginx","time":"2022-01-15T05:06:57Z"}
{"filepath":"/tmp/helm-tmpl-630335915/manifest-1","level":"info","msg":"Processing Kubernetes Resource","time":"2022-01-15T05:06:57Z"}
2022/01/15 05:06:57 No plugin for kind Deployment found. Using generic Plugin
{"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"info","msg":"Created Kubernetes Resource","resource":"cnftest-nginx","time":"2022-01-15T05:06:57Z"}
10.233.73.132 - - [15/Jan/2022:05:06:56 +0000] "POST /basicnf-owner/k8sregion/infra_workload HTTP/1.1" 201 304
{"level":"info","msg":"Broker API Response","response":{"template_type":"heat","workload_id":"laughing_golick","template_response":[{"GVK":{"Group":"","Version":"v1","Kind":"Service"},"Name":"cnftest-nginx"},{"GVK":{"Group":"apps","Version":"v1","Kind":"Deployment"},"Name":"cnftest-nginx"}],"workload_status":"CREATE_COMPLETE","workload_status_reason":null},"time":"2022-01-15T05:06:57Z"}
{"level":"info","msg":"Broker API Response","response":{"template_type":"heat","workload_id":"laughing_golick","workload_status":"CREATE_COMPLETE","workload_status_reason":null},"time":"2022-01-15T05:06:57Z"}
10.233.73.132 - - [15/Jan/2022:05:06:57 +0000] "GET /basicnf-owner/k8sregion/infra_workload/laughing_golick HTTP/1.1" 200 123
10.233.73.132 - - [15/Jan/2022:05:06:57 +0000] "POST /basicnf-owner/k8sregion/infra_workload/laughing_golick HTTP/1.1" 405 0
{"level":"info","msg":"Broker API Response","response":{"template_type":"heat","workload_id":"laughing_golick","workload_status":"CREATE_COMPLETE","workload_status_reason":null},"time":"2022-01-15T05:07:18Z"}
10.233.73.132 - - [15/Jan/2022:05:07:18 +0000] "GET /basicnf-owner/k8sregion/infra_workload/laughing_golick HTTP/1.1" 200 123
2022/01/15 05:07:18 [Config Cleanup] Instance laughing_golick
2022/01/15 05:07:18 [scheduleResources]: START thread
2022/01/15 05:07:23 Stop config thread for laughing_golick
{"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"warning","msg":"Deleting Resource","resource":"cnftest-nginx","time":"2022-01-15T05:07:23Z"}
2022/01/15 05:07:23 No plugin for kind Deployment found. Using generic Plugin
2022/01/15 05:07:23 [scheduleResources]: STOP thread
{"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"warning","msg":"Deleting Resource","resource":"cnftest-nginx","time":"2022-01-15T05:07:23Z"}
2022/01/15 05:07:23 Deleting service: cnftest-nginx
2022/01/15 05:07:23 Deleted Obj with ID ObjectID("61e25671b8606549b4d32926")
2022/01/15 05:07:23 Deleted Obj with ID ObjectID("61e25671726c6076f28a3274")
{"level":"info","msg":"Broker API Response","response":{"template_type":"heat","workload_id":"laughing_golick","workload_status":"DELETE_COMPLETE","workload_status_reason":null},"time":"2022-01-15T05:07:23Z"}
10.233.73.132 - - [15/Jan/2022:05:07:18 +0000] "DELETE /basicnf-owner/k8sregion/infra_workload/laughing_golick HTTP/1.1" 202 123
10.233.73.132 - - [15/Jan/2022:05:07:37 +0000] "GET /v1/rb/definition/6e5516db-947c-4b90-8a0a-4c9f7091040d/1ca391c2-643a-4774-83be-e52d5e8a8215 HTTP/1.1" 200 270
10.233.73.132 - - [15/Jan/2022:05:07:38 +0000] "GET /v1/rb/definition/6e5516db-947c-4b90-8a0a-4c9f7091040d/1ca391c2-643a-4774-83be-e52d5e8a8215/profile/cnftest HTTP/1.1" 200 240
2022/01/15 05:07:38 Deleted Obj with ID ObjectID("61e25669b8606549b4d32924")
2022/01/15 05:07:38 Deleted Obj with ID ObjectID("61e25669b8606549b4d32925")
10.233.73.132 - - [15/Jan/2022:05:07:38 +0000] "DELETE /v1/rb/definition/6e5516db-947c-4b90-8a0a-4c9f7091040d/1ca391c2-643a-4774-83be-e52d5e8a8215/profile/cnftest HTTP/1.1" 204 0
2022/01/15 05:07:38 Deleted Obj with ID ObjectID("61e25669726c6076f28a3251")
10.233.73.132 - - [15/Jan/2022:05:08:06 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 200 7565
2022/01/15 05:08:06 Deleted Obj with ID ObjectID("61e25388b8606549b4d3290c")
2022/01/15 05:08:06 Deleted Obj with ID ObjectID("61e25388726c6076f28a2ffe")
10.233.73.132 - - [15/Jan/2022:05:08:06 +0000] "DELETE /v1/connectivity-info/k8sregion HTTP/1.1" 204 0
10.233.73.132 - - [15/Jan/2022:05:09:46 +0000] "DELETE /v1/instance/adoring_bhabha HTTP/1.1" 500 177
{"error":"Getting CloudRegion Information: Get kubeconfig file: Downloading kubeconfig: Getting Connection info: Get Connection: Error finding master table: mongo: no documents in result","level":"error","msg":"Error Deleting Instance","time":"2022-01-15T05:09:46Z"}
10.233.73.132 - - [15/Jan/2022:05:09:57 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0
10.233.73.132 - - [15/Jan/2022:05:14:43 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 500 74
10.233.73.132 - - [15/Jan/2022:05:14:44 +0000] "POST /v1/connectivity-info HTTP/1.1" 201 7565
10.233.73.132 - - [15/Jan/2022:05:14:44 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 200 7565
10.233.73.132 - - [15/Jan/2022:05:14:44 +0000] "POST /v1/rb/definition HTTP/1.1" 201 125
10.233.73.132 - - [15/Jan/2022:05:14:44 +0000] "GET /v1/rb/definition/pnf-cnf-rb-476caf36-95a0-43dd-bf06-48e48c5b06c2/v1 HTTP/1.1" 200 125
10.233.73.132 - - [15/Jan/2022:05:14:44 +0000] "POST /v1/rb/definition/pnf-cnf-rb-476caf36-95a0-43dd-bf06-48e48c5b06c2/v1/content HTTP/1.1" 200 0
10.233.73.132 - - [15/Jan/2022:05:14:44 +0000] "GET /v1/rb/definition/pnf-cnf-rb-476caf36-95a0-43dd-bf06-48e48c5b06c2/v1 HTTP/1.1" 200 138
10.233.73.132 - - [15/Jan/2022:05:14:44 +0000] "POST /v1/rb/definition/pnf-cnf-rb-476caf36-95a0-43dd-bf06-48e48c5b06c2/v1/profile HTTP/1.1" 201 314
10.233.73.132 - - [15/Jan/2022:05:14:44 +0000] "GET /v1/rb/definition/pnf-cnf-rb-476caf36-95a0-43dd-bf06-48e48c5b06c2/v1/profile/pnf-cnf-profile-3b36af32-d8e5-4c73-a0f4-ed1495924985 HTTP/1.1" 200 314
10.233.73.132 - - [15/Jan/2022:05:14:44 +0000] "POST /v1/rb/definition/pnf-cnf-rb-476caf36-95a0-43dd-bf06-48e48c5b06c2/v1/profile/pnf-cnf-profile-3b36af32-d8e5-4c73-a0f4-ed1495924985/content HTTP/1.1" 200 0
2022/01/15 05:14:44 Main rss info
2022/01/15 05:14:44   Path: /tmp/helm-tmpl-148449221/manifest-0
2022/01/15 05:14:44     Kind: Service
2022/01/15 05:14:44   Path: /tmp/helm-tmpl-148449221/manifest-1
2022/01/15 05:14:44     Kind: Service
2022/01/15 05:14:44   Path: /tmp/helm-tmpl-148449221/manifest-2
2022/01/15 05:14:44     Kind: Pod
2022/01/15 05:14:44   Path: /tmp/helm-tmpl-148449221/manifest-3
2022/01/15 05:14:44     Kind: Deployment
2022/01/15 05:14:44 Crd rss info
2022/01/15 05:14:44 Hook info
{"filepath":"/tmp/helm-tmpl-148449221/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2022-01-15T05:14:44Z"}
{"error":"Create Service error: services \"pnf-macro-test-simulator-mongo\" already exists","filepath":"/tmp/helm-tmpl-148449221/manifest-0","gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"error","msg":"Error Creating Resource","time":"2022-01-15T05:14:44Z"}
2022/01/15 05:14:44   Instance: nostalgic_archimedes, Main rss are failed, skip post-install and remove instance in DB
2022/01/15 05:14:44 Deleted Obj with ID ObjectID("61e25844b8606549b4d3292f")
2022/01/15 05:14:44 Deleted Obj with ID ObjectID("61e25844726c6076f28a33fd")
{"error":"Create Kubernetes Resources: Error creating kind: /v1, Kind=Service: Error in plugin Service plugin: Create Service error: services \"pnf-macro-test-simulator-mongo\" already exists","level":"error","msg":"Error Creating Resource","resource":{"rb-name":"pnf-cnf-rb-476caf36-95a0-43dd-bf06-48e48c5b06c2","rb-version":"v1","profile-name":"pnf-cnf-profile-3b36af32-d8e5-4c73-a0f4-ed1495924985","release-name":"","cloud-region":"k8sregion","labels":{},"override-values":{}},"time":"2022-01-15T05:14:44Z"}
10.233.73.132 - - [15/Jan/2022:05:14:44 +0000] "POST /v1/instance HTTP/1.1" 500 180