2021/07/22 01:01:19 Etcd Client Initialization failed with error: Error creating etcd client: dial tcp: lookup multicloud-k8s-etcd on 169.254.25.10:53: no such host
2021/07/22 01:01:21 Starting Kubernetes Multicloud API
2021/07/22 01:01:21 Error Getting TLS Configuration. Starting without TLS...
10.233.71.133 - - [22/Jul/2021:03:52:36 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0
10.233.71.133 - - [22/Jul/2021:03:55:05 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0
10.233.71.133 - - [22/Jul/2021:03:56:26 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0
127.0.0.1 - - [22/Jul/2021:03:56:27 +0000] "POST /v1/rb/definition HTTP/1.1" 201 211
10.233.71.133 - - [22/Jul/2021:03:56:57 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0
127.0.0.1 - - [22/Jul/2021:03:58:04 +0000] "POST /v1/rb/definition HTTP/1.1" 201 211
10.233.71.133 - - [22/Jul/2021:03:58:20 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0
10.233.71.133 - - [22/Jul/2021:03:59:53 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0
10.233.71.133 - - [22/Jul/2021:04:01:35 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0
10.233.71.133 - - [22/Jul/2021:04:02:53 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0
10.233.71.133 - - [22/Jul/2021:04:05:34 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0
10.233.71.133 - - [22/Jul/2021:04:09:50 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 500 74
10.233.71.133 - - [22/Jul/2021:04:09:50 +0000] "POST /v1/connectivity-info HTTP/1.1" 201 7569
10.233.71.133 - - [22/Jul/2021:04:09:50 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 200 7569
10.233.71.133 - - [22/Jul/2021:04:09:50 +0000] "POST /v1/rb/definition HTTP/1.1" 201 125
10.233.71.133 - - [22/Jul/2021:04:09:51 +0000] "GET /v1/rb/definition/pnf-cnf-rb-03b3a066-b221-4716-b333-8dd31df8edf1/v1 HTTP/1.1" 200 125
10.233.71.133 - - [22/Jul/2021:04:09:51 +0000] "POST /v1/rb/definition/pnf-cnf-rb-03b3a066-b221-4716-b333-8dd31df8edf1/v1/content HTTP/1.1" 200 0
10.233.71.133 - - [22/Jul/2021:04:09:51 +0000] "GET /v1/rb/definition/pnf-cnf-rb-03b3a066-b221-4716-b333-8dd31df8edf1/v1 HTTP/1.1" 200 138
10.233.71.133 - - [22/Jul/2021:04:09:51 +0000] "POST /v1/rb/definition/pnf-cnf-rb-03b3a066-b221-4716-b333-8dd31df8edf1/v1/profile HTTP/1.1" 201 280
10.233.71.133 - - [22/Jul/2021:04:09:51 +0000] "GET /v1/rb/definition/pnf-cnf-rb-03b3a066-b221-4716-b333-8dd31df8edf1/v1/profile/pnf-cnf-profile-b359621a-55df-4e18-bd8e-b89f865ca24d HTTP/1.1" 200 280
10.233.71.133 - - [22/Jul/2021:04:09:51 +0000] "POST /v1/rb/definition/pnf-cnf-rb-03b3a066-b221-4716-b333-8dd31df8edf1/v1/profile/pnf-cnf-profile-b359621a-55df-4e18-bd8e-b89f865ca24d/content HTTP/1.1" 200 0
2021/07/22 04:09:51 Error reading name cache from Database:  Error finding master table: mongo: no documents in result
2021/07/22 04:09:51 Error Reading from DB:  Reading cache from DB: Error finding master table: mongo: no documents in result
{"filepath":"/tmp/helm-tmpl-438233432/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2021-07-22T04:09:52Z"}
{"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator-mongo","time":"2021-07-22T04:09:52Z"}
{"filepath":"/tmp/helm-tmpl-438233432/manifest-1","level":"info","msg":"Processing Kubernetes Resource","time":"2021-07-22T04:09:52Z"}
{"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator","time":"2021-07-22T04:09:52Z"}
{"filepath":"/tmp/helm-tmpl-438233432/manifest-2","level":"info","msg":"Processing Kubernetes Resource","time":"2021-07-22T04:09:52Z"}
2021/07/22 04:09:52 No plugin for kind Pod found. Using generic Plugin
2021/07/22 04:09:52 Error converting template to map
{"gvk":{"Group":"","Version":"v1","Kind":"Pod"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator","time":"2021-07-22T04:09:54Z"}
{"filepath":"/tmp/helm-tmpl-438233432/manifest-3","level":"info","msg":"Processing Kubernetes Resource","time":"2021-07-22T04:09:54Z"}
2021/07/22 04:09:54 No plugin for kind Deployment found. Using generic Plugin
{"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator-mongo","time":"2021-07-22T04:09:54Z"}
10.233.71.133 - - [22/Jul/2021:04:09:51 +0000] "POST /v1/instance HTTP/1.1" 201 728
127.0.0.1 - - [22/Jul/2021:04:13:04 +0000] "POST /v1/rb/definition HTTP/1.1" 201 211
127.0.0.1 - - [22/Jul/2021:04:13:25 +0000] "POST /v1/rb/definition HTTP/1.1" 201 211
10.233.71.133 - - [22/Jul/2021:04:17:27 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 200 7569
127.0.0.1 - - [22/Jul/2021:04:17:33 +0000] "POST /v1/rb/definition HTTP/1.1" 201 211
127.0.0.1 - - [22/Jul/2021:04:17:33 +0000] "POST /v1/rb/definition/79f8ade8-db0a-4fc7-9e22-d9bfffec6779/bf0eb9dd-8f65-4bf1-b964-4f371b7d86a7/content HTTP/1.1" 200 0
127.0.0.1 - - [22/Jul/2021:04:18:05 +0000] "POST /v1/rb/definition HTTP/1.1" 201 211
10.233.71.133 - - [22/Jul/2021:04:22:57 +0000] "GET /v1/rb/definition/79f8ade8-db0a-4fc7-9e22-d9bfffec6779/bf0eb9dd-8f65-4bf1-b964-4f371b7d86a7 HTTP/1.1" 200 216
10.233.71.133 - - [22/Jul/2021:04:22:57 +0000] "GET /v1/rb/definition/79f8ade8-db0a-4fc7-9e22-d9bfffec6779/bf0eb9dd-8f65-4bf1-b964-4f371b7d86a7/profile/cnftest HTTP/1.1" 404 87
10.233.71.133 - - [22/Jul/2021:04:22:57 +0000] "POST /v1/rb/definition/79f8ade8-db0a-4fc7-9e22-d9bfffec6779/bf0eb9dd-8f65-4bf1-b964-4f371b7d86a7/profile HTTP/1.1" 201 212
10.233.71.133 - - [22/Jul/2021:04:22:57 +0000] "GET /v1/rb/definition/79f8ade8-db0a-4fc7-9e22-d9bfffec6779/bf0eb9dd-8f65-4bf1-b964-4f371b7d86a7/profile/cnftest HTTP/1.1" 200 212
10.233.71.133 - - [22/Jul/2021:04:22:57 +0000] "POST /v1/rb/definition/79f8ade8-db0a-4fc7-9e22-d9bfffec6779/bf0eb9dd-8f65-4bf1-b964-4f371b7d86a7/profile/cnftest/content HTTP/1.1" 200 0
2021/07/22 04:23:27 Did not find tag: instance
2021/07/22 04:23:27 Did not find tag: instance
2021/07/22 04:23:27 Did not find tag: instance
2021/07/22 04:23:27 Did not find tag: instance
2021/07/22 04:23:27 Did not find tag: instance
2021/07/22 04:23:27 Did not find tag: instance
2021/07/22 04:23:27 Did not find tag: instance
2021/07/22 04:23:27 Did not find tag: instance
2021/07/22 04:23:27 Did not find tag: instance
2021/07/22 04:23:27 Did not find tag: instance
2021/07/22 04:23:27 Did not find tag: instance
2021/07/22 04:23:27 Did not find tag: instance
2021/07/22 04:23:27 Did not find tag: instance
2021/07/22 04:23:27 Did not find tag: instance
2021/07/22 04:23:27 Did not find tag: instance
2021/07/22 04:23:27 Did not find tag: instance
{"level":"info","msg":"Broker API Response","response":{"template_type":"heat","workload_id":"","workload_status":"GET_COMPLETE","workload_status_reason":{"stacks":[]}},"time":"2021-07-22T04:23:27Z"}
10.233.71.133 - - [22/Jul/2021:04:23:27 +0000] "GET /basicnf-owner/k8sregion/infra_workload?name=basic_cnf-3499a1f6-7b31-497c-825b-a2611977fc7b HTTP/1.1" 200 114
{"Body":{},"Payload":{"generic-vnf-id":"711bc85c-9170-4841-afec-3d49addcae71","vf-module-id":"a6ed9ab3-eb6a-4ca1-934d-d585fb9b0c6a","vf-module-model-invariant-id":"79f8ade8-db0a-4fc7-9e22-d9bfffec6779","vf-module-model-version-id":"bf0eb9dd-8f65-4bf1-b964-4f371b7d86a7","vf-module-model-customization-id":"7392268f-6327-48b2-82b0-21659e2a7a37","oof_directives":{"attributes":null},"sdnc_directives":{"attributes":[{"attribute_name":"k8s-rb-profile-name","attribute_value":"cnftest"},{"attribute_name":"k8s-rb-profile-namespace","attribute_value":"k8s"},{"attribute_name":"availability_zone_0","attribute_value":"basicnf-availability-zone"},{"attribute_name":"dummy_name_0","attribute_value":"dummy_name"}]},"user_directives":{"attributes":null},"template_type":"","template_data":{"stack_name":"basic_cnf-3499a1f6-7b31-497c-825b-a2611977fc7b"}},"level":"info","msg":"Broker API Payload","time":"2021-07-22T04:23:27Z"}
{"level":"info","msg":"Instance API Payload","payload":{"rb-name":"79f8ade8-db0a-4fc7-9e22-d9bfffec6779","rb-version":"bf0eb9dd-8f65-4bf1-b964-4f371b7d86a7","profile-name":"cnftest","release-name":"a6ed9ab3-eb6a-4ca1-934d-d585fb9b0c6a","cloud-region":"k8sregion","labels":{"stack-name":"basic_cnf-3499a1f6-7b31-497c-825b-a2611977fc7b"},"override-values":{"availability_zone_0":"basicnf-availability-zone","dummy_name_0":"dummy_name","k8s-rb-profile-name":"cnftest","k8s-rb-profile-namespace":"k8s"}},"time":"2021-07-22T04:23:27Z"}
{"level":"info","msg":"Creating Namespace","namespace":"k8s","time":"2021-07-22T04:23:27Z"}
2021/07/22 04:23:28 Namespace (k8s) created
{"filepath":"/tmp/helm-tmpl-901475477/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2021-07-22T04:23:28Z"}
{"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"cnftest-nginx","time":"2021-07-22T04:23:28Z"}
{"filepath":"/tmp/helm-tmpl-901475477/manifest-1","level":"info","msg":"Processing Kubernetes Resource","time":"2021-07-22T04:23:28Z"}
2021/07/22 04:23:28 No plugin for kind Deployment found. Using generic Plugin
{"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"info","msg":"Created Kubernetes Resource","resource":"cnftest-nginx","time":"2021-07-22T04:23:28Z"}
10.233.71.133 - - [22/Jul/2021:04:23:27 +0000] "POST /basicnf-owner/k8sregion/infra_workload HTTP/1.1" 201 304
{"level":"info","msg":"Broker API Response","response":{"template_type":"heat","workload_id":"hopeful_hellman","template_response":[{"GVK":{"Group":"","Version":"v1","Kind":"Service"},"Name":"cnftest-nginx"},{"GVK":{"Group":"apps","Version":"v1","Kind":"Deployment"},"Name":"cnftest-nginx"}],"workload_status":"CREATE_COMPLETE","workload_status_reason":null},"time":"2021-07-22T04:23:28Z"}
{"level":"info","msg":"Broker API Response","response":{"template_type":"heat","workload_id":"hopeful_hellman","workload_status":"CREATE_COMPLETE","workload_status_reason":null},"time":"2021-07-22T04:23:28Z"}
10.233.71.133 - - [22/Jul/2021:04:23:28 +0000] "GET /basicnf-owner/k8sregion/infra_workload/hopeful_hellman HTTP/1.1" 200 123
10.233.71.133 - - [22/Jul/2021:04:23:29 +0000] "POST /basicnf-owner/k8sregion/infra_workload/hopeful_hellman HTTP/1.1" 405 0
{"level":"info","msg":"Broker API Response","response":{"template_type":"heat","workload_id":"hopeful_hellman","workload_status":"CREATE_COMPLETE","workload_status_reason":null},"time":"2021-07-22T04:24:03Z"}
10.233.71.133 - - [22/Jul/2021:04:24:03 +0000] "GET /basicnf-owner/k8sregion/infra_workload/hopeful_hellman HTTP/1.1" 200 123
{"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"warning","msg":"Deleting Resource","resource":"cnftest-nginx","time":"2021-07-22T04:24:03Z"}
2021/07/22 04:24:03 Deleting service: cnftest-nginx
{"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"warning","msg":"Deleting Resource","resource":"cnftest-nginx","time":"2021-07-22T04:24:03Z"}
2021/07/22 04:24:03 No plugin for kind Deployment found. Using generic Plugin
2021/07/22 04:24:03 Deleted Obj with ID ObjectID("60f8f2c06752fea98c66bb57")
2021/07/22 04:24:03 Deleted Obj with ID ObjectID("60f8f2c009f7d59342887978")
{"level":"info","msg":"Broker API Response","response":{"template_type":"heat","workload_id":"hopeful_hellman","workload_status":"DELETE_COMPLETE","workload_status_reason":null},"time":"2021-07-22T04:24:03Z"}
10.233.71.133 - - [22/Jul/2021:04:24:03 +0000] "DELETE /basicnf-owner/k8sregion/infra_workload/hopeful_hellman HTTP/1.1" 202 123
10.233.71.133 - - [22/Jul/2021:04:24:30 +0000] "GET /v1/rb/definition/79f8ade8-db0a-4fc7-9e22-d9bfffec6779/bf0eb9dd-8f65-4bf1-b964-4f371b7d86a7 HTTP/1.1" 200 216
10.233.71.133 - - [22/Jul/2021:04:24:31 +0000] "GET /v1/rb/definition/79f8ade8-db0a-4fc7-9e22-d9bfffec6779/bf0eb9dd-8f65-4bf1-b964-4f371b7d86a7/profile/cnftest HTTP/1.1" 200 212
2021/07/22 04:24:31 Deleted Obj with ID ObjectID("60f8f2a16752fea98c66bb55")
2021/07/22 04:24:31 Deleted Obj with ID ObjectID("60f8f2a16752fea98c66bb56")
10.233.71.133 - - [22/Jul/2021:04:24:31 +0000] "DELETE /v1/rb/definition/79f8ade8-db0a-4fc7-9e22-d9bfffec6779/bf0eb9dd-8f65-4bf1-b964-4f371b7d86a7/profile/cnftest HTTP/1.1" 204 0
2021/07/22 04:24:31 Deleted Obj with ID ObjectID("60f8f2a109f7d59342887949")
10.233.71.133 - - [22/Jul/2021:04:25:39 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 200 7569
2021/07/22 04:25:39 Deleted Obj with ID ObjectID("60f8ef8e6752fea98c66bb3d")
2021/07/22 04:25:39 Deleted Obj with ID ObjectID("60f8ef8e09f7d593428876de")
10.233.71.133 - - [22/Jul/2021:04:25:39 +0000] "DELETE /v1/connectivity-info/k8sregion HTTP/1.1" 204 0
10.233.71.133 - - [22/Jul/2021:04:54:16 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 500 74
10.233.71.133 - - [22/Jul/2021:04:54:16 +0000] "POST /v1/connectivity-info HTTP/1.1" 201 7569
10.233.71.133 - - [22/Jul/2021:04:54:16 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 200 7569
10.233.71.133 - - [22/Jul/2021:04:54:16 +0000] "POST /v1/rb/definition HTTP/1.1" 201 125
10.233.71.133 - - [22/Jul/2021:04:54:16 +0000] "GET /v1/rb/definition/pnf-cnf-rb-49eee2eb-b377-40f2-8ffb-40f36e380103/v1 HTTP/1.1" 200 125
10.233.71.133 - - [22/Jul/2021:04:54:16 +0000] "POST /v1/rb/definition/pnf-cnf-rb-49eee2eb-b377-40f2-8ffb-40f36e380103/v1/content HTTP/1.1" 200 0
10.233.71.133 - - [22/Jul/2021:04:54:16 +0000] "GET /v1/rb/definition/pnf-cnf-rb-49eee2eb-b377-40f2-8ffb-40f36e380103/v1 HTTP/1.1" 200 138
10.233.71.133 - - [22/Jul/2021:04:54:16 +0000] "POST /v1/rb/definition/pnf-cnf-rb-49eee2eb-b377-40f2-8ffb-40f36e380103/v1/profile HTTP/1.1" 201 280
10.233.71.133 - - [22/Jul/2021:04:54:16 +0000] "GET /v1/rb/definition/pnf-cnf-rb-49eee2eb-b377-40f2-8ffb-40f36e380103/v1/profile/pnf-cnf-profile-b7cc58a2-f23a-4f9a-ad25-f5274cb4c99f HTTP/1.1" 200 280
10.233.71.133 - - [22/Jul/2021:04:54:16 +0000] "POST /v1/rb/definition/pnf-cnf-rb-49eee2eb-b377-40f2-8ffb-40f36e380103/v1/profile/pnf-cnf-profile-b7cc58a2-f23a-4f9a-ad25-f5274cb4c99f/content HTTP/1.1" 200 0
{"filepath":"/tmp/helm-tmpl-637479309/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2021-07-22T04:54:17Z"}
{"error":"Create Service error: services \"pnf-macro-test-simulator-mongo\" already exists","filepath":"/tmp/helm-tmpl-637479309/manifest-0","gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"error","msg":"Error Creating Resource","time":"2021-07-22T04:54:17Z"}
{"error":"Create Kubernetes Resources: Error creating kind: /v1, Kind=Service: Error in plugin Service plugin: Create Service error: services \"pnf-macro-test-simulator-mongo\" already exists","level":"error","msg":"Error Creating Resource","resource":{"rb-name":"pnf-cnf-rb-49eee2eb-b377-40f2-8ffb-40f36e380103","rb-version":"v1","profile-name":"pnf-cnf-profile-b7cc58a2-f23a-4f9a-ad25-f5274cb4c99f","release-name":"","cloud-region":"k8sregion","labels":{},"override-values":{}},"time":"2021-07-22T04:54:17Z"}
10.233.71.133 - - [22/Jul/2021:04:54:16 +0000] "POST /v1/instance HTTP/1.1" 500 180