By type
2023/01/26 22:51:49 Starting Kubernetes Multicloud API
2023/01/26 22:51:49 Error Getting TLS Configuration. Starting without TLS...
{"level":"info","msg":"Restoring status subscription notifications","time":"2023-01-26T22:51:59Z"}
{"error":"Listing Instances: Did not find any objects with tag: instance","level":"error","msg":"Error reading instance list","time":"2023-01-26T22:51:59Z"}
{"error":"Listing Instances: Did not find any objects with tag: instance","level":"error","msg":"Error listing instances","profile-name":"","rb-name":"","rb-version":"","time":"2023-01-26T23:21:26Z"}
127.0.0.6 - - [26/Jan/2023:23:21:26 +0000] "GET /v1/instance HTTP/1.1" 500 63
127.0.0.6 - - [27/Jan/2023:01:43:34 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0
127.0.0.6 - - [27/Jan/2023:02:16:06 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0
127.0.0.6 - - [27/Jan/2023:02:20:50 +0000] "GET /v1/healthcheck HTTP/1.1" 200 0
127.0.0.1 - - [27/Jan/2023:02:26:26 +0000] "POST /v1/rb/definition HTTP/1.1" 201 270
127.0.0.1 - - [27/Jan/2023:02:26:58 +0000] "POST /v1/rb/definition HTTP/1.1" 201 278
127.0.0.6 - - [27/Jan/2023:03:16:57 +0000] "GET /v1/connectivity-info/k8sregion-cds HTTP/1.1" 500 74
127.0.0.6 - - [27/Jan/2023:03:16:57 +0000] "POST /v1/connectivity-info HTTP/1.1" 201 7669
127.0.0.6 - - [27/Jan/2023:03:16:57 +0000] "GET /v1/connectivity-info/k8sregion-cds HTTP/1.1" 200 7669
127.0.0.6 - - [27/Jan/2023:03:16:57 +0000] "POST /v1/rb/definition HTTP/1.1" 201 124
127.0.0.6 - - [27/Jan/2023:03:16:57 +0000] "GET /v1/rb/definition/cds-ms-rb-5e238956-5e42-49d4-8dd7-fe801df1b7ca/v1 HTTP/1.1" 200 124
127.0.0.6 - - [27/Jan/2023:03:16:57 +0000] "POST /v1/rb/definition/cds-ms-rb-5e238956-5e42-49d4-8dd7-fe801df1b7ca/v1/content HTTP/1.1" 200 0
127.0.0.6 - - [27/Jan/2023:03:16:57 +0000] "GET /v1/rb/definition/cds-ms-rb-5e238956-5e42-49d4-8dd7-fe801df1b7ca/v1 HTTP/1.1" 200 138
127.0.0.6 - - [27/Jan/2023:03:16:57 +0000] "POST /v1/rb/definition/cds-ms-rb-5e238956-5e42-49d4-8dd7-fe801df1b7ca/v1/profile HTTP/1.1" 201 305
127.0.0.6 - - [27/Jan/2023:03:16:57 +0000] "GET /v1/rb/definition/cds-ms-rb-5e238956-5e42-49d4-8dd7-fe801df1b7ca/v1/profile/cds-ms-prof-96e81c3e-ed47-4826-af0f-b7c39aac4cf0 HTTP/1.1" 200 305
127.0.0.6 - - [27/Jan/2023:03:16:57 +0000] "POST /v1/rb/definition/cds-ms-rb-5e238956-5e42-49d4-8dd7-fe801df1b7ca/v1/profile/cds-ms-prof-96e81c3e-ed47-4826-af0f-b7c39aac4cf0/content HTTP/1.1" 200 0
2023/01/27 03:16:58 Error reading name cache from Database: Error finding master table: mongo: no documents in result
2023/01/27 03:16:58 Error Reading from DB: Reading cache from DB: Error finding master table: mongo: no documents in result
2023/01/27 03:16:58 Main rss info
2023/01/27 03:16:58 Path: /tmp/helm-tmpl-380114700/manifest-0
2023/01/27 03:16:58 Kind: Service
2023/01/27 03:16:58 Path: /tmp/helm-tmpl-380114700/manifest-1
2023/01/27 03:16:58 Kind: Deployment
2023/01/27 03:16:58 Crd rss info
2023/01/27 03:16:58 Hook info
{"level":"info","msg":"Creating Namespace","namespace":"onap-tests","time":"2023-01-27T03:16:58Z"}
2023/01/27 03:16:58 Namespace (onap-tests) created
{"filepath":"/tmp/helm-tmpl-380114700/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2023-01-27T03:16:58Z"}
{"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"cds-regression-mockserver","time":"2023-01-27T03:16:58Z"}
{"filepath":"/tmp/helm-tmpl-380114700/manifest-1","level":"info","msg":"Processing Kubernetes Resource","time":"2023-01-27T03:16:58Z"}
2023/01/27 03:16:58 No plugin for kind Deployment found. Using generic Plugin
{"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"info","msg":"Created Kubernetes Resource","resource":"cds-cds-mockserver","time":"2023-01-27T03:16:58Z"}
127.0.0.6 - - [27/Jan/2023:03:16:58 +0000] "POST /v1/instance HTTP/1.1" 201 542
2023/01/27 03:18:20 [Config Cleanup] Instance zealous_kepler
2023/01/27 03:18:20 [scheduleResources]: START thread
2023/01/27 03:18:25 Stop config thread for zealous_kepler
{"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"warning","msg":"Deleting Resource","resource":"cds-cds-mockserver","time":"2023-01-27T03:18:25Z"}
2023/01/27 03:18:25 No plugin for kind Deployment found. Using generic Plugin
2023/01/27 03:18:25 [scheduleResources]: STOP thread
{"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"warning","msg":"Deleting Resource","resource":"cds-regression-mockserver","time":"2023-01-27T03:18:25Z"}
2023/01/27 03:18:25 Deleting service: cds-regression-mockserver
{"instance":"zealous_kepler","level":"info","msg":"[START] status notify thread for ","time":"2023-01-27T03:18:25Z"}
127.0.0.6 - - [27/Jan/2023:03:18:29 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 500 74
127.0.0.6 - - [27/Jan/2023:03:18:29 +0000] "POST /v1/connectivity-info HTTP/1.1" 201 7665
127.0.0.6 - - [27/Jan/2023:03:18:29 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 200 7665
{"instance":"zealous_kepler","level":"info","msg":"[STOP] status notify thread for ","time":"2023-01-27T03:18:30Z"}
2023/01/27 03:18:30 Deleted Obj with ID ObjectID("63d3422ab08391d1c3eb3a0c")
127.0.0.6 - - [27/Jan/2023:03:18:20 +0000] "DELETE /v1/instance/zealous_kepler HTTP/1.1" 202 0
2023/01/27 03:18:30 Deleted Obj with ID ObjectID("63d3422ba74c86542b855131")
127.0.0.6 - - [27/Jan/2023:03:18:30 +0000] "GET /v1/connectivity-info/k8sregion-cds HTTP/1.1" 200 7669
2023/01/27 03:18:30 Deleted Obj with ID ObjectID("63d34229b08391d1c3eb3a03")
127.0.0.6 - - [27/Jan/2023:03:18:30 +0000] "DELETE /v1/connectivity-info/k8sregion-cds HTTP/1.1" 204 0
2023/01/27 03:18:30 Deleted Obj with ID ObjectID("63d3422aa74c86542b8550f3")
127.0.0.1 - - [27/Jan/2023:03:18:46 +0000] "POST /v1/rb/definition HTTP/1.1" 201 265
127.0.0.1 - - [27/Jan/2023:03:18:46 +0000] "POST /v1/rb/definition/cf64c6bb-ea0c-407e-ab39-950f198ef0c0/03206f55-1008-47cc-9224-795990eba0e5/content HTTP/1.1" 200 0
127.0.0.1 - - [27/Jan/2023:03:18:58 +0000] "POST /v1/rb/definition HTTP/1.1" 201 267
127.0.0.6 - - [27/Jan/2023:03:23:02 +0000] "GET /v1/rb/definition/cf64c6bb-ea0c-407e-ab39-950f198ef0c0/03206f55-1008-47cc-9224-795990eba0e5 HTTP/1.1" 200 270
127.0.0.6 - - [27/Jan/2023:03:23:02 +0000] "GET /v1/rb/definition/cf64c6bb-ea0c-407e-ab39-950f198ef0c0/03206f55-1008-47cc-9224-795990eba0e5/profile/cnftest HTTP/1.1" 404 87
127.0.0.6 - - [27/Jan/2023:03:23:03 +0000] "POST /v1/rb/definition/cf64c6bb-ea0c-407e-ab39-950f198ef0c0/03206f55-1008-47cc-9224-795990eba0e5/profile HTTP/1.1" 201 240
127.0.0.6 - - [27/Jan/2023:03:23:03 +0000] "GET /v1/rb/definition/cf64c6bb-ea0c-407e-ab39-950f198ef0c0/03206f55-1008-47cc-9224-795990eba0e5/profile/cnftest HTTP/1.1" 200 240
127.0.0.6 - - [27/Jan/2023:03:23:03 +0000] "POST /v1/rb/definition/cf64c6bb-ea0c-407e-ab39-950f198ef0c0/03206f55-1008-47cc-9224-795990eba0e5/profile/cnftest/content HTTP/1.1" 200 0
127.0.0.6 - - [27/Jan/2023:03:36:43 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 200 7665
127.0.0.6 - - [27/Jan/2023:03:37:14 +0000] "GET /v1/rb/definition/cf64c6bb-ea0c-407e-ab39-950f198ef0c0/03206f55-1008-47cc-9224-795990eba0e5 HTTP/1.1" 200 270
127.0.0.6 - - [27/Jan/2023:03:37:14 +0000] "GET /v1/rb/definition/cf64c6bb-ea0c-407e-ab39-950f198ef0c0/03206f55-1008-47cc-9224-795990eba0e5/profile/cnftest HTTP/1.1" 200 240
127.0.0.6 - - [27/Jan/2023:04:11:12 +0000] "GET /v1/connectivity-info/k8sregion HTTP/1.1" 200 7665
127.0.0.6 - - [27/Jan/2023:04:11:43 +0000] "GET /v1/rb/definition/cf64c6bb-ea0c-407e-ab39-950f198ef0c0/03206f55-1008-47cc-9224-795990eba0e5 HTTP/1.1" 200 270
127.0.0.6 - - [27/Jan/2023:04:11:43 +0000] "GET /v1/rb/definition/cf64c6bb-ea0c-407e-ab39-950f198ef0c0/03206f55-1008-47cc-9224-795990eba0e5/profile/cnftest HTTP/1.1" 200 240
127.0.0.6 - - [27/Jan/2023:04:24:26 +0000] "GET /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 500 74
127.0.0.6 - - [27/Jan/2023:04:24:26 +0000] "POST /v1/connectivity-info HTTP/1.1" 201 7675
127.0.0.6 - - [27/Jan/2023:04:24:26 +0000] "GET /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 200 7675
127.0.0.6 - - [27/Jan/2023:04:24:26 +0000] "POST /v1/rb/definition HTTP/1.1" 201 125
127.0.0.6 - - [27/Jan/2023:04:24:26 +0000] "GET /v1/rb/definition/pnf-cnf-rb-760fc6dc-d950-454e-92d7-7cb17ae8a1c1/v1 HTTP/1.1" 200 125
127.0.0.6 - - [27/Jan/2023:04:24:26 +0000] "POST /v1/rb/definition/pnf-cnf-rb-760fc6dc-d950-454e-92d7-7cb17ae8a1c1/v1/content HTTP/1.1" 200 0
127.0.0.6 - - [27/Jan/2023:04:24:26 +0000] "GET /v1/rb/definition/pnf-cnf-rb-760fc6dc-d950-454e-92d7-7cb17ae8a1c1/v1 HTTP/1.1" 200 138
127.0.0.6 - - [27/Jan/2023:04:24:26 +0000] "POST /v1/rb/definition/pnf-cnf-rb-760fc6dc-d950-454e-92d7-7cb17ae8a1c1/v1/profile HTTP/1.1" 201 314
127.0.0.6 - - [27/Jan/2023:04:24:27 +0000] "GET /v1/rb/definition/pnf-cnf-rb-760fc6dc-d950-454e-92d7-7cb17ae8a1c1/v1/profile/pnf-cnf-profile-4b994ca1-ecd4-479b-a908-625d5594259c HTTP/1.1" 200 314
127.0.0.6 - - [27/Jan/2023:04:24:27 +0000] "POST /v1/rb/definition/pnf-cnf-rb-760fc6dc-d950-454e-92d7-7cb17ae8a1c1/v1/profile/pnf-cnf-profile-4b994ca1-ecd4-479b-a908-625d5594259c/content HTTP/1.1" 200 0
2023/01/27 04:24:27 Main rss info
2023/01/27 04:24:27 Path: /tmp/helm-tmpl-281446646/manifest-0
2023/01/27 04:24:27 Kind: Service
2023/01/27 04:24:27 Path: /tmp/helm-tmpl-281446646/manifest-1
2023/01/27 04:24:27 Kind: Service
2023/01/27 04:24:27 Path: /tmp/helm-tmpl-281446646/manifest-2
2023/01/27 04:24:27 Kind: Pod
2023/01/27 04:24:27 Path: /tmp/helm-tmpl-281446646/manifest-3
2023/01/27 04:24:27 Kind: Deployment
2023/01/27 04:24:27 Crd rss info
2023/01/27 04:24:27 Hook info
{"filepath":"/tmp/helm-tmpl-281446646/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2023-01-27T04:24:27Z"}
{"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator-mongo","time":"2023-01-27T04:24:27Z"}
{"filepath":"/tmp/helm-tmpl-281446646/manifest-1","level":"info","msg":"Processing Kubernetes Resource","time":"2023-01-27T04:24:27Z"}
{"error":"Create Service error: Service \"pnf-macro-test-simulator\" is invalid: spec.ports[0].nodePort: Invalid value: 30999: provided port is already allocated","filepath":"/tmp/helm-tmpl-281446646/manifest-1","gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"error","msg":"Error Creating Resource","time":"2023-01-27T04:24:27Z"}
2023/01/27 04:24:27 [Instance] Reverting created resources on Error: Error creating kind: /v1, Kind=Service: Error in plugin Service plugin: Create Service error: Service "pnf-macro-test-simulator" is invalid: spec.ports[0].nodePort: Invalid value: 30999: provided port is already allocated
{"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"warning","msg":"Deleting Resource","resource":"pnf-macro-test-simulator-mongo","time":"2023-01-27T04:24:27Z"}
2023/01/27 04:24:27 Deleting service: pnf-macro-test-simulator-mongo
2023/01/27 04:24:27 Instance: wonderful_blackwell, Main rss are failed, skip post-install and remove instance in DB
2023/01/27 04:24:27 Deleted Obj with ID ObjectID("63d351fbb08391d1c3eb3a20")
2023/01/27 04:24:27 Deleted Obj with ID ObjectID("63d351fca74c86542b855b83")
{"error":"Create Kubernetes Resources: Error creating kind: /v1, Kind=Service: Error in plugin Service plugin: Create Service error: Service \"pnf-macro-test-simulator\" is invalid: spec.ports[0].nodePort: Invalid value: 30999: provided port is already allocated","level":"error","msg":"Error Creating Resource","resource":{"rb-name":"pnf-cnf-rb-760fc6dc-d950-454e-92d7-7cb17ae8a1c1","rb-version":"v1","profile-name":"pnf-cnf-profile-4b994ca1-ecd4-479b-a908-625d5594259c","release-name":"","cloud-region":"k8sregion-pnf-macro","labels":{},"override-values":{}},"time":"2023-01-27T04:24:27Z"}
127.0.0.6 - - [27/Jan/2023:04:24:27 +0000] "POST /v1/instance HTTP/1.1" 500 251
127.0.0.6 - - [27/Jan/2023:04:24:27 +0000] "GET /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 200 7675
2023/01/27 04:24:27 Deleted Obj with ID ObjectID("63d351fab08391d1c3eb3a18")
127.0.0.6 - - [27/Jan/2023:04:24:27 +0000] "DELETE /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 204 0
2023/01/27 04:24:27 Deleted Obj with ID ObjectID("63d351fba74c86542b855b48")
127.0.0.6 - - [27/Jan/2023:04:25:52 +0000] "GET /v1/connectivity-info/k8sregion-cnf-macro HTTP/1.1" 500 74
127.0.0.6 - - [27/Jan/2023:04:25:52 +0000] "POST /v1/connectivity-info HTTP/1.1" 201 7682
127.0.0.6 - - [27/Jan/2023:04:25:52 +0000] "GET /v1/connectivity-info/k8sregion-cnf-macro HTTP/1.1" 200 7682
127.0.0.1 - - [27/Jan/2023:04:26:04 +0000] "POST /v1/rb/definition HTTP/1.1" 201 286
127.0.0.1 - - [27/Jan/2023:04:26:04 +0000] "POST /v1/rb/definition HTTP/1.1" 201 271
127.0.0.1 - - [27/Jan/2023:04:26:04 +0000] "POST /v1/rb/definition/73ebd0b2-7b3c-46f3-995a-9be48048a1b5/59341115-f051-4f1b-a637-2470e400fa7d/content HTTP/1.1" 200 0
127.0.0.1 - - [27/Jan/2023:04:26:18 +0000] "POST /v1/rb/definition HTTP/1.1" 201 272
127.0.0.6 - - [27/Jan/2023:04:29:12 +0000] "GET /v1/rb/definition/73ebd0b2-7b3c-46f3-995a-9be48048a1b5/59341115-f051-4f1b-a637-2470e400fa7d HTTP/1.1" 200 277
127.0.0.6 - - [27/Jan/2023:04:29:12 +0000] "GET /v1/rb/definition/73ebd0b2-7b3c-46f3-995a-9be48048a1b5/59341115-f051-4f1b-a637-2470e400fa7d/profile/node-port-profile HTTP/1.1" 404 87
127.0.0.6 - - [27/Jan/2023:04:29:12 +0000] "POST /v1/rb/definition/73ebd0b2-7b3c-46f3-995a-9be48048a1b5/59341115-f051-4f1b-a637-2470e400fa7d/profile HTTP/1.1" 201 270
127.0.0.6 - - [27/Jan/2023:04:29:12 +0000] "POST /v1/rb/definition/73ebd0b2-7b3c-46f3-995a-9be48048a1b5/59341115-f051-4f1b-a637-2470e400fa7d/profile/node-port-profile/content HTTP/1.1" 200 0
127.0.0.6 - - [27/Jan/2023:04:29:24 +0000] "GET /v1/rb/definition/73ebd0b2-7b3c-46f3-995a-9be48048a1b5/59341115-f051-4f1b-a637-2470e400fa7d HTTP/1.1" 200 277
127.0.0.6 - - [27/Jan/2023:04:29:24 +0000] "GET /v1/rb/definition/73ebd0b2-7b3c-46f3-995a-9be48048a1b5/59341115-f051-4f1b-a637-2470e400fa7d/config-template/replica-count-template HTTP/1.1" 500 78
2023/01/27 04:29:24 [ConfigiTemplate]: create 73ebd0b2-7b3c-46f3-995a-9be48048a1b5
127.0.0.6 - - [27/Jan/2023:04:29:24 +0000] "POST /v1/rb/definition/73ebd0b2-7b3c-46f3-995a-9be48048a1b5/59341115-f051-4f1b-a637-2470e400fa7d/config-template HTTP/1.1" 201 113
2023/01/27 04:29:24 [ConfigTemplate]: Upload replica-count-template
127.0.0.6 - - [27/Jan/2023:04:29:24 +0000] "POST /v1/rb/definition/73ebd0b2-7b3c-46f3-995a-9be48048a1b5/59341115-f051-4f1b-a637-2470e400fa7d/config-template/replica-count-template/content HTTP/1.1" 200 0
2023/01/27 04:29:27 Main rss info
2023/01/27 04:29:27 Path: /tmp/helm-tmpl-835923020/manifest-0
2023/01/27 04:29:27 Kind: Service
2023/01/27 04:29:27 Path: /tmp/helm-tmpl-835923020/manifest-1
2023/01/27 04:29:27 Kind: Deployment
2023/01/27 04:29:27 Crd rss info
2023/01/27 04:29:27 Hook info
{"filepath":"/tmp/helm-tmpl-835923020/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2023-01-27T04:29:27Z"}
{"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"rel-1-apache","time":"2023-01-27T04:29:27Z"}
{"filepath":"/tmp/helm-tmpl-835923020/manifest-1","level":"info","msg":"Processing Kubernetes Resource","time":"2023-01-27T04:29:27Z"}
2023/01/27 04:29:27 No plugin for kind Deployment found. Using generic Plugin
{"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"info","msg":"Created Kubernetes Resource","resource":"rel-1-apache","time":"2023-01-27T04:29:27Z"}
127.0.0.6 - - [27/Jan/2023:04:29:27 +0000] "POST /v1/instance HTTP/1.1" 201 1281
2023/01/27 04:29:28 Deployment is not ready: onap-tests/rel-1-apache. 0 out of 1 expected pods are ready
127.0.0.6 - - [27/Jan/2023:04:29:28 +0000] "GET /v1/instance/lucid_goldberg/status HTTP/1.1" 200 14548
{"instance":"lucid_goldberg","level":"info","msg":"[START] status notify thread for ","time":"2023-01-27T04:29:50Z"}
{"instance":"lucid_goldberg","level":"info","msg":"REFRESH WATCHERS","subscription":"lucid_goldberg-cnf-adapter","time":"2023-01-27T04:29:55Z"}
{"Instance":"lucid_goldberg","Kind":"Pod","Subscription":"lucid_goldberg-cnf-adapter","level":"info","msg":"[START] Watcher","time":"2023-01-27T04:29:55Z"}
{"Instance":"lucid_goldberg","Kind":"Deployment","Subscription":"lucid_goldberg-cnf-adapter","level":"info","msg":"[START] Watcher","time":"2023-01-27T04:29:55Z"}
{"Instance":"lucid_goldberg","Kind":"Service","Subscription":"lucid_goldberg-cnf-adapter","level":"info","msg":"[START] Watcher","time":"2023-01-27T04:29:55Z"}
{"InstanceId":"lucid_goldberg","SubscriptionName":"lucid_goldberg-cnf-adapter","level":"info","msg":"Successfully created Status Subscription","time":"2023-01-27T04:29:55Z"}
127.0.0.6 - - [27/Jan/2023:04:29:50 +0000] "POST /v1/instance/lucid_goldberg/status/subscription HTTP/1.1" 201 648
{"InstanceId":"lucid_goldberg","SubscriptionName":"lucid_goldberg-cnf-adapter","level":"info","msg":"[START] status verification thread","time":"2023-01-27T04:30:00Z"}
2023/01/27 04:30:01 Deployment is not ready: onap-tests/rel-1-apache. 0 out of 1 expected pods are ready
127.0.0.6 - - [27/Jan/2023:04:30:01 +0000] "GET /v1/instance/lucid_goldberg/status HTTP/1.1" 200 14888
2023/01/27 04:30:11 Deployment is not ready: onap-tests/rel-1-apache. 0 out of 1 expected pods are ready
127.0.0.6 - - [27/Jan/2023:04:30:11 +0000] "GET /v1/instance/lucid_goldberg/status HTTP/1.1" 200 14888
127.0.0.6 - - [27/Jan/2023:04:30:21 +0000] "GET /v1/instance/lucid_goldberg/status HTTP/1.1" 200 14700
2023/01/27 04:30:21 [scheduleResources]: START thread
127.0.0.6 - - [27/Jan/2023:04:30:21 +0000] "GET /v1/instance/lucid_goldberg/config/replica-count-change HTTP/1.1" 500 60
2023/01/27 04:30:26 [Config Create] Instance lucid_goldberg
2023/01/27 04:30:26 [ConfigTemplate]: Download replica-count-template
2023/01/27 04:30:26 Before Sent to goroutine {73ebd0b2-7b3c-46f3-995a-9be48048a1b5 59341115-f051-4f1b-a637-2470e400fa7d node-port-profile node-port-profile onap-tests 1.19.0 map[] []}
2023/01/27 04:30:26 Message Sent to goroutine {73ebd0b2-7b3c-46f3-995a-9be48048a1b5 59341115-f051-4f1b-a637-2470e400fa7d node-port-profile node-port-profile onap-tests 1.19.0 map[] []}
2023/01/27 04:30:26 [scheduleResources]: POST {73ebd0b2-7b3c-46f3-995a-9be48048a1b5 59341115-f051-4f1b-a637-2470e400fa7d node-port-profile node-port-profile onap-tests 1.19.0 map[] []} [{apps/v1, Kind=Deployment /tmp/helm-tmpl-416560074/manifest-0}]
{"filepath":"/tmp/helm-tmpl-416560074/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2023-01-27T04:30:26Z"}
2023/01/27 04:30:26 No plugin for kind Deployment found. Using generic Plugin
{"error":"Create object error: deployments.apps \"rel-1-apache\" already exists","filepath":"/tmp/helm-tmpl-416560074/manifest-0","gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"error","msg":"Error Creating Resource","time":"2023-01-27T04:30:26Z"}
{"filepath":"/tmp/helm-tmpl-416560074/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2023-01-27T04:30:26Z"}
2023/01/27 04:30:26 No plugin for kind Deployment found. Using generic Plugin
{"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"info","msg":"Updated Kubernetes Resource","resource":"rel-1-apache","time":"2023-01-27T04:30:26Z"}
2023/01/27 04:30:26 POST result: [{{apps/v1, Kind=Deployment rel-1-apache} UPDATED}]
127.0.0.6 - - [27/Jan/2023:04:30:26 +0000] "POST /v1/instance/lucid_goldberg/config HTTP/1.1" 201 266
2023/01/27 04:30:26 Deployment is not ready: onap-tests/rel-1-apache. 1 out of 2 expected pods are ready
127.0.0.6 - - [27/Jan/2023:04:30:26 +0000] "GET /v1/instance/lucid_goldberg/status HTTP/1.1" 200 20950
{"Instance":"lucid_goldberg","Subscription":"lucid_goldberg-cnf-adapter","level":"info","msg":"CHANGE DETECTED","time":"2023-01-27T04:30:35Z"}
{"Kind":"Pod","Name":"rel-1-apache-7b4fb945c7-n9jv7","level":"info","msg":"CREATED","time":"2023-01-27T04:30:35Z"}
{"Kind":"Deployment","Name":"rel-1-apache","level":"info","msg":"MODIFIED","time":"2023-01-27T04:30:35Z"}
{"Kind":"Pod","Name":"rel-1-apache-7b4fb945c7-4fdbq","level":"info","msg":"MODIFIED","time":"2023-01-27T04:30:35Z"}
2023/01/27 04:30:35 Deployment is not ready: onap-tests/rel-1-apache. 1 out of 2 expected pods are ready
127.0.0.6 - - [27/Jan/2023:04:30:35 +0000] "GET /v1/instance/lucid_goldberg/status HTTP/1.1" 200 20950
2023/01/27 04:30:36 Deployment is not ready: onap-tests/rel-1-apache. 1 out of 2 expected pods are ready
127.0.0.6 - - [27/Jan/2023:04:30:36 +0000] "GET /v1/instance/lucid_goldberg/status HTTP/1.1" 200 20950
{"InstanceId":"lucid_goldberg","Result":202,"SubscriptionName":"lucid_goldberg-cnf-adapter","level":"info","msg":"Notification sent","time":"2023-01-27T04:30:37Z"}
2023/01/27 04:30:46 Deployment is not ready: onap-tests/rel-1-apache. 1 out of 2 expected pods are ready
127.0.0.6 - - [27/Jan/2023:04:30:46 +0000] "GET /v1/instance/lucid_goldberg/status HTTP/1.1" 200 21290
2023/01/27 04:30:57 Deployment is not ready: onap-tests/rel-1-apache. 1 out of 2 expected pods are ready
127.0.0.6 - - [27/Jan/2023:04:30:56 +0000] "GET /v1/instance/lucid_goldberg/status HTTP/1.1" 200 21290
2023/01/27 04:31:07 Deployment is not ready: onap-tests/rel-1-apache. 1 out of 2 expected pods are ready
127.0.0.6 - - [27/Jan/2023:04:31:07 +0000] "GET /v1/instance/lucid_goldberg/status HTTP/1.1" 200 21290
{"Instance":"lucid_goldberg","Subscription":"lucid_goldberg-cnf-adapter","level":"info","msg":"CHANGE DETECTED","time":"2023-01-27T04:31:07Z"}
{"Kind":"Pod","Name":"rel-1-apache-7b4fb945c7-n9jv7","level":"info","msg":"MODIFIED","time":"2023-01-27T04:31:07Z"}
2023/01/27 04:31:07 Deployment is not ready: onap-tests/rel-1-apache. 1 out of 2 expected pods are ready
127.0.0.6 - - [27/Jan/2023:04:31:07 +0000] "GET /v1/instance/lucid_goldberg/status HTTP/1.1" 200 21290
{"InstanceId":"lucid_goldberg","Result":202,"SubscriptionName":"lucid_goldberg-cnf-adapter","level":"info","msg":"Notification sent","time":"2023-01-27T04:31:09Z"}
127.0.0.6 - - [27/Jan/2023:04:31:17 +0000] "GET /v1/instance/lucid_goldberg/status HTTP/1.1" 200 20998
{"Instance":"lucid_goldberg","Kind":"Deployment","Subscription":"lucid_goldberg-cnf-adapter","level":"info","msg":"[STOP] Watcher","time":"2023-01-27T04:31:34Z"}
{"Instance":"lucid_goldberg","Kind":"Pod","Subscription":"lucid_goldberg-cnf-adapter","level":"info","msg":"[STOP] Watcher","time":"2023-01-27T04:31:34Z"}
{"Instance":"lucid_goldberg","Kind":"Service","Subscription":"lucid_goldberg-cnf-adapter","level":"info","msg":"[STOP] Watcher","time":"2023-01-27T04:31:34Z"}
2023/01/27 04:31:34 Deleted Obj with ID ObjectID("63d35343b08391d1c3eb3a33")
2023/01/27 04:31:34 Deleted Obj with ID ObjectID("63d35345a74c86542b855cda")
127.0.0.6 - - [27/Jan/2023:04:31:34 +0000] "DELETE /v1/instance/lucid_goldberg/status/subscription/lucid_goldberg-cnf-adapter HTTP/1.1" 202 0
2023/01/27 04:31:34 [Config Cleanup] Instance lucid_goldberg
2023/01/27 04:31:34 [Config Delete] Instance lucid_goldberg Config replica-count-change
2023/01/27 04:31:34 [ConfigTemplate]: Download replica-count-template
2023/01/27 04:31:34 Before Sent to goroutine {73ebd0b2-7b3c-46f3-995a-9be48048a1b5 59341115-f051-4f1b-a637-2470e400fa7d node-port-profile node-port-profile onap-tests 1.19.0 map[] []}
2023/01/27 04:31:34 Message Sent to goroutine {73ebd0b2-7b3c-46f3-995a-9be48048a1b5 59341115-f051-4f1b-a637-2470e400fa7d node-port-profile node-port-profile onap-tests 1.19.0 map[] []}
2023/01/27 04:31:34 [scheduleResources]: DELETE {73ebd0b2-7b3c-46f3-995a-9be48048a1b5 59341115-f051-4f1b-a637-2470e400fa7d node-port-profile node-port-profile onap-tests 1.19.0 map[] []} [{{apps/v1, Kind=Deployment rel-1-apache} UPDATED}]
{"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"warning","msg":"Deleting Resource","resource":"rel-1-apache","time":"2023-01-27T04:31:34Z"}
2023/01/27 04:31:34 No plugin for kind Deployment found. Using generic Plugin
2023/01/27 04:31:34 DELETE resources: [[{{apps/v1, Kind=Deployment rel-1-apache} UPDATED}]]
2023/01/27 04:31:34 [Config Delete All] Instance lucid_goldberg Config replica-count-change
2023/01/27 04:31:34 Stop config thread for lucid_goldberg
{"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"warning","msg":"Deleting Resource","resource":"rel-1-apache","time":"2023-01-27T04:31:34Z"}
2023/01/27 04:31:34 No plugin for kind Deployment found. Using generic Plugin
2023/01/27 04:31:34 [scheduleResources]: STOP thread
{"gvk":{"Group":"apps","Version":"v1","Kind":"Deployment"},"level":"warning","msg":"Resource already does not exist","resource":"rel-1-apache","time":"2023-01-27T04:31:34Z"}
{"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"warning","msg":"Deleting Resource","resource":"rel-1-apache","time":"2023-01-27T04:31:34Z"}
2023/01/27 04:31:34 Deleting service: rel-1-apache
{"instance":"lucid_goldberg","level":"info","msg":"[STOP] status notify thread for ","time":"2023-01-27T04:31:34Z"}
2023/01/27 04:31:34 Deleted Obj with ID ObjectID("63d35327b08391d1c3eb3a32")
2023/01/27 04:31:34 Deleted Obj with ID ObjectID("63d35328a74c86542b855cb7")
127.0.0.6 - - [27/Jan/2023:04:31:34 +0000] "DELETE /v1/instance/lucid_goldberg HTTP/1.1" 202 0
{"instance":"lucid_goldberg","level":"info","msg":"[START] status notify thread for ","time":"2023-01-27T04:31:39Z"}
{"InstanceId":"lucid_goldberg","SubscriptionName":"lucid_goldberg-cnf-adapter","level":"info","msg":"[STOP] status verification thread","time":"2023-01-27T04:31:44Z"}
127.0.0.6 - - [27/Jan/2023:04:31:52 +0000] "GET /v1/connectivity-info/k8sregion-cnf-macro HTTP/1.1" 200 7682
2023/01/27 04:31:52 Deleted Obj with ID ObjectID("63d35250b08391d1c3eb3a21")
127.0.0.6 - - [27/Jan/2023:04:31:52 +0000] "DELETE /v1/connectivity-info/k8sregion-cnf-macro HTTP/1.1" 204 0
2023/01/27 04:31:52 Deleted Obj with ID ObjectID("63d35251a74c86542b855bc9")
127.0.0.6 - - [27/Jan/2023:04:33:10 +0000] "GET /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 500 74
127.0.0.6 - - [27/Jan/2023:04:33:10 +0000] "POST /v1/connectivity-info HTTP/1.1" 201 7675
127.0.0.6 - - [27/Jan/2023:04:33:10 +0000] "GET /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 200 7675
127.0.0.6 - - [27/Jan/2023:04:33:10 +0000] "POST /v1/rb/definition HTTP/1.1" 201 125
127.0.0.6 - - [27/Jan/2023:04:33:10 +0000] "GET /v1/rb/definition/pnf-cnf-rb-44f1cf41-95d9-45a1-b2c1-3b72895ceb47/v1 HTTP/1.1" 200 125
127.0.0.6 - - [27/Jan/2023:04:33:10 +0000] "POST /v1/rb/definition/pnf-cnf-rb-44f1cf41-95d9-45a1-b2c1-3b72895ceb47/v1/content HTTP/1.1" 200 0
127.0.0.6 - - [27/Jan/2023:04:33:11 +0000] "GET /v1/rb/definition/pnf-cnf-rb-44f1cf41-95d9-45a1-b2c1-3b72895ceb47/v1 HTTP/1.1" 200 138
127.0.0.6 - - [27/Jan/2023:04:33:11 +0000] "POST /v1/rb/definition/pnf-cnf-rb-44f1cf41-95d9-45a1-b2c1-3b72895ceb47/v1/profile HTTP/1.1" 201 314
127.0.0.6 - - [27/Jan/2023:04:33:11 +0000] "GET /v1/rb/definition/pnf-cnf-rb-44f1cf41-95d9-45a1-b2c1-3b72895ceb47/v1/profile/pnf-cnf-profile-f1e91952-5b66-42a5-acdc-2efc692b4a5c HTTP/1.1" 200 314
127.0.0.6 - - [27/Jan/2023:04:33:11 +0000] "POST /v1/rb/definition/pnf-cnf-rb-44f1cf41-95d9-45a1-b2c1-3b72895ceb47/v1/profile/pnf-cnf-profile-f1e91952-5b66-42a5-acdc-2efc692b4a5c/content HTTP/1.1" 200 0
2023/01/27 04:33:11 Main rss info
2023/01/27 04:33:11 Path: /tmp/helm-tmpl-672644853/manifest-0
2023/01/27 04:33:11 Kind: Service
2023/01/27 04:33:11 Path: /tmp/helm-tmpl-672644853/manifest-1
2023/01/27 04:33:11 Kind: Service
2023/01/27 04:33:11 Path: /tmp/helm-tmpl-672644853/manifest-2
2023/01/27 04:33:11 Kind: Pod
2023/01/27 04:33:11 Path: /tmp/helm-tmpl-672644853/manifest-3
2023/01/27 04:33:11 Kind: Deployment
2023/01/27 04:33:11 Crd rss info
2023/01/27 04:33:11 Hook info
{"filepath":"/tmp/helm-tmpl-672644853/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2023-01-27T04:33:11Z"}
{"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator-mongo","time":"2023-01-27T04:33:11Z"}
{"filepath":"/tmp/helm-tmpl-672644853/manifest-1","level":"info","msg":"Processing Kubernetes Resource","time":"2023-01-27T04:33:11Z"}
{"error":"Create Service error: Service \"pnf-macro-test-simulator\" is invalid: spec.ports[0].nodePort: Invalid value: 30999: provided port is already allocated","filepath":"/tmp/helm-tmpl-672644853/manifest-1","gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"error","msg":"Error Creating Resource","time":"2023-01-27T04:33:11Z"}
2023/01/27 04:33:11 [Instance] Reverting created resources on Error: Error creating kind: /v1, Kind=Service: Error in plugin Service plugin: Create Service error: Service "pnf-macro-test-simulator" is invalid: spec.ports[0].nodePort: Invalid value: 30999: provided port is already allocated
{"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"warning","msg":"Deleting Resource","resource":"pnf-macro-test-simulator-mongo","time":"2023-01-27T04:33:11Z"}
2023/01/27 04:33:11 Deleting service: pnf-macro-test-simulator-mongo
2023/01/27 04:33:11 Instance: peaceful_taussig, Main rss are failed, skip post-install and remove instance in DB
2023/01/27 04:33:11 Deleted Obj with ID ObjectID("63d35407b08391d1c3eb3a3c")
2023/01/27 04:33:11 Deleted Obj with ID ObjectID("63d35408a74c86542b855e5a")
{"error":"Create Kubernetes Resources: Error creating kind: /v1, Kind=Service: Error in plugin Service plugin: Create Service error: Service \"pnf-macro-test-simulator\" is invalid: spec.ports[0].nodePort: Invalid value: 30999: provided port is already allocated","level":"error","msg":"Error Creating Resource","resource":{"rb-name":"pnf-cnf-rb-44f1cf41-95d9-45a1-b2c1-3b72895ceb47","rb-version":"v1","profile-name":"pnf-cnf-profile-f1e91952-5b66-42a5-acdc-2efc692b4a5c","release-name":"","cloud-region":"k8sregion-pnf-macro","labels":{},"override-values":{}},"time":"2023-01-27T04:33:11Z"}
127.0.0.6 - - [27/Jan/2023:04:33:11 +0000] "POST /v1/instance HTTP/1.1" 500 251
127.0.0.6 - - [27/Jan/2023:04:33:11 +0000] "GET /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 200 7675
2023/01/27 04:33:11 Deleted Obj with ID ObjectID("63d35406b08391d1c3eb3a34")
2023/01/27 04:33:11 Deleted Obj with ID ObjectID("63d35408a74c86542b855e1f")
127.0.0.6 - - [27/Jan/2023:04:33:11 +0000] "DELETE /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 204 0
127.0.0.6 - - [27/Jan/2023:05:09:11 +0000] "GET /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 500 74
127.0.0.6 - - [27/Jan/2023:05:09:11 +0000] "POST /v1/connectivity-info HTTP/1.1" 201 7675
127.0.0.6 - - [27/Jan/2023:05:09:11 +0000] "GET /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 200 7675
127.0.0.6 - - [27/Jan/2023:05:09:11 +0000] "POST /v1/rb/definition HTTP/1.1" 201 125
127.0.0.6 - - [27/Jan/2023:05:09:11 +0000] "GET /v1/rb/definition/pnf-cnf-rb-eedae42c-01bf-4e95-814c-1e6829f432ac/v1 HTTP/1.1" 200 125
127.0.0.6 - - [27/Jan/2023:05:09:11 +0000] "POST /v1/rb/definition/pnf-cnf-rb-eedae42c-01bf-4e95-814c-1e6829f432ac/v1/content HTTP/1.1" 200 0
127.0.0.6 - - [27/Jan/2023:05:09:11 +0000] "GET /v1/rb/definition/pnf-cnf-rb-eedae42c-01bf-4e95-814c-1e6829f432ac/v1 HTTP/1.1" 200 138
127.0.0.6 - - [27/Jan/2023:05:09:11 +0000] "POST /v1/rb/definition/pnf-cnf-rb-eedae42c-01bf-4e95-814c-1e6829f432ac/v1/profile HTTP/1.1" 201 314
127.0.0.6 - - [27/Jan/2023:05:09:11 +0000] "GET /v1/rb/definition/pnf-cnf-rb-eedae42c-01bf-4e95-814c-1e6829f432ac/v1/profile/pnf-cnf-profile-1ec4dc91-d9e9-4e47-8827-0a70b07b4df4 HTTP/1.1" 200 314
127.0.0.6 - - [27/Jan/2023:05:09:11 +0000] "POST /v1/rb/definition/pnf-cnf-rb-eedae42c-01bf-4e95-814c-1e6829f432ac/v1/profile/pnf-cnf-profile-1ec4dc91-d9e9-4e47-8827-0a70b07b4df4/content HTTP/1.1" 200 0
2023/01/27 05:09:12 Main rss info
2023/01/27 05:09:12 Path: /tmp/helm-tmpl-590466564/manifest-0
2023/01/27 05:09:12 Kind: Service
2023/01/27 05:09:12 Path: /tmp/helm-tmpl-590466564/manifest-1
2023/01/27 05:09:12 Kind: Service
2023/01/27 05:09:12 Path: /tmp/helm-tmpl-590466564/manifest-2
2023/01/27 05:09:12 Kind: Pod
2023/01/27 05:09:12 Path: /tmp/helm-tmpl-590466564/manifest-3
2023/01/27 05:09:12 Kind: Deployment
2023/01/27 05:09:12 Crd rss info
2023/01/27 05:09:12 Hook info
{"filepath":"/tmp/helm-tmpl-590466564/manifest-0","level":"info","msg":"Processing Kubernetes Resource","time":"2023-01-27T05:09:12Z"}
{"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"info","msg":"Created Kubernetes Resource","resource":"pnf-macro-test-simulator-mongo","time":"2023-01-27T05:09:12Z"}
{"filepath":"/tmp/helm-tmpl-590466564/manifest-1","level":"info","msg":"Processing Kubernetes Resource","time":"2023-01-27T05:09:12Z"}
{"error":"Create Service error: Service \"pnf-macro-test-simulator\" is invalid: spec.ports[0].nodePort: Invalid value: 30999: provided port is already allocated","filepath":"/tmp/helm-tmpl-590466564/manifest-1","gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"error","msg":"Error Creating Resource","time":"2023-01-27T05:09:12Z"}
2023/01/27 05:09:12 [Instance] Reverting created resources on Error: Error creating kind: /v1, Kind=Service: Error in plugin Service plugin: Create Service error: Service "pnf-macro-test-simulator" is invalid: spec.ports[0].nodePort: Invalid value: 30999: provided port is already allocated
{"gvk":{"Group":"","Version":"v1","Kind":"Service"},"level":"warning","msg":"Deleting Resource","resource":"pnf-macro-test-simulator-mongo","time":"2023-01-27T05:09:12Z"}
2023/01/27 05:09:12 Deleting service: pnf-macro-test-simulator-mongo
2023/01/27 05:09:12 Instance: ecstatic_leakey, Main rss are failed, skip post-install and remove instance in DB
2023/01/27 05:09:12 Deleted Obj with ID ObjectID("63d35c78b08391d1c3eb3a45")
2023/01/27 05:09:12 Deleted Obj with ID ObjectID("63d35c79a74c86542b8563d4")
{"error":"Create Kubernetes Resources: Error creating kind: /v1, Kind=Service: Error in plugin Service plugin: Create Service error: Service \"pnf-macro-test-simulator\" is invalid: spec.ports[0].nodePort: Invalid value: 30999: provided port is already allocated","level":"error","msg":"Error Creating Resource","resource":{"rb-name":"pnf-cnf-rb-eedae42c-01bf-4e95-814c-1e6829f432ac","rb-version":"v1","profile-name":"pnf-cnf-profile-1ec4dc91-d9e9-4e47-8827-0a70b07b4df4","release-name":"","cloud-region":"k8sregion-pnf-macro","labels":{},"override-values":{}},"time":"2023-01-27T05:09:12Z"}
127.0.0.6 - - [27/Jan/2023:05:09:12 +0000] "POST /v1/instance HTTP/1.1" 500 251
127.0.0.6 - - [27/Jan/2023:05:09:12 +0000] "GET /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 200 7675
2023/01/27 05:09:12 Deleted Obj with ID ObjectID("63d35c77b08391d1c3eb3a3d")
2023/01/27 05:09:12 Deleted Obj with ID ObjectID("63d35c78a74c86542b856399")
127.0.0.6 - - [27/Jan/2023:05:09:12 +0000] "DELETE /v1/connectivity-info/k8sregion-pnf-macro HTTP/1.1" 204 0