sigs.k8s.io/cloud-provider-azure PR #269 chewong-cloud-provider-azure-multiple-zones #1205301865068105728
Recent runs || View in Spyglass
Recent runs || View in Spyglass
error creating cluster: cannot deploy: cannot get the create deployment future response: Code="DeploymentFailed" Message="At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/DeployOperations for usage details." Details=[{"code":"Conflict","message":"{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource operation completed with terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"VMExtensionProvisioningError\",\r\n \"message\": \"VM has reported a failure when processing extension 'k8s-master-80076048-vmssCSE'. Error message: \\\"Enable failed: failed to execute command: command terminated with exit status=99\\n[stdout]\\nFri Dec 13 02:04:04 UTC 2019,k8s-master-80076048-vmss000000\\n\\n[stderr]\\n\\\"\\r\\n\\r\\nMore information on troubleshooting is available at https://aka.ms/VMExtensionCSELinuxTroubleshoot \"\r\n }\r\n ]\r\n }\r\n}"},{"code":"Conflict","message":"{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource operation completed with terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"VMExtensionProvisioningError\",\r\n \"message\": \"VM has reported a failure when processing extension 'vmssCSE'. Error message: \\\"Enable failed: failed to execute command: command terminated with exit status=99\\n[stdout]\\nFri Dec 13 02:03:36 UTC 2019,k8s-agentpool-80076048-vmss000000\\n\\n[stderr]\\n\\\"\\r\\n\\r\\nMore information on troubleshooting is available at https://aka.ms/VMExtensionCSELinuxTroubleshoot \"\r\n }\r\n ]\r\n }\r\n}"}]
from junit_runner.xml
Filter through log files
Build
Deferred TearDown
DumpClusterLogs (--up failed)
TearDown Previous
Timeout
... skipping 518 lines ... I1213 01:43:35.899] .../coreos => go.etcd.io}/etcd/clientv3/sort.go | 0 I1213 01:43:35.899] .../coreos => go.etcd.io}/etcd/clientv3/txn.go | 2 +- I1213 01:43:35.899] vendor/go.etcd.io/etcd/clientv3/utils.go | 49 + I1213 01:43:35.899] .../coreos => go.etcd.io}/etcd/clientv3/watch.go | 219 +- I1213 01:43:35.899] .../etcd/etcdserver/api/v3rpc/rpctypes/BUILD.bazel | 5 +- I1213 01:43:35.899] .../etcd/etcdserver/api/v3rpc/rpctypes/doc.go | 0 I1213 01:43:35.899] .../etcd/etcdserver/api/v3rpc/rpctypes/error.go | 20 + I1213 01:43:35.900] .../etcd/etcdserver/api/v3rpc/rpctypes/md.go | 0 I1213 01:43:35.900] .../api/v3rpc/rpctypes/metadatafields.go | 20 + I1213 01:43:35.900] .../etcd/etcdserver/etcdserverpb/BUILD.bazel | 8 +- I1213 01:43:35.900] .../etcd/etcdserver/etcdserverpb/etcdserver.pb.go | 6 + I1213 01:43:35.900] .../etcd/etcdserver/etcdserverpb/etcdserver.proto | 0 I1213 01:43:35.900] .../etcdserver/etcdserverpb/raft_internal.pb.go | 226 +- ... skipping 76 lines ... I1213 01:43:35.913] vendor/go.uber.org/atomic/BUILD.bazel | 12 + I1213 01:43:35.913] vendor/go.uber.org/atomic/LICENSE.txt | 19 + I1213 01:43:35.913] vendor/go.uber.org/atomic/atomic.go | 351 + I1213 01:43:35.913] vendor/go.uber.org/atomic/string.go | 49 + I1213 01:43:35.914] vendor/go.uber.org/multierr/BUILD.bazel | 10 + I1213 01:43:35.914] vendor/go.uber.org/multierr/LICENSE.txt | 19 + I1213 01:43:35.914] vendor/go.uber.org/multierr/error.go | 401 + I1213 01:43:35.914] vendor/go.uber.org/zap/BUILD.bazel | 35 + I1213 01:43:35.914] vendor/go.uber.org/zap/LICENSE.txt | 19 + I1213 01:43:35.914] vendor/go.uber.org/zap/array.go | 320 + I1213 01:43:35.914] vendor/go.uber.org/zap/buffer/BUILD.bazel | 12 + I1213 01:43:35.915] vendor/go.uber.org/zap/buffer/buffer.go | 115 + I1213 01:43:35.915] vendor/go.uber.org/zap/buffer/pool.go | 49 + I1213 01:43:35.915] vendor/go.uber.org/zap/config.go | 243 + I1213 01:43:35.915] vendor/go.uber.org/zap/doc.go | 113 + I1213 01:43:35.915] vendor/go.uber.org/zap/encoder.go | 75 + I1213 01:43:35.915] vendor/go.uber.org/zap/error.go | 80 + I1213 01:43:35.915] vendor/go.uber.org/zap/field.go | 310 + I1213 01:43:35.916] vendor/go.uber.org/zap/flag.go | 39 + I1213 01:43:35.916] vendor/go.uber.org/zap/global.go | 168 + I1213 01:43:35.916] vendor/go.uber.org/zap/global_go112.go | 26 + I1213 01:43:35.916] vendor/go.uber.org/zap/global_prego112.go | 26 + I1213 01:43:35.916] vendor/go.uber.org/zap/http_handler.go | 81 + ... skipping 14 lines ... I1213 01:43:35.919] vendor/go.uber.org/zap/zapcore/BUILD.bazel | 34 + I1213 01:43:35.919] vendor/go.uber.org/zap/zapcore/console_encoder.go | 147 + I1213 01:43:35.919] vendor/go.uber.org/zap/zapcore/core.go | 113 + I1213 01:43:35.919] vendor/go.uber.org/zap/zapcore/doc.go | 24 + I1213 01:43:35.919] vendor/go.uber.org/zap/zapcore/encoder.go | 348 + I1213 01:43:35.919] vendor/go.uber.org/zap/zapcore/entry.go | 257 + I1213 01:43:35.919] vendor/go.uber.org/zap/zapcore/error.go | 120 + I1213 01:43:35.919] vendor/go.uber.org/zap/zapcore/field.go | 212 + I1213 01:43:35.920] vendor/go.uber.org/zap/zapcore/hook.go | 68 + I1213 01:43:35.920] vendor/go.uber.org/zap/zapcore/json_encoder.go | 505 ++ I1213 01:43:35.920] vendor/go.uber.org/zap/zapcore/level.go | 175 + I1213 01:43:35.920] vendor/go.uber.org/zap/zapcore/level_strings.go | 46 + I1213 01:43:35.920] vendor/go.uber.org/zap/zapcore/marshaler.go | 53 + ... skipping 989 lines ... I1213 01:43:36.061] rename vendor/{github.com/coreos => go.etcd.io}/etcd/clientv3/sort.go (100%) I1213 01:43:36.062] rename vendor/{github.com/coreos => go.etcd.io}/etcd/clientv3/txn.go (98%) I1213 01:43:36.062] create mode 100644 vendor/go.etcd.io/etcd/clientv3/utils.go I1213 01:43:36.062] rename vendor/{github.com/coreos => go.etcd.io}/etcd/clientv3/watch.go (77%) I1213 01:43:36.062] rename vendor/{github.com/coreos => go.etcd.io}/etcd/etcdserver/api/v3rpc/rpctypes/BUILD.bazel (65%) I1213 01:43:36.062] rename vendor/{github.com/coreos => go.etcd.io}/etcd/etcdserver/api/v3rpc/rpctypes/doc.go (100%) I1213 01:43:36.062] rename vendor/{github.com/coreos => go.etcd.io}/etcd/etcdserver/api/v3rpc/rpctypes/error.go (86%) I1213 01:43:36.062] rename vendor/{github.com/coreos => go.etcd.io}/etcd/etcdserver/api/v3rpc/rpctypes/md.go (100%) I1213 01:43:36.063] create mode 100644 vendor/go.etcd.io/etcd/etcdserver/api/v3rpc/rpctypes/metadatafields.go I1213 01:43:36.063] rename vendor/{github.com/coreos => go.etcd.io}/etcd/etcdserver/etcdserverpb/BUILD.bazel (64%) I1213 01:43:36.063] rename vendor/{github.com/coreos => go.etcd.io}/etcd/etcdserver/etcdserverpb/etcdserver.pb.go (99%) I1213 01:43:36.063] rename vendor/{github.com/coreos => go.etcd.io}/etcd/etcdserver/etcdserverpb/etcdserver.proto (100%) I1213 01:43:36.063] rename vendor/{github.com/coreos => go.etcd.io}/etcd/etcdserver/etcdserverpb/raft_internal.pb.go (86%) ... skipping 76 lines ... I1213 01:43:36.072] create mode 100644 vendor/go.uber.org/atomic/BUILD.bazel I1213 01:43:36.072] create mode 100644 vendor/go.uber.org/atomic/LICENSE.txt I1213 01:43:36.072] create mode 100644 vendor/go.uber.org/atomic/atomic.go I1213 01:43:36.072] create mode 100644 vendor/go.uber.org/atomic/string.go I1213 01:43:36.072] create mode 100644 vendor/go.uber.org/multierr/BUILD.bazel I1213 01:43:36.072] create mode 100644 vendor/go.uber.org/multierr/LICENSE.txt I1213 01:43:36.073] create mode 100644 vendor/go.uber.org/multierr/error.go I1213 01:43:36.073] create mode 100644 vendor/go.uber.org/zap/BUILD.bazel I1213 01:43:36.073] create mode 100644 vendor/go.uber.org/zap/LICENSE.txt I1213 01:43:36.073] create mode 100644 vendor/go.uber.org/zap/array.go I1213 01:43:36.073] create mode 100644 vendor/go.uber.org/zap/buffer/BUILD.bazel I1213 01:43:36.073] create mode 100644 vendor/go.uber.org/zap/buffer/buffer.go I1213 01:43:36.073] create mode 100644 vendor/go.uber.org/zap/buffer/pool.go I1213 01:43:36.073] create mode 100644 vendor/go.uber.org/zap/config.go I1213 01:43:36.074] create mode 100644 vendor/go.uber.org/zap/doc.go I1213 01:43:36.074] create mode 100644 vendor/go.uber.org/zap/encoder.go I1213 01:43:36.074] create mode 100644 vendor/go.uber.org/zap/error.go I1213 01:43:36.074] create mode 100644 vendor/go.uber.org/zap/field.go I1213 01:43:36.074] create mode 100644 vendor/go.uber.org/zap/flag.go I1213 01:43:36.074] create mode 100644 vendor/go.uber.org/zap/global.go I1213 01:43:36.074] create mode 100644 vendor/go.uber.org/zap/global_go112.go I1213 01:43:36.074] create mode 100644 vendor/go.uber.org/zap/global_prego112.go I1213 01:43:36.074] create mode 100644 vendor/go.uber.org/zap/http_handler.go ... skipping 14 lines ... I1213 01:43:36.076] create mode 100644 vendor/go.uber.org/zap/zapcore/BUILD.bazel I1213 01:43:36.076] create mode 100644 vendor/go.uber.org/zap/zapcore/console_encoder.go I1213 01:43:36.076] create mode 100644 vendor/go.uber.org/zap/zapcore/core.go I1213 01:43:36.076] create mode 100644 vendor/go.uber.org/zap/zapcore/doc.go I1213 01:43:36.076] create mode 100644 vendor/go.uber.org/zap/zapcore/encoder.go I1213 01:43:36.077] create mode 100644 vendor/go.uber.org/zap/zapcore/entry.go I1213 01:43:36.077] create mode 100644 vendor/go.uber.org/zap/zapcore/error.go I1213 01:43:36.077] create mode 100644 vendor/go.uber.org/zap/zapcore/field.go I1213 01:43:36.077] create mode 100644 vendor/go.uber.org/zap/zapcore/hook.go I1213 01:43:36.077] create mode 100644 vendor/go.uber.org/zap/zapcore/json_encoder.go I1213 01:43:36.077] create mode 100644 vendor/go.uber.org/zap/zapcore/level.go I1213 01:43:36.077] create mode 100644 vendor/go.uber.org/zap/zapcore/level_strings.go I1213 01:43:36.077] create mode 100644 vendor/go.uber.org/zap/zapcore/marshaler.go ... skipping 432 lines ... W1213 02:02:16.608] 2019/12/13 02:02:16 azure.go:781: Validating deployment ARM templates. W1213 02:02:17.883] 2019/12/13 02:02:17 azure.go:787: Deploying cluster kubetest-fcf368f4-1d49-11ea-8f8c-024283fcdaf9 in resource group kubetest-fcf368f4-1d49-11ea-8f8c-024283fcdaf9. W1213 02:07:19.093] 2019/12/13 02:07:19 process.go:153: Running: bash -c ./log-dump.sh I1213 02:07:19.194] Installing log-dump-daemonset.yaml via kubectl W1213 02:07:49.350] Unable to connect to the server: dial tcp 52.148.148.165:443: i/o timeout I1213 02:07:49.451] Uninstalling log-dump-daemonset.yaml via kubectl W1213 02:08:19.413] error: unable to recognize "/go/src/sigs.k8s.io/cloud-provider-azure/hack/log-dump/log-dump-daemonset.yaml": Get https://kubetest-fcf368f4-1d49-11ea-8f8c-024283fcdaf9.westus2.cloudapp.azure.com/api?timeout=32s: dial tcp 52.148.148.165:443: i/o timeout W1213 02:08:19.416] 2019/12/13 02:08:19 process.go:155: Step 'bash -c ./log-dump.sh' finished in 1m0.322970633s W1213 02:08:19.416] 2019/12/13 02:08:19 azure.go:1147: Deleting resource group: kubetest-fcf368f4-1d49-11ea-8f8c-024283fcdaf9. W1213 02:15:04.881] 2019/12/13 02:15:04 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml. W1213 02:15:04.881] 2019/12/13 02:15:04 process.go:153: Running: bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}" W1213 02:15:05.602] 2019/12/13 02:15:05 process.go:155: Step 'bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"' finished in 721.493689ms W1213 02:15:05.604] 2019/12/13 02:15:05 main.go:319: Something went wrong: starting e2e cluster: error creating cluster: cannot deploy: cannot get the create deployment future response: Code="DeploymentFailed" Message="At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/DeployOperations for usage details." Details=[{"code":"Conflict","message":"{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource operation completed with terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"VMExtensionProvisioningError\",\r\n \"message\": \"VM has reported a failure when processing extension 'k8s-master-80076048-vmssCSE'. Error message: \\\"Enable failed: failed to execute command: command terminated with exit status=99\\n[stdout]\\nFri Dec 13 02:04:04 UTC 2019,k8s-master-80076048-vmss000000\\n\\n[stderr]\\n\\\"\\r\\n\\r\\nMore information on troubleshooting is available at https://aka.ms/VMExtensionCSELinuxTroubleshoot \"\r\n }\r\n ]\r\n }\r\n}"},{"code":"Conflict","message":"{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource operation completed with terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"VMExtensionProvisioningError\",\r\n \"message\": \"VM has reported a failure when processing extension 'vmssCSE'. Error message: \\\"Enable failed: failed to execute command: command terminated with exit status=99\\n[stdout]\\nFri Dec 13 02:03:36 UTC 2019,k8s-agentpool-80076048-vmss000000\\n\\n[stderr]\\n\\\"\\r\\n\\r\\nMore information on troubleshooting is available at https://aka.ms/VMExtensionCSELinuxTroubleshoot \"\r\n }\r\n ]\r\n }\r\n}"}] W1213 02:15:05.604] Traceback (most recent call last): W1213 02:15:05.604] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 778, in <module> W1213 02:15:05.605] main(parse_args()) W1213 02:15:05.605] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 626, in main W1213 02:15:05.605] mode.start(runner_args) W1213 02:15:05.605] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start W1213 02:15:05.605] check_env(env, self.command, *args) W1213 02:15:05.606] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env W1213 02:15:05.606] subprocess.check_call(cmd, env=env) W1213 02:15:05.606] File "/usr/lib/python2.7/subprocess.py", line 190, in check_call W1213 02:15:05.606] raise CalledProcessError(retcode, cmd) W1213 02:15:05.607] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--build=quick', '--up', '--down', '--test', '--deployment=aksengine', '--provider=skeleton', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--ginkgo-parallel=30', '--aksengine-agentpoolcount=2', '--aksengine-admin-username=azureuser', '--aksengine-creds=/etc/azure-cred/credentials', '--aksengine-orchestratorRelease=1.17', '--aksengine-mastervmsize=Standard_DS4_v2', '--aksengine-agentvmsize=Standard_D4s_v3', '--aksengine-ccm=True', '--aksengine-cnm=True', '--aksengine-deploy-custom-k8s=True', '--aksengine-location=westus2', '--aksengine-public-key=/etc/azure-ssh/azure-ssh-pub', '--aksengine-template-url=https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/master/tests/k8s-azure/manifest/linux-vmss-multi-zones.json', '--aksengine-download-url=https://chuwon.blob.core.windows.net/aks-engine/aks-engine-master-linux-amd64.tar.gz', "--test_args=--ginkgo.skip=\\[Slow\\]|\\[Serial\\]|\\[Disruptive\\]|\\[Flaky\\]|\\[Feature:.+\\]|Network\\sshould\\sset\\sTCP\\sCLOSE_WAIT\\stimeout|Mount\\spropagation\\sshould\\spropagate\\smounts\\sto\\sthe\\shost|PodSecurityPolicy|PVC\\sProtection\\sVerify|should\\sprovide\\sbasic\\sidentity|should\\sadopt\\smatching\\sorphans\\sand\\srelease|should\\snot\\sdeadlock\\swhen\\sa\\spod's\\spredecessor\\sfails|should\\sperform\\srolling\\supdates\\sand\\sroll\\sbacks\\sof\\stemplate\\smodifications\\swith\\sPVCs|should\\sperform\\srolling\\supdates\\sand\\sroll\\sbacks\\sof\\stemplate\\smodifications|Services\\sshould\\sbe\\sable\\sto\\screate\\sa\\sfunctioning\\sNodePort\\sservice$|volumeMode\\sshould\\snot\\smount\\s/\\smap\\sunused\\svolumes\\sin\\sa\\spod", '--timeout=420m')' returned non-zero exit status 1 E1213 02:15:05.613] Command failed I1213 02:15:05.613] process 709 exited with code 1 after 31.4m E1213 02:15:05.613] FAIL: chewong-cloud-provider-azure-multiple-zones I1213 02:15:05.614] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1213 02:15:06.409] Activated service account credentials for: [kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com] I1213 02:15:06.444] process 30404 exited with code 0 after 0.0m I1213 02:15:06.444] Call: gcloud config get-value account I1213 02:15:06.716] process 30417 exited with code 0 after 0.0m I1213 02:15:06.717] Will upload results to gs://kubernetes-upstream/pr-logs using kubernetes-upstream@kubernetes-upstream.iam.gserviceaccount.com I1213 02:15:06.717] Upload result and artifacts... I1213 02:15:06.717] Gubernator results at https://gubernator.k8s.io/build/kubernetes-upstream/pr-logs/pull/sigs.k8s.io_cloud-provider-azure/269/chewong-cloud-provider-azure-multiple-zones/1205301865068105728 I1213 02:15:06.717] Call: gsutil ls gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_cloud-provider-azure/269/chewong-cloud-provider-azure-multiple-zones/1205301865068105728/artifacts W1213 02:15:07.723] CommandException: One or more URLs matched no objects. E1213 02:15:07.797] Command failed I1213 02:15:07.797] process 30430 exited with code 1 after 0.0m W1213 02:15:07.798] Remote dir gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_cloud-provider-azure/269/chewong-cloud-provider-azure-multiple-zones/1205301865068105728/artifacts not exist yet I1213 02:15:07.798] Call: gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-upstream/pr-logs/pull/sigs.k8s.io_cloud-provider-azure/269/chewong-cloud-provider-azure-multiple-zones/1205301865068105728/artifacts I1213 02:15:09.321] process 30575 exited with code 0 after 0.0m I1213 02:15:09.321] Call: git rev-parse HEAD I1213 02:15:09.325] process 31102 exited with code 0 after 0.0m ... skipping 21 lines ...