Skip to content

Instantly share code, notes, and snippets.

@rodolfoap

rodolfoap/1: k8s_kube-apiserver_kube-apiserver-mc1_kube-system.log

Last active December 28, 2020 07:16
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save rodolfoap/f14a8974ad96314ab162bd97478c9198 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save rodolfoap/f14a8974ad96314ab162bd97478c9198 to your computer and use it in GitHub Desktop.
Download ZIP

Revisions

  1. RodolfoAP revised this gist Dec 28, 2020. 1 changed file with 67 additions and 0 deletions.
    67 changes: 67 additions & 0 deletions specs
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,67 @@
    > dpkg -l|grep kube

    ii kubeadm 1.20.1-00 armhf Kubernetes Cluster Bootstrapping Tool
    ii kubectl 1.20.1-00 armhf Kubernetes Command Line Tool
    ii kubectx 0.6.2-1 all Fast way to switch between clusters and namespaces in kubectl
    ii kubelet 1.20.1-00 armhf Kubernetes Node Agent
    ii kubernetes-cni 0.8.7-00 armhf Kubernetes CNI

    > dpkg -l|grep docker

    ii docker-ce 5:20.10.1~3-0~debian-buster armhf Docker: the open-source application container engine
    ii docker-ce-cli 5:20.10.1~3-0~debian-buster armhf Docker CLI: the open-source application container engine

    > uname -a

    Linux mc1 5.9.14-odroidxu4 #20.11.3 SMP PREEMPT Fri Dec 11 21:37:36 CET 2020 armv7l GNU/Linux

    > grep memtotal /proc/meminfo

    MemTotal: 2040036 kB

    > cat /proc/cpuinfo|head

    processor : 0
    model name : ARMv7 Processor rev 3 (v7l)
    BogoMIPS : 84.00
    Features : half thumb fastmult vfp edsp neon vfpv3 tls vfpv4 idiva idivt vfpd32 lpae evtstrm
    CPU implementer : 0x41
    CPU architecture: 7
    CPU variant : 0x0
    CPU part : 0xc07
    CPU revision : 3

    (... 8 cores)

    > cat /etc/issue.net

    Armbian 20.11.3 Buster

    #
    # The following commands might run instantly, fail (api server dead) or take a couple of minutes to produce an output...
    #

    > kubectl get pods -o wide --all-namespaces

    NAMESPACE NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
    kube-system coredns-74ff55c5b-6hczq 1/1 Running 2 20h 10.10.0.6 mc1 <none> <none>
    kube-system coredns-74ff55c5b-xm8rz 1/1 Running 2 20h 10.10.0.7 mc1 <none> <none>
    kube-system etcd-mc1 1/1 Running 2 20h 192.168.1.91 mc1 <none> <none>
    kube-system kube-apiserver-mc1 1/1 Running 40 20h 192.168.1.91 mc1 <none> <none>
    kube-system kube-controller-manager-mc1 1/1 Running 9 20h 192.168.1.91 mc1 <none> <none>
    kube-system kube-flannel-ds-2rz8w 1/1 Running 5 20h 192.168.1.93 mc3 <none> <none>
    kube-system kube-flannel-ds-5dxt7 1/1 Running 1 20h 192.168.1.92 mc2 <none> <none>
    kube-system kube-flannel-ds-j9vpp 1/1 Running 5 20h 192.168.1.94 mc4 <none> <none>
    kube-system kube-flannel-ds-xvfbn 1/1 Running 2 20h 192.168.1.91 mc1 <none> <none>
    kube-system kube-proxy-jvpx9 1/1 Running 2 20h 192.168.1.91 mc1 <none> <none>
    kube-system kube-proxy-mq25n 1/1 Running 1 20h 192.168.1.92 mc2 <none> <none>
    kube-system kube-proxy-pbxt6 1/1 Running 1 20h 192.168.1.93 mc3 <none> <none>
    kube-system kube-proxy-zswqd 1/1 Running 1 20h 192.168.1.94 mc4 <none> <none>
    kube-system kube-scheduler-mc1 1/1 Running 9 20h 192.168.1.91 mc1 <none> <none>

    > kubectl get nodes
    NAME STATUS ROLES AGE VERSION
    mc1 Ready control-plane,master 20h v1.20.1
    mc2 Ready <none> 20h v1.20.1
    mc3 Ready <none> 20h v1.20.1
    mc4 Ready <none> 20h v1.20.1
  2. RodolfoAP revised this gist Dec 28, 2020. No changes.
  3. RodolfoAP revised this gist Dec 28, 2020. 3 changed files with 8 additions and 4432 deletions.
    180 changes: 6 additions & 174 deletions 1: k8s_kube-apiserver_kube-apiserver-mc1_kube-system.log
    View file
    Original file line number Diff line number Diff line change
    @@ -21,140 +21,11 @@ I1228 06:10:51.673533 1 endpoint.go:68] ccResolverWrapper: sending new add
    I1228 06:10:51.760098 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:51.760191 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:51.870890 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:51.871475 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:51.997487 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:51.997726 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:52.084119 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:52.084266 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:52.148206 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:52.148320 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:52.220204 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:52.220380 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:52.300050 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:52.300231 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:52.408490 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:52.408617 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:52.486239 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:52.486461 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:52.607075 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:52.607301 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:52.736278 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:52.736403 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:52.816892 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:52.817402 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:52.979799 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:52.980409 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:53.083880 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:53.084081 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:53.187201 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:53.187405 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:53.267443 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:53.267526 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:53.372279 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:53.372422 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:53.451242 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:53.451504 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:53.531932 1 rest.go:131] the default service ipfamily for this cluster is: IPv4
    I1228 06:10:53.849365 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:53.849459 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:53.961248 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:53.961479 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:54.189604 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:54.189820 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:54.271455 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:54.271751 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:54.355417 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:54.355639 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:54.453394 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:54.453511 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:54.565499 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:54.565674 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:54.664259 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:54.664468 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:54.763626 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:54.763844 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:54.846324 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:54.846453 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:54.925438 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:54.925585 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:55.055476 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:55.055615 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:55.163881 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:55.164004 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:55.240978 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:55.241274 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:55.347371 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:55.347496 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:55.446139 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:55.446459 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:55.556831 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:55.556956 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:55.664452 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:55.664883 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:55.773834 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:55.774121 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:55.854114 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:55.854245 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:55.964057 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:55.964258 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:56.083620 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:56.083865 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:56.193852 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:56.193987 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:56.332055 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:56.332322 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:56.409607 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:56.409808 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:56.491326 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:56.491636 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:56.597097 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:56.597228 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:56.743868 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:56.744098 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:56.828883 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:56.829010 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:56.927872 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:56.928050 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:57.036013 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:57.036206 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:57.109653 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:57.109797 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:57.365374 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:57.365595 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:57.517200 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:57.518183 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:57.640033 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:57.640143 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:57.714105 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:57.714203 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:57.848294 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:57.848505 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:57.922565 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:57.922798 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:58.034418 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:58.034667 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:58.136098 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:58.136235 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:58.242676 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:58.242881 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:58.342073 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:58.342203 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:58.416654 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:58.416754 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:58.542965 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:58.543107 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:58.657790 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:58.657993 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:58.765155 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:58.765307 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:58.999704 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:59.000111 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:59.142717 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:59.143320 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:59.240742 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:59.241427 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:59.339537 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:59.339677 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]

    (...)

    I1228 06:10:59.416630 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:59.416771 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    W1228 06:11:00.067882 1 genericapiserver.go:419] Skipping API batch/v2alpha1 because it has no resources.
    @@ -218,48 +89,9 @@ I1228 06:12:17.160922 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:12:17.161016 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:12:17.161053 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:12:50.076804 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:12:50.077055 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:12:50.077135 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:13:28.363420 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:13:28.363762 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:13:28.363859 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:14:04.038589 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:14:04.038711 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:14:04.038768 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:14:15.258470 1 controller.go:606] quota admission added evaluator for: namespaces
    I1228 06:14:36.305543 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:14:36.305663 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:14:36.305715 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:15:15.323528 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:15:15.325655 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:15:15.326233 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:15:50.895552 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:15:50.895680 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:15:50.895736 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:16:35.146716 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:16:35.146892 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:16:35.146961 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:17:08.641460 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:17:08.641886 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:17:08.642072 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:17:47.809711 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:17:47.810192 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:17:47.810328 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:18:22.283008 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:18:22.283136 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:18:22.283197 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:18:59.031851 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:18:59.032214 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:18:59.032366 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:19:39.022881 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:19:39.023226 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:19:39.023325 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:20:13.520169 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:20:13.520521 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:20:13.520642 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:20:44.151145 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:20:44.151478 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:20:44.151590 1 clientconn.go:948] ClientConn switching balancer to "pick_first"

    (...)

    E1228 06:21:14.064304 1 storage_flowcontrol.go:137] failed creating mandatory flowcontrol settings: failed getting mandatory FlowSchema exempt due to the server was unable to return a response in the time allotted, but may still be processing the request (get flowschemas.flowcontrol.apiserver.k8s.io exempt), will retry later
    E1228 06:21:14.208693 1 repair.go:118] unable to refresh the service IP block: the server was unable to return a response in the time allotted, but may still be processing the request (get services)
    E1228 06:21:14.229966 1 repair.go:75] unable to refresh the port block: the server was unable to return a response in the time allotted, but may still be processing the request (get services)
    1,806 changes: 1 addition & 1,805 deletions 2: k8s_kube-scheduler_kube-scheduler-mc1_kube-system.log
    View file
    1 addition, 1,805 deletions not shown because the diff is too large. Please use a local Git client to view these changes.
    2,454 changes: 1 addition & 2,453 deletions 3: k8s_kube-controller-manager_kube-controller-manager-mc1_kube-system.log
    View file
    1 addition, 2,453 deletions not shown because the diff is too large. Please use a local Git client to view these changes.
  4. rodolfoap revised this gist Dec 28, 2020. No changes.
  5. RodolfoAP revised this gist Dec 28, 2020. 4 changed files with 5028 additions and 18 deletions.
    295 changes: 295 additions & 0 deletions 1: k8s_kube-apiserver_kube-apiserver-mc1_kube-system.log
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,295 @@
    Flag --insecure-port has been deprecated, This flag has no effect now and will be removed in v1.24.
    I1228 06:10:45.350181 1 server.go:632] external host was not specified, using 192.168.1.91
    I1228 06:10:45.351642 1 server.go:182] Version: v1.20.1
    I1228 06:10:51.150476 1 shared_informer.go:240] Waiting for caches to sync for node_authorizer
    I1228 06:10:51.156000 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.
    I1228 06:10:51.156093 1 plugins.go:161] Loaded 10 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota.
    I1228 06:10:51.161833 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.
    I1228 06:10:51.161926 1 plugins.go:161] Loaded 10 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota.
    I1228 06:10:51.178069 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:51.178397 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:51.341273 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:51.341593 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:51.423718 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:10:51.424247 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:10:51.424369 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:10:51.427486 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:51.427615 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:51.671655 1 instance.go:289] Using reconciler: lease
    I1228 06:10:51.673452 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:51.673533 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:51.760098 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:51.760191 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:51.870890 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:51.871475 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:51.997487 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:51.997726 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:52.084119 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:52.084266 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:52.148206 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:52.148320 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:52.220204 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:52.220380 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:52.300050 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:52.300231 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:52.408490 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:52.408617 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:52.486239 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:52.486461 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:52.607075 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:52.607301 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:52.736278 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:52.736403 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:52.816892 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:52.817402 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:52.979799 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:52.980409 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:53.083880 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:53.084081 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:53.187201 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:53.187405 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:53.267443 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:53.267526 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:53.372279 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:53.372422 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:53.451242 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:53.451504 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:53.531932 1 rest.go:131] the default service ipfamily for this cluster is: IPv4
    I1228 06:10:53.849365 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:53.849459 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:53.961248 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:53.961479 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:54.189604 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:54.189820 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:54.271455 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:54.271751 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:54.355417 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:54.355639 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:54.453394 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:54.453511 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:54.565499 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:54.565674 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:54.664259 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:54.664468 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:54.763626 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:54.763844 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:54.846324 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:54.846453 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:54.925438 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:54.925585 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:55.055476 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:55.055615 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:55.163881 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:55.164004 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:55.240978 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:55.241274 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:55.347371 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:55.347496 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:55.446139 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:55.446459 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:55.556831 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:55.556956 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:55.664452 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:55.664883 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:55.773834 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:55.774121 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:55.854114 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:55.854245 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:55.964057 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:55.964258 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:56.083620 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:56.083865 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:56.193852 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:56.193987 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:56.332055 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:56.332322 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:56.409607 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:56.409808 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:56.491326 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:56.491636 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:56.597097 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:56.597228 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:56.743868 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:56.744098 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:56.828883 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:56.829010 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:56.927872 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:56.928050 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:57.036013 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:57.036206 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:57.109653 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:57.109797 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:57.365374 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:57.365595 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:57.517200 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:57.518183 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:57.640033 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:57.640143 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:57.714105 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:57.714203 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:57.848294 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:57.848505 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:57.922565 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:57.922798 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:58.034418 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:58.034667 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:58.136098 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:58.136235 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:58.242676 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:58.242881 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:58.342073 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:58.342203 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:58.416654 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:58.416754 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:58.542965 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:58.543107 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:58.657790 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:58.657993 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:58.765155 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:58.765307 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:58.999704 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:59.000111 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:59.142717 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:59.143320 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:59.240742 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:59.241427 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:59.339537 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:59.339677 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:10:59.416630 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:10:59.416771 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    W1228 06:11:00.067882 1 genericapiserver.go:419] Skipping API batch/v2alpha1 because it has no resources.
    W1228 06:11:00.107988 1 genericapiserver.go:419] Skipping API discovery.k8s.io/v1alpha1 because it has no resources.
    W1228 06:11:00.152290 1 genericapiserver.go:419] Skipping API node.k8s.io/v1alpha1 because it has no resources.
    W1228 06:11:00.186949 1 genericapiserver.go:419] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources.
    W1228 06:11:00.201543 1 genericapiserver.go:419] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources.
    W1228 06:11:00.226327 1 genericapiserver.go:419] Skipping API storage.k8s.io/v1alpha1 because it has no resources.
    W1228 06:11:00.236999 1 genericapiserver.go:419] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources.
    W1228 06:11:00.258556 1 genericapiserver.go:419] Skipping API apps/v1beta2 because it has no resources.
    W1228 06:11:00.258628 1 genericapiserver.go:419] Skipping API apps/v1beta1 because it has no resources.
    I1228 06:11:00.297860 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.
    I1228 06:11:00.297927 1 plugins.go:161] Loaded 10 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota.
    I1228 06:11:00.307473 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:11:00.307560 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:11:00.471041 1 client.go:360] parsed scheme: "endpoint"
    I1228 06:11:00.471375 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 <nil> 0 <nil>}]
    I1228 06:11:12.392612 1 dynamic_cafile_content.go:167] Starting request-header::/etc/kubernetes/pki/front-proxy-ca.crt
    I1228 06:11:12.392711 1 dynamic_cafile_content.go:167] Starting client-ca-bundle::/etc/kubernetes/pki/ca.crt
    I1228 06:11:12.393774 1 dynamic_serving_content.go:130] Starting serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key
    I1228 06:11:12.396429 1 secure_serving.go:197] Serving securely on [::]:6443
    I1228 06:11:12.397276 1 apf_controller.go:249] Starting API Priority and Fairness config controller
    I1228 06:11:12.397327 1 customresource_discovery_controller.go:209] Starting DiscoveryController
    I1228 06:11:12.397498 1 controller.go:83] Starting OpenAPI AggregationController
    I1228 06:11:12.399595 1 naming_controller.go:291] Starting NamingConditionController
    I1228 06:11:12.399766 1 crd_finalizer.go:266] Starting CRDFinalizer
    I1228 06:11:12.399854 1 available_controller.go:475] Starting AvailableConditionController
    I1228 06:11:12.399914 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller
    I1228 06:11:12.400055 1 establishing_controller.go:76] Starting EstablishingController
    I1228 06:11:12.400105 1 dynamic_serving_content.go:130] Starting aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key
    I1228 06:11:12.400227 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
    I1228 06:11:12.400565 1 apiservice_controller.go:97] Starting APIServiceRegistrationController
    I1228 06:11:12.400645 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller
    I1228 06:11:12.400679 1 autoregister_controller.go:141] Starting autoregister controller
    I1228 06:11:12.400688 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller
    I1228 06:11:12.400722 1 cache.go:32] Waiting for caches to sync for autoregister controller
    I1228 06:11:12.400749 1 shared_informer.go:240] Waiting for caches to sync for cluster_authentication_trust_controller
    I1228 06:11:12.400174 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController
    I1228 06:11:12.400933 1 dynamic_cafile_content.go:167] Starting client-ca-bundle::/etc/kubernetes/pki/ca.crt
    I1228 06:11:12.401095 1 dynamic_cafile_content.go:167] Starting request-header::/etc/kubernetes/pki/front-proxy-ca.crt
    I1228 06:11:12.404292 1 controller.go:86] Starting OpenAPI controller
    I1228 06:11:12.404483 1 crdregistration_controller.go:111] Starting crd-autoregister controller
    I1228 06:11:12.404518 1 shared_informer.go:240] Waiting for caches to sync for crd-autoregister
    I1228 06:11:12.421259 1 tlsconfig.go:240] Starting DynamicServingCertificateController
    E1228 06:11:12.422146 1 controller.go:152] Unable to remove old endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/192.168.1.91, ResourceVersion: 0, AdditionalErrorMsg:
    I1228 06:11:13.427016 1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
    I1228 06:11:13.427092 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
    I1228 06:11:14.000416 1 cache.go:39] Caches are synced for AvailableConditionController controller
    I1228 06:11:14.001172 1 cache.go:39] Caches are synced for autoregister controller
    I1228 06:11:14.017064 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
    I1228 06:11:14.018568 1 shared_informer.go:247] Caches are synced for crd-autoregister
    I1228 06:11:14.018645 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
    I1228 06:11:14.018695 1 shared_informer.go:247] Caches are synced for cluster_authentication_trust_controller
    I1228 06:11:14.060050 1 shared_informer.go:247] Caches are synced for node_authorizer
    I1228 06:11:14.078230 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
    I1228 06:11:14.097562 1 apf_controller.go:253] Running API Priority and Fairness config worker
    I1228 06:11:36.455058 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:11:36.455383 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:11:36.455485 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:12:17.160922 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:12:17.161016 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:12:17.161053 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:12:50.076804 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:12:50.077055 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:12:50.077135 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:13:28.363420 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:13:28.363762 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:13:28.363859 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:14:04.038589 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:14:04.038711 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:14:04.038768 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:14:15.258470 1 controller.go:606] quota admission added evaluator for: namespaces
    I1228 06:14:36.305543 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:14:36.305663 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:14:36.305715 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:15:15.323528 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:15:15.325655 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:15:15.326233 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:15:50.895552 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:15:50.895680 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:15:50.895736 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:16:35.146716 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:16:35.146892 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:16:35.146961 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:17:08.641460 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:17:08.641886 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:17:08.642072 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:17:47.809711 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:17:47.810192 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:17:47.810328 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:18:22.283008 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:18:22.283136 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:18:22.283197 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:18:59.031851 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:18:59.032214 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:18:59.032366 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:19:39.022881 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:19:39.023226 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:19:39.023325 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:20:13.520169 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:20:13.520521 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:20:13.520642 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:20:44.151145 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:20:44.151478 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:20:44.151590 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    E1228 06:21:14.064304 1 storage_flowcontrol.go:137] failed creating mandatory flowcontrol settings: failed getting mandatory FlowSchema exempt due to the server was unable to return a response in the time allotted, but may still be processing the request (get flowschemas.flowcontrol.apiserver.k8s.io exempt), will retry later
    E1228 06:21:14.208693 1 repair.go:118] unable to refresh the service IP block: the server was unable to return a response in the time allotted, but may still be processing the request (get services)
    E1228 06:21:14.229966 1 repair.go:75] unable to refresh the port block: the server was unable to return a response in the time allotted, but may still be processing the request (get services)
    E1228 06:21:16.165956 1 controller.go:203] unable to create required kubernetes system namespace kube-system: the server was unable to return a response in the time allotted, but may still be processing the request (post namespaces)
    I1228 06:21:21.842662 1 client.go:360] parsed scheme: "passthrough"
    I1228 06:21:21.843006 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
    I1228 06:21:21.843103 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
    I1228 06:21:23.834212 1 dynamic_cafile_content.go:182] Shutting down request-header::/etc/kubernetes/pki/front-proxy-ca.crt
    I1228 06:21:23.834351 1 controller.go:181] Shutting down kubernetes service endpoint reconciler
    I1228 06:21:23.839303 1 controller.go:123] Shutting down OpenAPI controller
    I1228 06:21:23.839415 1 apiservice_controller.go:131] Shutting down APIServiceRegistrationController
    I1228 06:21:23.839576 1 cluster_authentication_trust_controller.go:463] Shutting down cluster_authentication_trust_controller controller
    I1228 06:21:23.839651 1 crdregistration_controller.go:142] Shutting down crd-autoregister controller
    I1228 06:21:23.839740 1 naming_controller.go:302] Shutting down NamingConditionController
    I1228 06:21:23.839807 1 nonstructuralschema_controller.go:204] Shutting down NonStructuralSchemaConditionController
    I1228 06:21:23.839880 1 establishing_controller.go:87] Shutting down EstablishingController
    I1228 06:21:23.839952 1 crd_finalizer.go:278] Shutting down CRDFinalizer
    I1228 06:21:23.840029 1 apiapproval_controller.go:198] Shutting down KubernetesAPIApprovalPolicyConformantConditionController
    I1228 06:21:23.840106 1 autoregister_controller.go:165] Shutting down autoregister controller
    I1228 06:21:23.840195 1 available_controller.go:487] Shutting down AvailableConditionController
    I1228 06:21:23.840289 1 customresource_discovery_controller.go:245] Shutting down DiscoveryController
    E1228 06:21:23.840254 1 controller.go:184] StorageError: key not found, Code: 1, Key: /registry/masterleases/192.168.1.91, ResourceVersion: 0, AdditionalErrorMsg:
    I1228 06:21:23.842576 1 dynamic_cafile_content.go:182] Shutting down request-header::/etc/kubernetes/pki/front-proxy-ca.crt
    I1228 06:21:23.842678 1 dynamic_cafile_content.go:182] Shutting down client-ca-bundle::/etc/kubernetes/pki/ca.crt
    I1228 06:21:23.842752 1 dynamic_serving_content.go:145] Shutting down aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key
    I1228 06:21:23.842823 1 controller.go:89] Shutting down OpenAPI AggregationController
    I1228 06:21:23.843632 1 tlsconfig.go:255] Shutting down DynamicServingCertificateController
    I1228 06:21:23.843770 1 dynamic_serving_content.go:145] Shutting down serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key
    I1228 06:21:23.843930 1 dynamic_cafile_content.go:182] Shutting down client-ca-bundle::/etc/kubernetes/pki/ca.crt
    I1228 06:21:23.868442 1 secure_serving.go:241] Stopped listening on [::]:6443
    E1228 06:21:23.872144 1 controller.go:223] unable to sync kubernetes service: Post "https://localhost:6443/api/v1/namespaces": http2: server sent GOAWAY and closed the connection; LastStreamID=945, ErrCode=NO_ERROR, debug=""
    E1228 06:21:24.922424 1 controller.go:203] unable to create required kubernetes system namespace kube-public: Post "https://localhost:6443/api/v1/namespaces": dial tcp 127.0.0.1:6443: connect: connection refused
    E1228 06:21:24.934137 1 controller.go:203] unable to create required kubernetes system namespace kube-node-lease: Post "https://localhost:6443/api/v1/namespaces": dial tcp 127.0.0.1:6443: connect: connection refused
    1,971 changes: 1,971 additions & 0 deletions 2: k8s_kube-scheduler_kube-scheduler-mc1_kube-system.log
    View file
    1,971 additions, 0 deletions not shown because the diff is too large. Please use a local Git client to view these changes.
    2,762 changes: 2,762 additions & 0 deletions 3: k8s_kube-controller-manager_kube-controller-manager-mc1_kube-system.log
    View file
    2,762 additions, 0 deletions not shown because the diff is too large. Please use a local Git client to view these changes.
    18 changes: 0 additions & 18 deletions Kubernetes modules rebooting
    View file
    Original file line number Diff line number Diff line change
    @@ -1,18 +0,0 @@
    kubectl get nodes
    kubectl drain mc4 --delete-emptydir-data --force --ignore-daemonsets
    kubectl drain mc3 --delete-emptydir-data --force --ignore-daemonsets
    kubectl drain mc2 --delete-emptydir-data --force --ignore-daemonsets
    kubectl drain mc1 --delete-emptydir-data --force --ignore-daemonsets
    kubectl delete -f https://raw.githubusercontent.com/coreos/flannel/master/Documentation/kube-flannel.yml
    kubeadm reset -f # on worker nodes
    apt-get purge kubeadm kubectl kubelet kubernetes-cni kube*
    apt-get autoremove
    docker rmi -f $(docker images -a -q)
    iptables -F && iptables -X
    iptables -t nat -F && iptables -t nat -X
    iptables -t raw -F && iptables -t raw -X
    iptables -t mangle -F && iptables -t mangle -X
    reboot
    rm -rf /home/rodolfoap/.kube /root/.kube
    rm -rf /etc/cni /etc/kubernetes /var/lib/dockershim /var/lib/etcd /var/lib/kubelet /var/run/kubernetes
    rm -r /usr/libexec/kubernetes /var/log.hdd/ /var/log/containers/ /var/log/pods/
  6. rodolfoap created this gist Dec 28, 2020.
    18 changes: 18 additions & 0 deletions Kubernetes modules rebooting
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,18 @@
    kubectl get nodes
    kubectl drain mc4 --delete-emptydir-data --force --ignore-daemonsets
    kubectl drain mc3 --delete-emptydir-data --force --ignore-daemonsets
    kubectl drain mc2 --delete-emptydir-data --force --ignore-daemonsets
    kubectl drain mc1 --delete-emptydir-data --force --ignore-daemonsets
    kubectl delete -f https://raw.githubusercontent.com/coreos/flannel/master/Documentation/kube-flannel.yml
    kubeadm reset -f # on worker nodes
    apt-get purge kubeadm kubectl kubelet kubernetes-cni kube*
    apt-get autoremove
    docker rmi -f $(docker images -a -q)
    iptables -F && iptables -X
    iptables -t nat -F && iptables -t nat -X
    iptables -t raw -F && iptables -t raw -X
    iptables -t mangle -F && iptables -t mangle -X
    reboot
    rm -rf /home/rodolfoap/.kube /root/.kube
    rm -rf /etc/cni /etc/kubernetes /var/lib/dockershim /var/lib/etcd /var/lib/kubelet /var/run/kubernetes
    rm -r /usr/libexec/kubernetes /var/log.hdd/ /var/log/containers/ /var/log/pods/