Skip to content

Instantly share code, notes, and snippets.

@nenkoru
Created November 9, 2024 14:41
Show Gist options
  • Select an option

  • Save nenkoru/df80fcd599f960798a6e6e7a60fc87a3 to your computer and use it in GitHub Desktop.

Select an option

Save nenkoru/df80fcd599f960798a6e6e7a60fc87a3 to your computer and use it in GitHub Desktop.
ZDE and remote ziti-edge-tunnel logs with wrong port forwarding
192.168.10.13: (1)[ 327137.641] DEBUG tunnel-sdk:tunnel_tcp.c:429 recv_tcp() intercepted address[tcp:100.64.0.9:443] client[tcp:100.64.0.1:8502] service[vault-bayfut.svc]
192.168.10.13: (1)[ 327137.641] DEBUG tunnel-cbs:ziti_tunnel_cbs.c:349 ziti_sdk_c_dial() service[vault-bayfut.svc] app_data_json[172]='{"connType":null,"dst_protocol":"tcp","dst_hostname":"vault.bayfut.net","dst_ip":"100.64.0.9","dst_port":"443","src_protocol":"tcp","src_ip":"100.64.0.1","src_port":"8502"}'
192.168.10.13: (1)[ 327137.641] DEBUG ziti-sdk:connect.c:413 connect_get_service_cb() conn[0.67238/jgRfH63p/Connecting] got service[vault-bayfut.svc] id[8fPqpz8sAU2tZIiyIDfos]
192.168.10.13: (1)[ 327137.641] DEBUG ziti-sdk:connect.c:534 process_connect() conn[0.67238/jgRfH63p/Connecting] starting Dial connection for service[vault-bayfut.svc] with session[cm3a8nkjx5u6alijx1soc6pis]
192.168.10.13: (1)[ 327137.643] DEBUG tunnel-cbs:ziti_hosting.c:565 on_hosted_client_connect() hosted_service[vault-bayfut.svc] client[nenkoru-kube-worker-0]: received app_data_json='{"connType":null,"dst_protocol":"tcp","dst_hostname":"vault.bayfut.net","dst_ip":"100.64.0.9","dst_port":"443","src_protocol":"tcp","src_ip":"100.64.0.1","src_port":"8502"}'
192.168.10.13: (1)[ 327137.643] INFO tunnel-cbs:ziti_hosting.c:620 on_hosted_client_connect() hosted_service[vault-bayfut.svc] client[nenkoru-kube-worker-0] client_src_addr[tcp:100.64.0.1:8502] dst_addr[tcp:10.107.36.86:80]: incoming connection
192.168.10.13: (1)[ 327137.643] DEBUG tunnel-cbs:ziti_hosting.c:692 on_hosted_client_connect_resolved() hosted_service[vault-bayfut.svc] client[nenkoru-kube-worker-0] client_src_addr[tcp:100.64.0.1:8502] initiating connection to tcp:10.107.36.86:80
192.168.10.13: (1)[ 327137.643] DEBUG tunnel-cbs:ziti_hosting.c:204 complete_hosted_tcp_connection() hosted_service[vault-bayfut.svc], client[nenkoru-kube-worker-0] client_src_addr[tcp:100.64.0.1:8502]: connected to server tcp:10.107.36.86:80
192.168.10.13: (1)[ 327137.644] DEBUG tunnel-cbs:ziti_hosting.c:187 on_hosted_client_connect_complete() hosted_service[vault-bayfut.svc] client[nenkoru-kube-worker-0] client_src_addr[tcp:100.64.0.1:8502] local_addr[192.168.10.13:42876] fd[16] server[tcp:10.107.36.86:80] connected 16
192.168.10.13: (1)[ 327137.644] DEBUG tunnel-sdk:ziti_tunnel.c:221 ziti_tunneler_dial_completed() ziti dial succeeded: client[tcp:100.64.0.1:8502] service[vault-bayfut.svc]
192.168.10.13: (1)[ 327137.646] DEBUG tunnel-sdk:tunnel_tcp.c:145 on_tcp_client_data() client sent FIN: client=tcp:100.64.0.1:8502, service=vault-bayfut.svc
192.168.10.13: (1)[ 327137.646] DEBUG tunnel-sdk:tunnel_tcp.c:146 on_tcp_client_data() FIN received src[tcp:100.64.0.1:8502] dst[tcp:100.64.0.9:443] state[7/CLOSE_WAIT] flags[0x103] service[vault-bayfut.svc]
192.168.10.13: (1)[ 327137.647] DEBUG tunnel-sdk:ziti_tunnel.c:434 ziti_tunneler_close() closing connection: client[tcp:100.64.0.1:8502] service[vault-bayfut.svc]
192.168.10.13: (1)[ 327137.647] DEBUG tunnel-sdk:tunnel_tcp.c:251 tunneler_tcp_close() closing src[tcp:100.64.0.1:8502] dst[tcp:100.64.0.9:443] state[7/CLOSE_WAIT] flags[0x100] service[vault-bayfut.svc]
192.168.10.13: (1)[ 327140.185] DEBUG tunnel-cbs:ziti_hosting.c:565 on_hosted_client_connect() hosted_service[vault-bayfut.svc] client[nenkoru-macbook-desktop-edge]: received app_data_json='{"connType":null,"dst_protocol":"tcp","dst_hostname":"vault.bayfut.net","dst_ip":"100.64.0.3","dst_port":"443","src_protocol":"tcp","src_ip":"100.64.0.1","src_port":"53642"}'
192.168.10.13: (1)[ 327140.185] INFO tunnel-cbs:ziti_hosting.c:620 on_hosted_client_connect() hosted_service[vault-bayfut.svc] client[nenkoru-macbook-desktop-edge] client_src_addr[tcp:100.64.0.1:53642] dst_addr[tcp:10.107.36.86:80]: incoming connection
192.168.10.13: (1)[ 327140.186] DEBUG tunnel-cbs:ziti_hosting.c:692 on_hosted_client_connect_resolved() hosted_service[vault-bayfut.svc] client[nenkoru-macbook-desktop-edge] client_src_addr[tcp:100.64.0.1:53642] initiating connection to tcp:10.107.36.86:80
(79731)[2024-11-09T14:21:54.014Z] TRACE tunnel-sdk:ziti_tunnel.c:505 check_lwip_timeouts() next wake in 250 millis
[2024-11-09T14:21:54:105Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 1 packets
(79731)[2024-11-09T14:21:54.105Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:62151] dst[tcp:100.64.0.6:6443] flags[PSH,ACK]
[2024-11-09T14:21:54:106Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 1 packets
(79731)[2024-11-09T14:21:54.105Z] VERBOSE tunnel-sdk:tunnel_tcp.c:141 on_tcp_client_data() status 0 src[tcp:100.64.0.1:62151] dst[tcp:100.64.0.6:6443] state[4/ESTABLISHED] flags[0x101] service[nenkoru-cluster-kubeapi.svc]
(79731)[2024-11-09T14:21:54.105Z] TRACE ziti-sdk:connect.c:1280 ziti_write() conn[0.3421/axQJEI2X/Connected] write 24 bytes
(79731)[2024-11-09T14:21:54.105Z] TRACE ziti-sdk:connect.c:809 flush_connection() conn[0.3421/axQJEI2X/Connected] starting flusher
(79731)[2024-11-09T14:21:54.106Z] VERBOSE ziti-sdk:connect.c:896 flush_to_client() conn[0.3421/axQJEI2X/Connected] 0 bytes available
(79731)[2024-11-09T14:21:54.106Z] TRACE ziti-sdk:connect.c:310 send_message() conn[0.3421/axQJEI2X/Connected] => ct[ED72] uuid[1ee87f8b:000006ed:5cdd01ea] edge_seq[1773] len[41] hash[1ee87f8b:03def6ab:93ab305f:be164ec1:67df0057:869f3cbc:bb40960e:1e087c27]
(79731)[2024-11-09T14:21:54.106Z] TRACE ziti-sdk:channel.c:413 ziti_channel_send_message() ch[0] => ct[ED72] seq[11059] len[41]
(79731)[2024-11-09T14:21:54.106Z] TRACE ziti-sdk:channel.c:384 on_channel_send() ch[0] write delay = 0.000d q=1 qs=109
(79731)[2024-11-09T14:21:54.106Z] TRACE ziti-sdk:connect.c:238 on_write_completed() conn[0.3421/axQJEI2X/Connected] status 0
(79731)[2024-11-09T14:21:54.106Z] TRACE ziti-sdk:connect.c:878 flush_to_service() conn[0.3421/axQJEI2X/Connected] flushed 1 messages
(79731)[2024-11-09T14:21:54.106Z] TRACE ziti-sdk:connect.c:802 on_flush() conn[0.3421/axQJEI2X/Connected] stopping flusher
(79731)[2024-11-09T14:21:54.106Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:62151] dst[tcp:100.64.0.6:6443] flags[PSH,ACK]
(79731)[2024-11-09T14:21:54.106Z] VERBOSE tunnel-sdk:tunnel_tcp.c:141 on_tcp_client_data() status 0 src[tcp:100.64.0.1:62151] dst[tcp:100.64.0.6:6443] state[4/ESTABLISHED] flags[0x102] service[nenkoru-cluster-kubeapi.svc]
(79731)[2024-11-09T14:21:54.106Z] TRACE ziti-sdk:connect.c:1280 ziti_write() conn[0.3421/axQJEI2X/Connected] write 32 bytes
(79731)[2024-11-09T14:21:54.106Z] TRACE ziti-sdk:connect.c:809 flush_connection() conn[0.3421/axQJEI2X/Connected] starting flusher
(79731)[2024-11-09T14:21:54.106Z] TRACE tunnel-sdk:netif_shim.c:34 netif_shim_output() writing packet TCP[100.64.0.6:6443 -> 100.64.0.1:62151] len=40
(79731)[2024-11-09T14:21:54.106Z] VERBOSE ziti-sdk:connect.c:896 flush_to_client() conn[0.3421/axQJEI2X/Connected] 0 bytes available
(79731)[2024-11-09T14:21:54.106Z] TRACE ziti-sdk:connect.c:310 send_message() conn[0.3421/axQJEI2X/Connected] => ct[ED72] uuid[e48ea5bd:000006ee:5cdd01ea] edge_seq[1774] len[49] hash[e48ea5bd:48d9e323:6b4f4068:dbda35a1:5ddc53ac:1ef8490b:503fb963:7401b5d3]
(79731)[2024-11-09T14:21:54.106Z] TRACE ziti-sdk:channel.c:413 ziti_channel_send_message() ch[0] => ct[ED72] seq[11060] len[49]
(79731)[2024-11-09T14:21:54.106Z] TRACE ziti-sdk:channel.c:384 on_channel_send() ch[0] write delay = 0.000d q=1 qs=117
(79731)[2024-11-09T14:21:54.106Z] TRACE ziti-sdk:connect.c:238 on_write_completed() conn[0.3421/axQJEI2X/Connected] status 0
(79731)[2024-11-09T14:21:54.106Z] TRACE ziti-sdk:connect.c:878 flush_to_service() conn[0.3421/axQJEI2X/Connected] flushed 1 messages
(79731)[2024-11-09T14:21:54.106Z] TRACE ziti-sdk:connect.c:802 on_flush() conn[0.3421/axQJEI2X/Connected] stopping flusher
[2024-11-09T14:21:54:241Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 1 packets
(79731)[2024-11-09T14:21:54.241Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:62155] dst[tcp:100.64.0.6:6443] flags[PSH,ACK]
(79731)[2024-11-09T14:21:54.241Z] VERBOSE tunnel-sdk:tunnel_tcp.c:141 on_tcp_client_data() status 0 src[tcp:100.64.0.1:62155] dst[tcp:100.64.0.6:6443] state[4/ESTABLISHED] flags[0x101] service[nenkoru-cluster-kubeapi.svc]
(79731)[2024-11-09T14:21:54.241Z] TRACE ziti-sdk:connect.c:1280 ziti_write() conn[0.3422/SwZqHrIZ/Connected] write 24 bytes
(79731)[2024-11-09T14:21:54.241Z] TRACE ziti-sdk:connect.c:809 flush_connection() conn[0.3422/SwZqHrIZ/Connected] starting flusher
(79731)[2024-11-09T14:21:54.241Z] VERBOSE ziti-sdk:connect.c:896 flush_to_client() conn[0.3422/SwZqHrIZ/Connected] 0 bytes available
[2024-11-09T14:21:54:241Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 1 packets
(79731)[2024-11-09T14:21:54.241Z] TRACE ziti-sdk:connect.c:310 send_message() conn[0.3422/SwZqHrIZ/Connected] => ct[ED72] uuid[a0540e94:000006a2:5cdd0271] edge_seq[1698] len[41] hash[a0540e94:4c3f1ced:b9e560c6:752b399a:5d1bfb88:3abafa4e:be9d322b:e4f21217]
(79731)[2024-11-09T14:21:54.241Z] TRACE ziti-sdk:channel.c:413 ziti_channel_send_message() ch[0] => ct[ED72] seq[11061] len[41]
(79731)[2024-11-09T14:21:54.241Z] TRACE ziti-sdk:channel.c:384 on_channel_send() ch[0] write delay = 0.000d q=1 qs=109
(79731)[2024-11-09T14:21:54.241Z] TRACE ziti-sdk:connect.c:238 on_write_completed() conn[0.3422/SwZqHrIZ/Connected] status 0
(79731)[2024-11-09T14:21:54.241Z] TRACE ziti-sdk:connect.c:878 flush_to_service() conn[0.3422/SwZqHrIZ/Connected] flushed 1 messages
(79731)[2024-11-09T14:21:54.241Z] TRACE ziti-sdk:connect.c:802 on_flush() conn[0.3422/SwZqHrIZ/Connected] stopping flusher
(79731)[2024-11-09T14:21:54.242Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:62155] dst[tcp:100.64.0.6:6443] flags[PSH,ACK]
(79731)[2024-11-09T14:21:54.242Z] VERBOSE tunnel-sdk:tunnel_tcp.c:141 on_tcp_client_data() status 0 src[tcp:100.64.0.1:62155] dst[tcp:100.64.0.6:6443] state[4/ESTABLISHED] flags[0x102] service[nenkoru-cluster-kubeapi.svc]
(79731)[2024-11-09T14:21:54.242Z] TRACE ziti-sdk:connect.c:1280 ziti_write() conn[0.3422/SwZqHrIZ/Connected] write 32 bytes
(79731)[2024-11-09T14:21:54.242Z] TRACE ziti-sdk:connect.c:809 flush_connection() conn[0.3422/SwZqHrIZ/Connected] starting flusher
(79731)[2024-11-09T14:21:54.242Z] TRACE tunnel-sdk:netif_shim.c:34 netif_shim_output() writing packet TCP[100.64.0.6:6443 -> 100.64.0.1:62155] len=40
(79731)[2024-11-09T14:21:54.242Z] VERBOSE ziti-sdk:connect.c:896 flush_to_client() conn[0.3422/SwZqHrIZ/Connected] 0 bytes available
(79731)[2024-11-09T14:21:54.242Z] TRACE ziti-sdk:connect.c:310 send_message() conn[0.3422/SwZqHrIZ/Connected] => ct[ED72] uuid[c7d76492:000006a3:5cdd0272] edge_seq[1699] len[49] hash[c7d76492:4f624789:d9b9b42d:54105fa2:45332069:ff5a9600:5abdd8ea:39638ad5]
(79731)[2024-11-09T14:21:54.242Z] TRACE ziti-sdk:channel.c:413 ziti_channel_send_message() ch[0] => ct[ED72] seq[11062] len[49]
(79731)[2024-11-09T14:21:54.242Z] TRACE ziti-sdk:channel.c:384 on_channel_send() ch[0] write delay = 0.000d q=1 qs=117
(79731)[2024-11-09T14:21:54.242Z] TRACE ziti-sdk:connect.c:238 on_write_completed() conn[0.3422/SwZqHrIZ/Connected] status 0
(79731)[2024-11-09T14:21:54.242Z] TRACE ziti-sdk:connect.c:878 flush_to_service() conn[0.3422/SwZqHrIZ/Connected] flushed 1 messages
(79731)[2024-11-09T14:21:54.242Z] TRACE ziti-sdk:connect.c:802 on_flush() conn[0.3422/SwZqHrIZ/Connected] stopping flusher
(79731)[2024-11-09T14:21:54.265Z] TRACE tunnel-sdk:ziti_tunnel.c:505 check_lwip_timeouts() next wake in 206 millis
(79731)[2024-11-09T14:21:54.418Z] TRACE ziti-sdk:channel.c:905 on_channel_data() ch[0] on_data [len=115]
(79731)[2024-11-09T14:21:54.418Z] TRACE ziti-sdk:channel.c:589 process_inbound() ch[0] <= ct[ED72] seq[19215] len[47] hdrs[48]
(79731)[2024-11-09T14:21:54.418Z] TRACE ziti-sdk:channel.c:599 process_inbound() ch[0] completing msg seq[19215] body+hrds=47+48, in_offset=0, want=95, got=95
(79731)[2024-11-09T14:21:54.418Z] TRACE ziti-sdk:channel.c:610 process_inbound() ch[0] message is complete seq[19215] ct[ED72]
(79731)[2024-11-09T14:21:54.418Z] TRACE ziti-sdk:connect.c:809 flush_connection() conn[0.3422/SwZqHrIZ/Connected] starting flusher
(79731)[2024-11-09T14:21:54.418Z] TRACE ziti-sdk:channel.c:900 on_channel_data() ch[0] read no data
(79731)[2024-11-09T14:21:54.418Z] TRACE ziti-sdk:connect.c:1429 process_edge_message() conn[0.3422/SwZqHrIZ/Connected] <= ct[ED72] edge_seq[1752] len[47]
(79731)[2024-11-09T14:21:54.418Z] VERBOSE ziti-sdk:connect.c:959 conn_inbound_data_msg() conn[0.3422/SwZqHrIZ/Connected] decrypting 47 bytes
(79731)[2024-11-09T14:21:54.418Z] VERBOSE ziti-sdk:connect.c:982 conn_inbound_data_msg() conn[0.3422/SwZqHrIZ/Connected] decrypted 30 bytes tag[0]
(79731)[2024-11-09T14:21:54.418Z] VERBOSE ziti-sdk:connect.c:896 flush_to_client() conn[0.3422/SwZqHrIZ/Connected] 30 bytes available
(79731)[2024-11-09T14:21:54.418Z] TRACE tunnel-cbs:ziti_tunnel_cbs.c:111 on_ziti_data() got 30 bytes from ziti
(79731)[2024-11-09T14:21:54.418Z] TRACE tunnel-sdk:tunnel_tcp.c:207 tunneler_tcp_write() sendlen=30 src[tcp:100.64.0.1:62155] dst[tcp:100.64.0.6:6443] state[4/ESTABLISHED] flags[0x100] service[nenkoru-cluster-kubeapi.svc]
(79731)[2024-11-09T14:21:54.418Z] TRACE tunnel-sdk:netif_shim.c:34 netif_shim_output() writing packet TCP[100.64.0.6:6443 -> 100.64.0.1:62155] len=70
(79731)[2024-11-09T14:21:54.418Z] TRACE ziti-sdk:connect.c:902 flush_to_client() conn[0.3422/SwZqHrIZ/Connected] client consumed 30 out of 30 bytes
(79731)[2024-11-09T14:21:54.418Z] TRACE ziti-sdk:connect.c:878 flush_to_service() conn[0.3422/SwZqHrIZ/Connected] flushed 0 messages
(79731)[2024-11-09T14:21:54.418Z] TRACE ziti-sdk:connect.c:802 on_flush() conn[0.3422/SwZqHrIZ/Connected] stopping flusher
(79731)[2024-11-09T14:21:54.419Z] TRACE ziti-sdk:channel.c:905 on_channel_data() ch[0] on_data [len=337]
(79731)[2024-11-09T14:21:54.419Z] TRACE ziti-sdk:channel.c:589 process_inbound() ch[0] <= ct[ED72] seq[19216] len[43] hdrs[48]
(79731)[2024-11-09T14:21:54.419Z] TRACE ziti-sdk:channel.c:599 process_inbound() ch[0] completing msg seq[19216] body+hrds=43+48, in_offset=0, want=91, got=91
(79731)[2024-11-09T14:21:54.419Z] TRACE ziti-sdk:channel.c:610 process_inbound() ch[0] message is complete seq[19216] ct[ED72]
(79731)[2024-11-09T14:21:54.419Z] TRACE ziti-sdk:connect.c:809 flush_connection() conn[0.3422/SwZqHrIZ/Connected] starting flusher
(79731)[2024-11-09T14:21:54.419Z] TRACE ziti-sdk:channel.c:589 process_inbound() ch[0] <= ct[ED72] seq[19217] len[41] hdrs[48]
(79731)[2024-11-09T14:21:54.419Z] TRACE ziti-sdk:channel.c:599 process_inbound() ch[0] completing msg seq[19217] body+hrds=41+48, in_offset=0, want=89, got=89
(79731)[2024-11-09T14:21:54.419Z] TRACE ziti-sdk:channel.c:610 process_inbound() ch[0] message is complete seq[19217] ct[ED72]
(79731)[2024-11-09T14:21:54.419Z] TRACE ziti-sdk:connect.c:809 flush_connection() conn[0.3421/axQJEI2X/Connected] starting flusher
(79731)[2024-11-09T14:21:54.419Z] TRACE ziti-sdk:channel.c:589 process_inbound() ch[0] <= ct[ED72] seq[19218] len[49] hdrs[48]
(79731)[2024-11-09T14:21:54.419Z] TRACE ziti-sdk:channel.c:599 process_inbound() ch[0] completing msg seq[19218] body+hrds=49+48, in_offset=0, want=97, got=97
(79731)[2024-11-09T14:21:54.419Z] TRACE ziti-sdk:channel.c:610 process_inbound() ch[0] message is complete seq[19218] ct[ED72]
(79731)[2024-11-09T14:21:54.419Z] TRACE ziti-sdk:channel.c:900 on_channel_data() ch[0] read no data
[2024-11-09T14:21:54:420Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 1 packets
(79731)[2024-11-09T14:21:54.420Z] TRACE ziti-sdk:connect.c:1429 process_edge_message() conn[0.3421/axQJEI2X/Connected] <= ct[ED72] edge_seq[4182] len[41]
(79731)[2024-11-09T14:21:54.420Z] VERBOSE ziti-sdk:connect.c:959 conn_inbound_data_msg() conn[0.3421/axQJEI2X/Connected] decrypting 41 bytes
(79731)[2024-11-09T14:21:54.420Z] VERBOSE ziti-sdk:connect.c:982 conn_inbound_data_msg() conn[0.3421/axQJEI2X/Connected] decrypted 24 bytes tag[0]
(79731)[2024-11-09T14:21:54.420Z] TRACE ziti-sdk:connect.c:1429 process_edge_message() conn[0.3421/axQJEI2X/Connected] <= ct[ED72] edge_seq[4183] len[49]
(79731)[2024-11-09T14:21:54.420Z] VERBOSE ziti-sdk:connect.c:959 conn_inbound_data_msg() conn[0.3421/axQJEI2X/Connected] decrypting 49 bytes
(79731)[2024-11-09T14:21:54.420Z] VERBOSE ziti-sdk:connect.c:982 conn_inbound_data_msg() conn[0.3421/axQJEI2X/Connected] decrypted 32 bytes tag[0]
(79731)[2024-11-09T14:21:54.420Z] VERBOSE ziti-sdk:connect.c:896 flush_to_client() conn[0.3421/axQJEI2X/Connected] 56 bytes available
(79731)[2024-11-09T14:21:54.420Z] TRACE tunnel-cbs:ziti_tunnel_cbs.c:111 on_ziti_data() got 24 bytes from ziti
(79731)[2024-11-09T14:21:54.420Z] TRACE tunnel-sdk:tunnel_tcp.c:207 tunneler_tcp_write() sendlen=24 src[tcp:100.64.0.1:62151] dst[tcp:100.64.0.6:6443] state[4/ESTABLISHED] flags[0x100] service[nenkoru-cluster-kubeapi.svc]
(79731)[2024-11-09T14:21:54.420Z] TRACE tunnel-sdk:netif_shim.c:34 netif_shim_output() writing packet TCP[100.64.0.6:6443 -> 100.64.0.1:62151] len=64
(79731)[2024-11-09T14:21:54.420Z] TRACE ziti-sdk:connect.c:902 flush_to_client() conn[0.3421/axQJEI2X/Connected] client consumed 24 out of 24 bytes
(79731)[2024-11-09T14:21:54.420Z] TRACE tunnel-cbs:ziti_tunnel_cbs.c:111 on_ziti_data() got 32 bytes from ziti
(79731)[2024-11-09T14:21:54.420Z] TRACE tunnel-sdk:tunnel_tcp.c:207 tunneler_tcp_write() sendlen=32 src[tcp:100.64.0.1:62151] dst[tcp:100.64.0.6:6443] state[4/ESTABLISHED] flags[0x100] service[nenkoru-cluster-kubeapi.svc]
(79731)[2024-11-09T14:21:54.420Z] TRACE ziti-sdk:connect.c:902 flush_to_client() conn[0.3421/axQJEI2X/Connected] client consumed 32 out of 32 bytes
(79731)[2024-11-09T14:21:54.420Z] TRACE ziti-sdk:connect.c:878 flush_to_service() conn[0.3421/axQJEI2X/Connected] flushed 0 messages
(79731)[2024-11-09T14:21:54.420Z] TRACE ziti-sdk:connect.c:802 on_flush() conn[0.3421/axQJEI2X/Connected] stopping flusher
(79731)[2024-11-09T14:21:54.420Z] TRACE ziti-sdk:connect.c:1429 process_edge_message() conn[0.3422/SwZqHrIZ/Connected] <= ct[ED72] edge_seq[1753] len[43]
(79731)[2024-11-09T14:21:54.420Z] VERBOSE ziti-sdk:connect.c:959 conn_inbound_data_msg() conn[0.3422/SwZqHrIZ/Connected] decrypting 43 bytes
(79731)[2024-11-09T14:21:54.420Z] VERBOSE ziti-sdk:connect.c:982 conn_inbound_data_msg() conn[0.3422/SwZqHrIZ/Connected] decrypted 26 bytes tag[0]
(79731)[2024-11-09T14:21:54.420Z] VERBOSE ziti-sdk:connect.c:896 flush_to_client() conn[0.3422/SwZqHrIZ/Connected] 26 bytes available
(79731)[2024-11-09T14:21:54.420Z] TRACE tunnel-cbs:ziti_tunnel_cbs.c:111 on_ziti_data() got 26 bytes from ziti
(79731)[2024-11-09T14:21:54.420Z] TRACE tunnel-sdk:tunnel_tcp.c:207 tunneler_tcp_write() sendlen=26 src[tcp:100.64.0.1:62155] dst[tcp:100.64.0.6:6443] state[4/ESTABLISHED] flags[0x100] service[nenkoru-cluster-kubeapi.svc]
(79731)[2024-11-09T14:21:54.420Z] TRACE ziti-sdk:connect.c:902 flush_to_client() conn[0.3422/SwZqHrIZ/Connected] client consumed 26 out of 26 bytes
(79731)[2024-11-09T14:21:54.420Z] TRACE ziti-sdk:connect.c:878 flush_to_service() conn[0.3422/SwZqHrIZ/Connected] flushed 0 messages
(79731)[2024-11-09T14:21:54.420Z] TRACE ziti-sdk:connect.c:802 on_flush() conn[0.3422/SwZqHrIZ/Connected] stopping flusher
[2024-11-09T14:21:54:421Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 1 packets
(79731)[2024-11-09T14:21:54.421Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:62155] dst[tcp:100.64.0.6:6443] flags[ACK]
(79731)[2024-11-09T14:21:54.421Z] TRACE tunnel-sdk:netif_shim.c:34 netif_shim_output() writing packet TCP[100.64.0.6:6443 -> 100.64.0.1:62155] len=66
(79731)[2024-11-09T14:21:54.421Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:62151] dst[tcp:100.64.0.6:6443] flags[ACK]
(79731)[2024-11-09T14:21:54.421Z] TRACE tunnel-sdk:netif_shim.c:34 netif_shim_output() writing packet TCP[100.64.0.6:6443 -> 100.64.0.1:62151] len=72
[2024-11-09T14:21:54:421Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 1 packets
(79731)[2024-11-09T14:21:54.421Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:62155] dst[tcp:100.64.0.6:6443] flags[ACK]
[2024-11-09T14:21:54:422Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 1 packets
(79731)[2024-11-09T14:21:54.421Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:62151] dst[tcp:100.64.0.6:6443] flags[ACK]
(79731)[2024-11-09T14:21:54.472Z] TRACE tunnel-sdk:ziti_tunnel.c:505 check_lwip_timeouts() next wake in 42 millis
(79731)[2024-11-09T14:21:54.515Z] TRACE tunnel-sdk:ziti_tunnel.c:505 check_lwip_timeouts() next wake in 250 millis
(79731)[2024-11-09T14:21:54.766Z] TRACE tunnel-sdk:ziti_tunnel.c:505 check_lwip_timeouts() next wake in 250 millis
(79731)[2024-11-09T14:21:55.017Z] TRACE tunnel-sdk:ziti_tunnel.c:505 check_lwip_timeouts() next wake in 250 millis
(79731)[2024-11-09T14:21:55.268Z] TRACE tunnel-sdk:ziti_tunnel.c:505 check_lwip_timeouts() next wake in 203 millis
[2024-11-09T14:21:55:295Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 2 packets
(79731)[2024-11-09T14:21:55.294Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:62014] dst[tcp:100.64.0.6:6443] flags[PSH,ACK]
(79731)[2024-11-09T14:21:55.294Z] VERBOSE tunnel-sdk:tunnel_tcp.c:141 on_tcp_client_data() status 0 src[tcp:100.64.0.1:62014] dst[tcp:100.64.0.6:6443] state[4/ESTABLISHED] flags[0x101] service[nenkoru-cluster-kubeapi.svc]
(79731)[2024-11-09T14:21:55.294Z] TRACE ziti-sdk:connect.c:1280 ziti_write() conn[0.3414/ASUFiNCr/Connected] write 114 bytes
(79731)[2024-11-09T14:21:55.294Z] TRACE ziti-sdk:connect.c:809 flush_connection() conn[0.3414/ASUFiNCr/Connected] starting flusher
(79731)[2024-11-09T14:21:55.294Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:58082] dst[tcp:100.64.0.6:6443] flags[PSH,ACK]
(79731)[2024-11-09T14:21:55.294Z] VERBOSE tunnel-sdk:tunnel_tcp.c:141 on_tcp_client_data() status 0 src[tcp:100.64.0.1:58082] dst[tcp:100.64.0.6:6443] state[4/ESTABLISHED] flags[0x101] service[nenkoru-cluster-kubeapi.svc]
(79731)[2024-11-09T14:21:55.294Z] TRACE ziti-sdk:connect.c:1280 ziti_write() conn[0.3492/_jm5Oxq-/Connected] write 28 bytes
(79731)[2024-11-09T14:21:55.294Z] TRACE ziti-sdk:connect.c:809 flush_connection() conn[0.3492/_jm5Oxq-/Connected] starting flusher
(79731)[2024-11-09T14:21:55.294Z] VERBOSE ziti-sdk:connect.c:896 flush_to_client() conn[0.3492/_jm5Oxq-/Connected] 0 bytes available
(79731)[2024-11-09T14:21:55.294Z] TRACE ziti-sdk:connect.c:310 send_message() conn[0.3492/_jm5Oxq-/Connected] => ct[ED72] uuid[90ba6b1d:0000011c:5cdd068e] edge_seq[284] len[45] hash[90ba6b1d:948e15b6:f941e908:66f5e90c:8f827952:fdd77a4b:1ee93d0e:e2ce8403]
(79731)[2024-11-09T14:21:55.294Z] TRACE ziti-sdk:channel.c:413 ziti_channel_send_message() ch[0] => ct[ED72] seq[11063] len[45]
(79731)[2024-11-09T14:21:55.294Z] TRACE ziti-sdk:channel.c:384 on_channel_send() ch[0] write delay = 0.000d q=1 qs=113
(79731)[2024-11-09T14:21:55.294Z] TRACE ziti-sdk:connect.c:238 on_write_completed() conn[0.3492/_jm5Oxq-/Connected] status 0
(79731)[2024-11-09T14:21:55.294Z] TRACE ziti-sdk:connect.c:878 flush_to_service() conn[0.3492/_jm5Oxq-/Connected] flushed 1 messages
(79731)[2024-11-09T14:21:55.294Z] TRACE ziti-sdk:connect.c:802 on_flush() conn[0.3492/_jm5Oxq-/Connected] stopping flusher
(79731)[2024-11-09T14:21:55.294Z] VERBOSE ziti-sdk:connect.c:896 flush_to_client() conn[0.3414/ASUFiNCr/Connected] 0 bytes available
(79731)[2024-11-09T14:21:55.294Z] TRACE ziti-sdk:connect.c:310 send_message() conn[0.3414/ASUFiNCr/Connected] => ct[ED72] uuid[6ada6826:00001218:5cdd068e] edge_seq[4632] len[131] hash[6ada6826:b4627c85:a1ab7c8a:98e3350a:65597d72:6b76b769:ea9243ed:e953e2ba]
(79731)[2024-11-09T14:21:55.294Z] TRACE ziti-sdk:channel.c:413 ziti_channel_send_message() ch[0] => ct[ED72] seq[11064] len[131]
(79731)[2024-11-09T14:21:55.294Z] TRACE ziti-sdk:channel.c:384 on_channel_send() ch[0] write delay = 0.000d q=1 qs=199
(79731)[2024-11-09T14:21:55.294Z] TRACE ziti-sdk:connect.c:238 on_write_completed() conn[0.3414/ASUFiNCr/Connected] status 0
(79731)[2024-11-09T14:21:55.294Z] TRACE ziti-sdk:connect.c:878 flush_to_service() conn[0.3414/ASUFiNCr/Connected] flushed 1 messages
(79731)[2024-11-09T14:21:55.294Z] TRACE ziti-sdk:connect.c:802 on_flush() conn[0.3414/ASUFiNCr/Connected] stopping flusher
(79731)[2024-11-09T14:21:55.439Z] TRACE ziti-sdk:channel.c:905 on_channel_data() ch[0] on_data [len=109]
(79731)[2024-11-09T14:21:55.439Z] TRACE ziti-sdk:channel.c:589 process_inbound() ch[0] <= ct[ED72] seq[19219] len[41] hdrs[48]
(79731)[2024-11-09T14:21:55.439Z] TRACE ziti-sdk:channel.c:599 process_inbound() ch[0] completing msg seq[19219] body+hrds=41+48, in_offset=0, want=89, got=89
(79731)[2024-11-09T14:21:55.439Z] TRACE ziti-sdk:channel.c:610 process_inbound() ch[0] message is complete seq[19219] ct[ED72]
(79731)[2024-11-09T14:21:55.439Z] TRACE ziti-sdk:connect.c:809 flush_connection() conn[0.3492/_jm5Oxq-/Connected] starting flusher
(79731)[2024-11-09T14:21:55.439Z] TRACE ziti-sdk:channel.c:900 on_channel_data() ch[0] read no data
(79731)[2024-11-09T14:21:55.439Z] TRACE ziti-sdk:connect.c:1429 process_edge_message() conn[0.3492/_jm5Oxq-/Connected] <= ct[ED72] edge_seq[284] len[41]
(79731)[2024-11-09T14:21:55.439Z] VERBOSE ziti-sdk:connect.c:959 conn_inbound_data_msg() conn[0.3492/_jm5Oxq-/Connected] decrypting 41 bytes
(79731)[2024-11-09T14:21:55.439Z] VERBOSE ziti-sdk:connect.c:982 conn_inbound_data_msg() conn[0.3492/_jm5Oxq-/Connected] decrypted 24 bytes tag[0]
(79731)[2024-11-09T14:21:55.439Z] VERBOSE ziti-sdk:connect.c:896 flush_to_client() conn[0.3492/_jm5Oxq-/Connected] 24 bytes available
(79731)[2024-11-09T14:21:55.439Z] TRACE tunnel-cbs:ziti_tunnel_cbs.c:111 on_ziti_data() got 24 bytes from ziti
(79731)[2024-11-09T14:21:55.439Z] TRACE tunnel-sdk:tunnel_tcp.c:207 tunneler_tcp_write() sendlen=24 src[tcp:100.64.0.1:58082] dst[tcp:100.64.0.6:6443] state[4/ESTABLISHED] flags[0x101] service[nenkoru-cluster-kubeapi.svc]
(79731)[2024-11-09T14:21:55.439Z] TRACE tunnel-sdk:netif_shim.c:34 netif_shim_output() writing packet TCP[100.64.0.6:6443 -> 100.64.0.1:58082] len=64
(79731)[2024-11-09T14:21:55.439Z] TRACE ziti-sdk:connect.c:902 flush_to_client() conn[0.3492/_jm5Oxq-/Connected] client consumed 24 out of 24 bytes
(79731)[2024-11-09T14:21:55.439Z] TRACE ziti-sdk:connect.c:878 flush_to_service() conn[0.3492/_jm5Oxq-/Connected] flushed 0 messages
(79731)[2024-11-09T14:21:55.439Z] TRACE ziti-sdk:connect.c:802 on_flush() conn[0.3492/_jm5Oxq-/Connected] stopping flusher
[2024-11-09T14:21:55:440Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 1 packets
(79731)[2024-11-09T14:21:55.439Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:58082] dst[tcp:100.64.0.6:6443] flags[ACK]
(79731)[2024-11-09T14:21:55.472Z] TRACE tunnel-sdk:ziti_tunnel.c:505 check_lwip_timeouts() next wake in 46 millis
(79731)[2024-11-09T14:21:55.519Z] TRACE tunnel-sdk:netif_shim.c:34 netif_shim_output() writing packet TCP[100.64.0.6:6443 -> 100.64.0.1:62014] len=40
(79731)[2024-11-09T14:21:55.519Z] TRACE tunnel-sdk:ziti_tunnel.c:505 check_lwip_timeouts() next wake in 250 millis
(79731)[2024-11-09T14:21:55.575Z] TRACE ziti-sdk:channel.c:905 on_channel_data() ch[0] on_data [len=520]
(79731)[2024-11-09T14:21:55.575Z] TRACE ziti-sdk:channel.c:589 process_inbound() ch[0] <= ct[ED72] seq[19220] len[106] hdrs[48]
(79731)[2024-11-09T14:21:55.575Z] TRACE ziti-sdk:channel.c:599 process_inbound() ch[0] completing msg seq[19220] body+hrds=106+48, in_offset=0, want=154, got=154
(79731)[2024-11-09T14:21:55.575Z] TRACE ziti-sdk:channel.c:610 process_inbound() ch[0] message is complete seq[19220] ct[ED72]
(79731)[2024-11-09T14:21:55.575Z] TRACE ziti-sdk:connect.c:809 flush_connection() conn[0.3414/ASUFiNCr/Connected] starting flusher
(79731)[2024-11-09T14:21:55.575Z] TRACE ziti-sdk:channel.c:589 process_inbound() ch[0] <= ct[ED72] seq[19221] len[278] hdrs[48]
(79731)[2024-11-09T14:21:55.575Z] TRACE ziti-sdk:channel.c:599 process_inbound() ch[0] completing msg seq[19221] body+hrds=278+48, in_offset=0, want=326, got=326
(79731)[2024-11-09T14:21:55.575Z] TRACE ziti-sdk:channel.c:610 process_inbound() ch[0] message is complete seq[19221] ct[ED72]
(79731)[2024-11-09T14:21:55.575Z] TRACE ziti-sdk:channel.c:900 on_channel_data() ch[0] read no data
(79731)[2024-11-09T14:21:55.575Z] TRACE ziti-sdk:connect.c:1429 process_edge_message() conn[0.3414/ASUFiNCr/Connected] <= ct[ED72] edge_seq[7907] len[106]
(79731)[2024-11-09T14:21:55.575Z] VERBOSE ziti-sdk:connect.c:959 conn_inbound_data_msg() conn[0.3414/ASUFiNCr/Connected] decrypting 106 bytes
(79731)[2024-11-09T14:21:55.575Z] VERBOSE ziti-sdk:connect.c:982 conn_inbound_data_msg() conn[0.3414/ASUFiNCr/Connected] decrypted 89 bytes tag[0]
(79731)[2024-11-09T14:21:55.575Z] TRACE ziti-sdk:connect.c:1429 process_edge_message() conn[0.3414/ASUFiNCr/Connected] <= ct[ED72] edge_seq[7908] len[278]
(79731)[2024-11-09T14:21:55.575Z] VERBOSE ziti-sdk:connect.c:959 conn_inbound_data_msg() conn[0.3414/ASUFiNCr/Connected] decrypting 278 bytes
(79731)[2024-11-09T14:21:55.575Z] VERBOSE ziti-sdk:connect.c:982 conn_inbound_data_msg() conn[0.3414/ASUFiNCr/Connected] decrypted 261 bytes tag[0]
(79731)[2024-11-09T14:21:55.575Z] VERBOSE ziti-sdk:connect.c:896 flush_to_client() conn[0.3414/ASUFiNCr/Connected] 350 bytes available
(79731)[2024-11-09T14:21:55.575Z] TRACE tunnel-cbs:ziti_tunnel_cbs.c:111 on_ziti_data() got 89 bytes from ziti
(79731)[2024-11-09T14:21:55.575Z] TRACE tunnel-sdk:tunnel_tcp.c:207 tunneler_tcp_write() sendlen=89 src[tcp:100.64.0.1:62014] dst[tcp:100.64.0.6:6443] state[4/ESTABLISHED] flags[0x100] service[nenkoru-cluster-kubeapi.svc]
(79731)[2024-11-09T14:21:55.575Z] TRACE tunnel-sdk:netif_shim.c:34 netif_shim_output() writing packet TCP[100.64.0.6:6443 -> 100.64.0.1:62014] len=129
(79731)[2024-11-09T14:21:55.575Z] TRACE ziti-sdk:connect.c:902 flush_to_client() conn[0.3414/ASUFiNCr/Connected] client consumed 89 out of 89 bytes
(79731)[2024-11-09T14:21:55.575Z] TRACE tunnel-cbs:ziti_tunnel_cbs.c:111 on_ziti_data() got 261 bytes from ziti
(79731)[2024-11-09T14:21:55.575Z] TRACE tunnel-sdk:tunnel_tcp.c:207 tunneler_tcp_write() sendlen=261 src[tcp:100.64.0.1:62014] dst[tcp:100.64.0.6:6443] state[4/ESTABLISHED] flags[0x100] service[nenkoru-cluster-kubeapi.svc]
(79731)[2024-11-09T14:21:55.575Z] TRACE ziti-sdk:connect.c:902 flush_to_client() conn[0.3414/ASUFiNCr/Connected] client consumed 261 out of 261 bytes
(79731)[2024-11-09T14:21:55.575Z] TRACE ziti-sdk:connect.c:878 flush_to_service() conn[0.3414/ASUFiNCr/Connected] flushed 0 messages
(79731)[2024-11-09T14:21:55.575Z] TRACE ziti-sdk:connect.c:802 on_flush() conn[0.3414/ASUFiNCr/Connected] stopping flusher
[2024-11-09T14:21:55:577Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 1 packets
(79731)[2024-11-09T14:21:55.576Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:62014] dst[tcp:100.64.0.6:6443] flags[ACK]
(79731)[2024-11-09T14:21:55.576Z] TRACE tunnel-sdk:netif_shim.c:34 netif_shim_output() writing packet TCP[100.64.0.6:6443 -> 100.64.0.1:62014] len=301
[2024-11-09T14:21:55:577Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 1 packets
(79731)[2024-11-09T14:21:55.577Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:62014] dst[tcp:100.64.0.6:6443] flags[ACK]
[2024-11-09T14:21:55:594Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 1 packets
(79731)[2024-11-09T14:21:55.594Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:62014] dst[tcp:100.64.0.6:6443] flags[PSH,ACK]
(79731)[2024-11-09T14:21:55.594Z] VERBOSE tunnel-sdk:tunnel_tcp.c:141 on_tcp_client_data() status 0 src[tcp:100.64.0.1:62014] dst[tcp:100.64.0.6:6443] state[4/ESTABLISHED] flags[0x101] service[nenkoru-cluster-kubeapi.svc]
(79731)[2024-11-09T14:21:55.594Z] TRACE ziti-sdk:connect.c:1280 ziti_write() conn[0.3414/ASUFiNCr/Connected] write 63 bytes
(79731)[2024-11-09T14:21:55.594Z] TRACE ziti-sdk:connect.c:809 flush_connection() conn[0.3414/ASUFiNCr/Connected] starting flusher
(79731)[2024-11-09T14:21:55.594Z] VERBOSE ziti-sdk:connect.c:896 flush_to_client() conn[0.3414/ASUFiNCr/Connected] 0 bytes available
(79731)[2024-11-09T14:21:55.594Z] TRACE ziti-sdk:connect.c:310 send_message() conn[0.3414/ASUFiNCr/Connected] => ct[ED72] uuid[f7e5e6a4:00001219:5cdd07ba] edge_seq[4633] len[80] hash[f7e5e6a4:8b8c2404:b577cf43:1dab16a7:80d68dca:9a7a56d1:d8dfee03:0cc5a44b]
(79731)[2024-11-09T14:21:55.594Z] TRACE ziti-sdk:channel.c:413 ziti_channel_send_message() ch[0] => ct[ED72] seq[11065] len[80]
(79731)[2024-11-09T14:21:55.594Z] TRACE ziti-sdk:channel.c:384 on_channel_send() ch[0] write delay = 0.000d q=1 qs=148
(79731)[2024-11-09T14:21:55.594Z] TRACE ziti-sdk:connect.c:238 on_write_completed() conn[0.3414/ASUFiNCr/Connected] status 0
(79731)[2024-11-09T14:21:55.594Z] TRACE ziti-sdk:connect.c:878 flush_to_service() conn[0.3414/ASUFiNCr/Connected] flushed 1 messages
(79731)[2024-11-09T14:21:55.594Z] TRACE ziti-sdk:connect.c:802 on_flush() conn[0.3414/ASUFiNCr/Connected] stopping flusher
(79731)[2024-11-09T14:21:55.729Z] TRACE ziti-sdk:channel.c:905 on_channel_data() ch[0] on_data [len=153]
(79731)[2024-11-09T14:21:55.729Z] TRACE ziti-sdk:channel.c:589 process_inbound() ch[0] <= ct[ED72] seq[19222] len[85] hdrs[48]
(79731)[2024-11-09T14:21:55.729Z] TRACE ziti-sdk:channel.c:599 process_inbound() ch[0] completing msg seq[19222] body+hrds=85+48, in_offset=0, want=133, got=133
(79731)[2024-11-09T14:21:55.729Z] TRACE ziti-sdk:channel.c:610 process_inbound() ch[0] message is complete seq[19222] ct[ED72]
(79731)[2024-11-09T14:21:55.729Z] TRACE ziti-sdk:connect.c:809 flush_connection() conn[0.3414/ASUFiNCr/Connected] starting flusher
(79731)[2024-11-09T14:21:55.729Z] TRACE ziti-sdk:channel.c:900 on_channel_data() ch[0] read no data
(79731)[2024-11-09T14:21:55.729Z] TRACE ziti-sdk:connect.c:1429 process_edge_message() conn[0.3414/ASUFiNCr/Connected] <= ct[ED72] edge_seq[7909] len[85]
(79731)[2024-11-09T14:21:55.729Z] VERBOSE ziti-sdk:connect.c:959 conn_inbound_data_msg() conn[0.3414/ASUFiNCr/Connected] decrypting 85 bytes
(79731)[2024-11-09T14:21:55.729Z] VERBOSE ziti-sdk:connect.c:982 conn_inbound_data_msg() conn[0.3414/ASUFiNCr/Connected] decrypted 68 bytes tag[0]
(79731)[2024-11-09T14:21:55.729Z] VERBOSE ziti-sdk:connect.c:896 flush_to_client() conn[0.3414/ASUFiNCr/Connected] 68 bytes available
(79731)[2024-11-09T14:21:55.729Z] TRACE tunnel-cbs:ziti_tunnel_cbs.c:111 on_ziti_data() got 68 bytes from ziti
(79731)[2024-11-09T14:21:55.729Z] TRACE tunnel-sdk:tunnel_tcp.c:207 tunneler_tcp_write() sendlen=68 src[tcp:100.64.0.1:62014] dst[tcp:100.64.0.6:6443] state[4/ESTABLISHED] flags[0x101] service[nenkoru-cluster-kubeapi.svc]
(79731)[2024-11-09T14:21:55.729Z] TRACE tunnel-sdk:netif_shim.c:34 netif_shim_output() writing packet TCP[100.64.0.6:6443 -> 100.64.0.1:62014] len=108
(79731)[2024-11-09T14:21:55.729Z] TRACE ziti-sdk:connect.c:902 flush_to_client() conn[0.3414/ASUFiNCr/Connected] client consumed 68 out of 68 bytes
(79731)[2024-11-09T14:21:55.729Z] TRACE ziti-sdk:connect.c:878 flush_to_service() conn[0.3414/ASUFiNCr/Connected] flushed 0 messages
(79731)[2024-11-09T14:21:55.729Z] TRACE ziti-sdk:connect.c:802 on_flush() conn[0.3414/ASUFiNCr/Connected] stopping flusher
[2024-11-09T14:21:55:730Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 1 packets
(79731)[2024-11-09T14:21:55.730Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:62014] dst[tcp:100.64.0.6:6443] flags[ACK]
(79731)[2024-11-09T14:21:55.740Z] TRACE ziti-sdk:channel.c:905 on_channel_data() ch[0] on_data [len=861]
(79731)[2024-11-09T14:21:55.740Z] TRACE ziti-sdk:channel.c:589 process_inbound() ch[0] <= ct[ED72] seq[19223] len[793] hdrs[48]
(79731)[2024-11-09T14:21:55.740Z] TRACE ziti-sdk:channel.c:599 process_inbound() ch[0] completing msg seq[19223] body+hrds=793+48, in_offset=0, want=841, got=841
(79731)[2024-11-09T14:21:55.740Z] TRACE ziti-sdk:channel.c:610 process_inbound() ch[0] message is complete seq[19223] ct[ED72]
(79731)[2024-11-09T14:21:55.740Z] TRACE ziti-sdk:connect.c:809 flush_connection() conn[0.3414/ASUFiNCr/Connected] starting flusher
(79731)[2024-11-09T14:21:55.740Z] TRACE ziti-sdk:channel.c:900 on_channel_data() ch[0] read no data
(79731)[2024-11-09T14:21:55.740Z] TRACE ziti-sdk:connect.c:1429 process_edge_message() conn[0.3414/ASUFiNCr/Connected] <= ct[ED72] edge_seq[7910] len[793]
(79731)[2024-11-09T14:21:55.740Z] VERBOSE ziti-sdk:connect.c:959 conn_inbound_data_msg() conn[0.3414/ASUFiNCr/Connected] decrypting 793 bytes
(79731)[2024-11-09T14:21:55.740Z] VERBOSE ziti-sdk:connect.c:982 conn_inbound_data_msg() conn[0.3414/ASUFiNCr/Connected] decrypted 776 bytes tag[0]
(79731)[2024-11-09T14:21:55.740Z] VERBOSE ziti-sdk:connect.c:896 flush_to_client() conn[0.3414/ASUFiNCr/Connected] 776 bytes available
(79731)[2024-11-09T14:21:55.740Z] TRACE tunnel-cbs:ziti_tunnel_cbs.c:111 on_ziti_data() got 776 bytes from ziti
(79731)[2024-11-09T14:21:55.740Z] TRACE tunnel-sdk:tunnel_tcp.c:207 tunneler_tcp_write() sendlen=776 src[tcp:100.64.0.1:62014] dst[tcp:100.64.0.6:6443] state[4/ESTABLISHED] flags[0x100] service[nenkoru-cluster-kubeapi.svc]
(79731)[2024-11-09T14:21:55.740Z] TRACE tunnel-sdk:netif_shim.c:34 netif_shim_output() writing packet TCP[100.64.0.6:6443 -> 100.64.0.1:62014] len=816
(79731)[2024-11-09T14:21:55.740Z] TRACE ziti-sdk:connect.c:902 flush_to_client() conn[0.3414/ASUFiNCr/Connected] client consumed 776 out of 776 bytes
(79731)[2024-11-09T14:21:55.740Z] TRACE ziti-sdk:connect.c:878 flush_to_service() conn[0.3414/ASUFiNCr/Connected] flushed 0 messages
(79731)[2024-11-09T14:21:55.740Z] TRACE ziti-sdk:connect.c:802 on_flush() conn[0.3414/ASUFiNCr/Connected] stopping flusher
[2024-11-09T14:21:55:741Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 1 packets
(79731)[2024-11-09T14:21:55.741Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:62014] dst[tcp:100.64.0.6:6443] flags[ACK]
(79731)[2024-11-09T14:21:55.770Z] TRACE tunnel-sdk:ziti_tunnel.c:505 check_lwip_timeouts() next wake in 250 millis
[2024-11-09T14:21:55:924Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 1 packets
(79731)[2024-11-09T14:21:55.924Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:61633] dst[tcp:100.64.0.3:443] flags[SYN]
(79731)[2024-11-09T14:21:55.924Z] DEBUG tunnel-sdk:tunnel_tcp.c:116 new_tcp_pcb() snd_wnd: 65535, snd_snd_max: 65535, mss: 3960
(79731)[2024-11-09T14:21:55.924Z] DEBUG tunnel-sdk:tunnel_tcp.c:438 recv_tcp() intercepted address[tcp:100.64.0.3:443] client[tcp:100.64.0.1:61633] service[vault-bayfut.svc]
(79731)[2024-11-09T14:21:55.924Z] VERBOSE tunnel-cbs:ziti_tunnel_cbs.c:287 ziti_sdk_c_dial() ziti_dial(name=vault-bayfut.svc)
(79731)[2024-11-09T14:21:55.924Z] DEBUG tunnel-cbs:ziti_tunnel_cbs.c:354 ziti_sdk_c_dial() service[vault-bayfut.svc] app_data_json[173]='{"connType":null,"dst_protocol":"tcp","dst_hostname":"vault.bayfut.net","dst_ip":"100.64.0.3","dst_port":"443","src_protocol":"tcp","src_ip":"100.64.0.1","src_port":"61633"}'
(79731)[2024-11-09T14:21:55.924Z] VERBOSE ziti-sdk:connect.c:125 conn_set_state() conn[0.3513/IkK0-v-f/Initial] transitioning Initial => Connecting
(79731)[2024-11-09T14:21:55.924Z] DEBUG ziti-sdk:connect.c:428 connect_get_service_cb() conn[0.3513/IkK0-v-f/Connecting] got service[vault-bayfut.svc] id[8fPqpz8sAU2tZIiyIDfos]
(79731)[2024-11-09T14:21:55.924Z] VERBOSE ziti-sdk:posture.c:196 ziti_send_posture_data() ztx[0] starting to send posture data
(79731)[2024-11-09T14:21:55.924Z] DEBUG ziti-sdk:posture.c:213 ziti_send_posture_data() ztx[0] posture checks must_send set to TRUE, new_session_id[FALSE], must_send_every_time[TRUE], new_controller_instance[FALSE]
(79731)[2024-11-09T14:21:55.924Z] VERBOSE ziti-sdk:posture.c:238 ziti_send_posture_data() ztx[0] checking posture queries on 22 service(s)
(79731)[2024-11-09T14:21:55.924Z] VERBOSE ziti-sdk:posture.c:536 ziti_pr_send_bulk() ztx[0] no change in posture data, not sending
(79731)[2024-11-09T14:21:55.924Z] DEBUG ziti-sdk:connect.c:549 process_connect() conn[0.3513/IkK0-v-f/Connecting] starting Dial connection for service[vault-bayfut.svc] with session[cm392bmnq4bcflijx4lk641mc]
(79731)[2024-11-09T14:21:55.924Z] DEBUG ziti-sdk:connect.c:406 ziti_connect() conn[0.3513/IkK0-v-f/Connecting] selected ch[openziti-edgerouter-02@tls://ziti.nenkoru.com:3023] for best latency(179 ms)
(79731)[2024-11-09T14:21:55.924Z] TRACE ziti-sdk:connect.c:1124 ziti_channel_start_connection() conn[0.3513/IkK0-v-f/Connecting] ch[0] => Edge Connect request token[e8a4da4f-60cc-4526-8283-52b7b29be8ef]
(79731)[2024-11-09T14:21:55.924Z] DEBUG ziti-sdk:channel.c:244 ziti_channel_add_receiver() ch[0] added receiver[3513]
(79731)[2024-11-09T14:21:55.924Z] TRACE ziti-sdk:channel.c:413 ziti_channel_send_message() ch[0] => ct[ED6F] seq[11066] len[36]
(79731)[2024-11-09T14:21:55.924Z] TRACE ziti-sdk:channel.c:384 on_channel_send() ch[0] write delay = 0.000d q=1 qs=354
(79731)[2024-11-09T14:21:55.924Z] TRACE tunnel-sdk:ziti_tunnel.c:505 check_lwip_timeouts() next wake in 95 millis
(79731)[2024-11-09T14:21:56.020Z] TRACE tunnel-sdk:ziti_tunnel.c:505 check_lwip_timeouts() next wake in 250 millis
(79731)[2024-11-09T14:21:56.088Z] TRACE ziti-sdk:channel.c:905 on_channel_data() ch[0] on_data [len=217]
(79731)[2024-11-09T14:21:56.088Z] TRACE ziti-sdk:channel.c:589 process_inbound() ch[0] <= ct[ED70] seq[19224] len[0] hdrs[105]
(79731)[2024-11-09T14:21:56.088Z] TRACE ziti-sdk:channel.c:599 process_inbound() ch[0] completing msg seq[19224] body+hrds=0+105, in_offset=0, want=105, got=105
(79731)[2024-11-09T14:21:56.088Z] TRACE ziti-sdk:channel.c:610 process_inbound() ch[0] message is complete seq[19224] ct[ED70]
(79731)[2024-11-09T14:21:56.088Z] TRACE ziti-sdk:connect.c:1079 connect_reply_cb() conn[0.3513/IkK0-v-f/Connecting] connected
(79731)[2024-11-09T14:21:56.088Z] TRACE ziti-sdk:connect.c:809 flush_connection() conn[0.3513/IkK0-v-f/Connecting] starting flusher
(79731)[2024-11-09T14:21:56.088Z] VERBOSE ziti-sdk:connect.c:125 conn_set_state() conn[0.3513/IkK0-v-f/Connecting] transitioning Connecting => Connected
(79731)[2024-11-09T14:21:56.088Z] VERBOSE tunnel-cbs:ziti_tunnel_cbs.c:93 on_ziti_connect() on_ziti_connect status: 0
(79731)[2024-11-09T14:21:56.088Z] DEBUG tunnel-sdk:ziti_tunnel.c:221 ziti_tunneler_dial_completed() ziti dial succeeded: client[tcp:100.64.0.1:61633] service[vault-bayfut.svc]
(79731)[2024-11-09T14:21:56.088Z] TRACE tunnel-sdk:netif_shim.c:34 netif_shim_output() writing packet TCP[100.64.0.3:443 -> 100.64.0.1:61633] len=48
(79731)[2024-11-09T14:21:56.088Z] TRACE ziti-sdk:channel.c:589 process_inbound() ch[0] <= ct[ED72] seq[19225] len[24] hdrs[48]
(79731)[2024-11-09T14:21:56.088Z] TRACE ziti-sdk:channel.c:599 process_inbound() ch[0] completing msg seq[19225] body+hrds=24+48, in_offset=0, want=72, got=72
(79731)[2024-11-09T14:21:56.088Z] TRACE ziti-sdk:channel.c:610 process_inbound() ch[0] message is complete seq[19225] ct[ED72]
(79731)[2024-11-09T14:21:56.088Z] TRACE ziti-sdk:channel.c:900 on_channel_data() ch[0] read no data
(79731)[2024-11-09T14:21:56.089Z] TRACE ziti-sdk:connect.c:1429 process_edge_message() conn[0.3513/IkK0-v-f/Connected] <= ct[ED72] edge_seq[1] len[24]
(79731)[2024-11-09T14:21:56.089Z] VERBOSE ziti-sdk:connect.c:949 conn_inbound_data_msg() conn[0.3513/IkK0-v-f/Connected] processing crypto header(24 bytes)
(79731)[2024-11-09T14:21:56.089Z] VERBOSE ziti-sdk:connect.c:952 conn_inbound_data_msg() conn[0.3513/IkK0-v-f/Connected] processed crypto header
(79731)[2024-11-09T14:21:56.089Z] VERBOSE ziti-sdk:connect.c:896 flush_to_client() conn[0.3513/IkK0-v-f/Connected] 0 bytes available
(79731)[2024-11-09T14:21:56.089Z] TRACE ziti-sdk:connect.c:310 send_message() conn[0.3513/IkK0-v-f/Connected] => ct[ED72] uuid[31e3ab03:00000000:5cdd09a7] edge_seq[0] len[24] hash[31e3ab03:dcae3c46:de1df84a:4853911e:853cba8b:bf7f8381:c220cd44:79853936]
(79731)[2024-11-09T14:21:56.089Z] TRACE ziti-sdk:channel.c:413 ziti_channel_send_message() ch[0] => ct[ED72] seq[11067] len[24]
[2024-11-09T14:21:56:090Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 1 packets
(79731)[2024-11-09T14:21:56.089Z] TRACE ziti-sdk:channel.c:384 on_channel_send() ch[0] write delay = 0.000d q=1 qs=104
(79731)[2024-11-09T14:21:56.089Z] TRACE ziti-sdk:connect.c:238 on_write_completed() conn[0.3513/IkK0-v-f/Connected] status 0
(79731)[2024-11-09T14:21:56.089Z] TRACE ziti-sdk:connect.c:878 flush_to_service() conn[0.3513/IkK0-v-f/Connected] flushed 1 messages
(79731)[2024-11-09T14:21:56.089Z] TRACE ziti-sdk:connect.c:802 on_flush() conn[0.3513/IkK0-v-f/Connected] stopping flusher
(79731)[2024-11-09T14:21:56.090Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:61633] dst[tcp:100.64.0.3:443] flags[ACK]
(79731)[2024-11-09T14:21:56.090Z] DEBUG tunnel-sdk:tunnel_tcp.c:66 on_accept() on_accept: 0
[2024-11-09T14:21:56:091Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 1 packets
(79731)[2024-11-09T14:21:56.090Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:61633] dst[tcp:100.64.0.3:443] flags[PSH,ACK]
(79731)[2024-11-09T14:21:56.090Z] VERBOSE tunnel-sdk:tunnel_tcp.c:141 on_tcp_client_data() status 0 src[tcp:100.64.0.1:61633] dst[tcp:100.64.0.3:443] state[4/ESTABLISHED] flags[0x101] service[vault-bayfut.svc]
(79731)[2024-11-09T14:21:56.090Z] TRACE ziti-sdk:connect.c:1280 ziti_write() conn[0.3513/IkK0-v-f/Connected] write 326 bytes
(79731)[2024-11-09T14:21:56.090Z] TRACE ziti-sdk:connect.c:809 flush_connection() conn[0.3513/IkK0-v-f/Connected] starting flusher
(79731)[2024-11-09T14:21:56.091Z] VERBOSE ziti-sdk:connect.c:896 flush_to_client() conn[0.3513/IkK0-v-f/Connected] 0 bytes available
(79731)[2024-11-09T14:21:56.091Z] TRACE ziti-sdk:connect.c:310 send_message() conn[0.3513/IkK0-v-f/Connected] => ct[ED72] uuid[5b3357a7:00000001:5cdd09ab] edge_seq[1] len[343] hash[5b3357a7:7e488ef3:80a2e44b:69e28f9b:c031e979:83f63f97:997c8bfb:2af7a974]
(79731)[2024-11-09T14:21:56.091Z] TRACE ziti-sdk:channel.c:413 ziti_channel_send_message() ch[0] => ct[ED72] seq[11068] len[343]
(79731)[2024-11-09T14:21:56.091Z] TRACE ziti-sdk:channel.c:384 on_channel_send() ch[0] write delay = 0.000d q=1 qs=411
(79731)[2024-11-09T14:21:56.091Z] TRACE ziti-sdk:connect.c:238 on_write_completed() conn[0.3513/IkK0-v-f/Connected] status 0
(79731)[2024-11-09T14:21:56.091Z] TRACE ziti-sdk:connect.c:878 flush_to_service() conn[0.3513/IkK0-v-f/Connected] flushed 1 messages
(79731)[2024-11-09T14:21:56.091Z] TRACE ziti-sdk:connect.c:802 on_flush() conn[0.3513/IkK0-v-f/Connected] stopping flusher
(79731)[2024-11-09T14:21:56.271Z] TRACE tunnel-sdk:netif_shim.c:34 netif_shim_output() writing packet TCP[100.64.0.3:443 -> 100.64.0.1:61633] len=40
(79731)[2024-11-09T14:21:56.271Z] TRACE tunnel-sdk:ziti_tunnel.c:505 check_lwip_timeouts() next wake in 200 millis
(79731)[2024-11-09T14:21:56.398Z] TRACE ziti-sdk:channel.c:905 on_channel_data() ch[0] on_data [len=365]
(79731)[2024-11-09T14:21:56.398Z] TRACE ziti-sdk:channel.c:589 process_inbound() ch[0] <= ct[ED72] seq[19226] len[297] hdrs[48]
(79731)[2024-11-09T14:21:56.398Z] TRACE ziti-sdk:channel.c:599 process_inbound() ch[0] completing msg seq[19226] body+hrds=297+48, in_offset=0, want=345, got=345
(79731)[2024-11-09T14:21:56.398Z] TRACE ziti-sdk:channel.c:610 process_inbound() ch[0] message is complete seq[19226] ct[ED72]
(79731)[2024-11-09T14:21:56.398Z] TRACE ziti-sdk:connect.c:809 flush_connection() conn[0.3513/IkK0-v-f/Connected] starting flusher
(79731)[2024-11-09T14:21:56.398Z] TRACE ziti-sdk:channel.c:900 on_channel_data() ch[0] read no data
(79731)[2024-11-09T14:21:56.399Z] TRACE ziti-sdk:connect.c:1429 process_edge_message() conn[0.3513/IkK0-v-f/Connected] <= ct[ED72] edge_seq[2] len[297]
(79731)[2024-11-09T14:21:56.399Z] VERBOSE ziti-sdk:connect.c:959 conn_inbound_data_msg() conn[0.3513/IkK0-v-f/Connected] decrypting 297 bytes
(79731)[2024-11-09T14:21:56.399Z] VERBOSE ziti-sdk:connect.c:982 conn_inbound_data_msg() conn[0.3513/IkK0-v-f/Connected] decrypted 280 bytes tag[0]
(79731)[2024-11-09T14:21:56.399Z] VERBOSE ziti-sdk:connect.c:896 flush_to_client() conn[0.3513/IkK0-v-f/Connected] 280 bytes available
(79731)[2024-11-09T14:21:56.399Z] TRACE tunnel-cbs:ziti_tunnel_cbs.c:111 on_ziti_data() got 280 bytes from ziti
(79731)[2024-11-09T14:21:56.399Z] TRACE tunnel-sdk:tunnel_tcp.c:207 tunneler_tcp_write() sendlen=280 src[tcp:100.64.0.1:61633] dst[tcp:100.64.0.3:443] state[4/ESTABLISHED] flags[0x100] service[vault-bayfut.svc]
(79731)[2024-11-09T14:21:56.399Z] TRACE tunnel-sdk:netif_shim.c:34 netif_shim_output() writing packet TCP[100.64.0.3:443 -> 100.64.0.1:61633] len=320
(79731)[2024-11-09T14:21:56.399Z] TRACE ziti-sdk:connect.c:902 flush_to_client() conn[0.3513/IkK0-v-f/Connected] client consumed 280 out of 280 bytes
(79731)[2024-11-09T14:21:56.399Z] TRACE ziti-sdk:connect.c:878 flush_to_service() conn[0.3513/IkK0-v-f/Connected] flushed 0 messages
(79731)[2024-11-09T14:21:56.399Z] TRACE ziti-sdk:connect.c:802 on_flush() conn[0.3513/IkK0-v-f/Connected] stopping flusher
[2024-11-09T14:21:56:400Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 1 packets
(79731)[2024-11-09T14:21:56.400Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:61633] dst[tcp:100.64.0.3:443] flags[ACK]
[2024-11-09T14:21:56:400Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 1 packets
[2024-11-09T14:21:56:401Z] TRACE PacketTunnelProvider:PacketTunnelProvider.swift:287 readPacketFlow() read 1 packets
(79731)[2024-11-09T14:21:56.400Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:61633] dst[tcp:100.64.0.3:443] flags[PSH,ACK]
(79731)[2024-11-09T14:21:56.400Z] VERBOSE tunnel-sdk:tunnel_tcp.c:141 on_tcp_client_data() status 0 src[tcp:100.64.0.1:61633] dst[tcp:100.64.0.3:443] state[4/ESTABLISHED] flags[0x101] service[vault-bayfut.svc]
(79731)[2024-11-09T14:21:56.400Z] TRACE ziti-sdk:connect.c:1280 ziti_write() conn[0.3513/IkK0-v-f/Connected] write 7 bytes
(79731)[2024-11-09T14:21:56.400Z] TRACE ziti-sdk:connect.c:809 flush_connection() conn[0.3513/IkK0-v-f/Connected] starting flusher
(79731)[2024-11-09T14:21:56.401Z] VERBOSE ziti-sdk:connect.c:896 flush_to_client() conn[0.3513/IkK0-v-f/Connected] 0 bytes available
(79731)[2024-11-09T14:21:56.401Z] TRACE ziti-sdk:connect.c:310 send_message() conn[0.3513/IkK0-v-f/Connected] => ct[ED72] uuid[266dd277:00000002:5cdd0ae1] edge_seq[2] len[24] hash[266dd277:9b083274:a66b075a:60848ba0:5ad7e4d2:474f7d80:c1e8a48a:f6588003]
(79731)[2024-11-09T14:21:56.401Z] TRACE ziti-sdk:channel.c:413 ziti_channel_send_message() ch[0] => ct[ED72] seq[11069] len[24]
(79731)[2024-11-09T14:21:56.401Z] TRACE ziti-sdk:channel.c:384 on_channel_send() ch[0] write delay = 0.000d q=1 qs=92
(79731)[2024-11-09T14:21:56.401Z] TRACE ziti-sdk:connect.c:238 on_write_completed() conn[0.3513/IkK0-v-f/Connected] status 0
(79731)[2024-11-09T14:21:56.401Z] TRACE ziti-sdk:connect.c:878 flush_to_service() conn[0.3513/IkK0-v-f/Connected] flushed 1 messages
(79731)[2024-11-09T14:21:56.401Z] TRACE ziti-sdk:connect.c:802 on_flush() conn[0.3513/IkK0-v-f/Connected] stopping flusher
(79731)[2024-11-09T14:21:56.401Z] TRACE tunnel-sdk:tunnel_tcp.c:371 recv_tcp() received segment src[tcp:100.64.0.1:61633] dst[tcp:100.64.0.3:443] flags[RST,ACK]
(79731)[2024-11-09T14:21:56.401Z] ERROR tunnel-sdk:tunnel_tcp.c:190 on_tcp_client_err() client=tcp:100.64.0.1:61633 err=-14, terminating connection
(79731)[2024-11-09T14:21:56.401Z] DEBUG tunnel-cbs:ziti_tunnel_cbs.c:150 ziti_sdk_c_close() closing ziti_conn tnlr_eof=0, ziti_eof=0
(79731)[2024-11-09T14:21:56.401Z] TRACE ziti-sdk:connect.c:809 flush_connection() conn[0.3513/IkK0-v-f/Connected] starting flusher
(79731)[2024-11-09T14:21:56.401Z] DEBUG ziti-sdk:connect.c:892 flush_to_client() conn[0.3513/IkK0-v-f/Connected] no data_cb: can't flush, 0 bytes available
(79731)[2024-11-09T14:21:56.401Z] TRACE ziti-sdk:channel.c:413 ziti_channel_send_message() ch[0] => ct[ED71] seq[11070] len[0]
(79731)[2024-11-09T14:21:56.401Z] TRACE ziti-sdk:channel.c:384 on_channel_send() ch[0] write delay = 0.000d q=1 qs=44
(79731)[2024-11-09T14:21:56.401Z] TRACE ziti-sdk:connect.c:238 on_write_completed() conn[0.3513/IkK0-v-f/Connected] status 0
(79731)[2024-11-09T14:21:56.401Z] VERBOSE ziti-sdk:connect.c:125 conn_set_state() conn[0.3513/IkK0-v-f/Connected] transitioning Connected => Closed
(79731)[2024-11-09T14:21:56.401Z] DEBUG ziti-sdk:channel.c:251 ziti_channel_rem_receiver() ch[0] removed receiver[3513]
(79731)[2024-11-09T14:21:56.401Z] TRACE ziti-sdk:connect.c:878 flush_to_service() conn[0.3513/IkK0-v-f/Closed] flushed 1 messages
(79731)[2024-11-09T14:21:56.401Z] TRACE ziti-sdk:connect.c:802 on_flush() conn[0.3513/IkK0-v-f/Closed] stopping flusher
(79731)[2024-11-09T14:21:56.401Z] DEBUG ziti-sdk:connect.c:182 close_conn_internal() conn[0.3513/IkK0-v-f/Closed] removing
(79731)[2024-11-09T14:21:56.401Z] TRACE tunnel-cbs:ziti_tunnel_cbs.c:598 ziti_conn_close_cb() ziti_conn[0x159767bc0] is closed
(79731)[2024-11-09T14:21:56.401Z] DEBUG tunnel-sdk:ziti_tunnel.c:435 ziti_tunneler_close() closing connection: client[tcp:100.64.0.1:61633] service[vault-bayfut.svc]
(79731)[2024-11-09T14:21:56.401Z] DEBUG tunnel-sdk:tunnel_tcp.c:248 tunneler_tcp_close() null pcb
(79731)[2024-11-09T14:21:56.401Z] VERBOSE tunnel-cbs:ziti_tunnel_cbs.c:611 ziti_conn_close_cb() nulled data for ziti_conn[0x159767bc0]
(79731)[2024-11-09T14:21:56.401Z] TRACE ziti-sdk:connect.c:223 close_conn_internal() conn[0.3513/IkK0-v-f/Closed] is being free()'d
(79731)[2024-11-09T14:21:56.401Z] DEBUG ziti-sdk:ziti.c:1502 grim_reaper() ztx[0] reaped 1 closed (out of 8 total) connections
(79731)[2024-11-09T14:21:56.403Z] TRACE ziti-sdk:channel.c:905 on_channel_data() ch[0] on_data [len=56]
(79731)[2024-11-09T14:21:56.403Z] TRACE ziti-sdk:channel.c:589 process_inbound() ch[0] <= ct[ED72] seq[19227] len[0] hdrs[36]
(79731)[2024-11-09T14:21:56.403Z] TRACE ziti-sdk:channel.c:599 process_inbound() ch[0] completing msg seq[19227] body+hrds=0+36, in_offset=0, want=36, got=36
(79731)[2024-11-09T14:21:56.403Z] TRACE ziti-sdk:channel.c:610 process_inbound() ch[0] message is complete seq[19227] ct[ED72]
(79731)[2024-11-09T14:21:56.403Z] WARN ziti-sdk:channel.c:554 dispatch_message() ch[0] received message without conn_id or for unknown connection ct[ED72] conn_id[3513]
(79731)[2024-11-09T14:21:56.403Z] TRACE ziti-sdk:channel.c:900 on_channel_data() ch[0] read no data
(79731)[2024-11-09T14:21:56.472Z] TRACE tunnel-sdk:ziti_tunnel.c:505 check_lwip_timeouts() next wake in 49 millis
(79731)[2024-11-09T14:21:56.522Z] TRACE tunnel-sdk:ziti_tunnel.c:505 check_lwip_timeouts() next wake in 250 millis
(79731)[2024-11-09T14:21:56.773Z] TRACE tunnel-sdk:ziti_tunnel.c:505 check_lwip_timeouts() next wake in 250 millis
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment