Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

non symmetric sync? #2319

Open
divagant-martian opened this issue May 23, 2024 · 2 comments
Open

non symmetric sync? #2319

divagant-martian opened this issue May 23, 2024 · 2 comments
Assignees
Milestone

Comments

@divagant-martian
Copy link
Contributor

divagant-martian commented May 23, 2024

These are the full logs of a test failure for test_download_policies. This is not a frequent failure at all so having the logs is a great opportunity to understand what's going on with this sync/docs problem.

The test setup is as follows:

  • There are two nodes: nkpqjtgrfsdzojzk (NK) and wp3g26raw2ercopv (WP),
  • NK has 6 locally inserted entries.
  • WP has 3 locally inserted entries.
  • Both nodes are supposed to sync all entries from the other node, of course.
  • NK should download 1 of the entries WP has.
  • WP should download 3 of the entries NK has.
  • At the end of the test we assert that these exact numbers are upheld (sync and download ones).

What actually happens:

  • Nodes connect to each other.
  • They both emit the start sync log/event
  • WP emits the RemoteInsert events it should
  • WP downloads the entries it should
  • Silence from NK, no RemoteInsert at all, and of course no downloads either.

Notable logs:

DEBUG sync{me=nkpqjtgrfsdzojzk}: iroh::docs_engine::live: start sync namespace=NamespaceId(6gebwlyf7po3fygx) peers=0
DEBUG sync{me=wp3g26raw2ercopv}: iroh::docs_engine::live: start sync namespace=NamespaceId(6gebwlyf7po3fygx) peers=1

NK claims to be starting sync with 0 peers. This is weird and potentially a problem on itself. However the fact that WP is actively communicating and successfully syncing with NK tells me there is a connection and sync messages are being passed. Still, NK is not using that info on its side, which leads me to conclude sync is not happening symmetrically

2024-05-21T16:59:39.1896110Z --- STDERR:              iroh::sync test_download_policies ---
2024-05-21T16:59:39.1897010Z 2024-05-21T16:58:38.833998Z DEBUG iroh_docs::store::fs::migrations: Start migration migration_001_populate_latest_table
2024-05-21T16:59:39.1898090Z 2024-05-21T16:58:38.834052Z DEBUG iroh_docs::store::fs::migrations: Skip migration migration_001_populate_latest_table: Not needed
2024-05-21T16:59:39.1899420Z 2024-05-21T16:58:38.834069Z DEBUG iroh_docs::store::fs::migrations: Start migration migration_002_namespaces_populate_v2
2024-05-21T16:59:39.1900530Z 2024-05-21T16:58:38.834113Z DEBUG iroh_docs::store::fs::migrations: Skip migration migration_002_namespaces_populate_v2: Not needed
2024-05-21T16:59:39.1901580Z 2024-05-21T16:58:38.834123Z DEBUG iroh_docs::store::fs::migrations: Start migration migration_003_namespaces_delete_v1
2024-05-21T16:59:39.1902610Z 2024-05-21T16:58:38.834157Z DEBUG iroh_docs::store::fs::migrations: Skip migration migration_003_namespaces_delete_v1: Not needed
2024-05-21T16:59:39.1903650Z 2024-05-21T16:58:38.834166Z DEBUG iroh_docs::store::fs::migrations: Start migration migration_004_populate_by_key_index
2024-05-21T16:59:39.1904730Z 2024-05-21T16:58:38.834227Z  INFO iroh_docs::store::fs::migrations: Executed migration migration_004_populate_by_key_index (0 rows affected)
2024-05-21T16:59:39.1906300Z 2024-05-21T16:58:38.842976Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}: iroh_net::magicsock::udp_conn: binding network=V4 port=11204
2024-05-21T16:59:39.1908410Z 2024-05-21T16:58:38.842998Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}: iroh_net::magicsock::udp_conn: candidate ports ports=[11204, 0]
2024-05-21T16:59:39.1910230Z 2024-05-21T16:58:38.843756Z  WARN magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}: iroh_net::magicsock::udp_conn: failed to bind: Error {
2024-05-21T16:59:39.1911140Z     context: "0.0.0.0:11204",
2024-05-21T16:59:39.1911360Z     source: Error {
2024-05-21T16:59:39.1911540Z         context: "binding",
2024-05-21T16:59:39.1911760Z         source: Os {
2024-05-21T16:59:39.1911940Z             code: 48,
2024-05-21T16:59:39.1912120Z             kind: AddrInUse,
2024-05-21T16:59:39.1912370Z             message: "Address already in use",
2024-05-21T16:59:39.1912620Z         },
2024-05-21T16:59:39.1912770Z     },
2024-05-21T16:59:39.1913010Z } network=V4 port=11204
2024-05-21T16:59:39.1914320Z 2024-05-21T16:58:38.843825Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}: iroh_net::magicsock::udp_conn: successfully bound network=V4 local_addr=0.0.0.0:51664
2024-05-21T16:59:39.1916660Z 2024-05-21T16:58:38.843845Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}: iroh_net::magicsock::udp_conn: binding network=V6 port=51665
2024-05-21T16:59:39.1918550Z 2024-05-21T16:58:38.843858Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}: iroh_net::magicsock::udp_conn: candidate ports ports=[51665, 0]
2024-05-21T16:59:39.1920500Z 2024-05-21T16:58:38.843891Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}: iroh_net::magicsock::udp_conn: successfully bound network=V6 local_addr=[::]:51665
2024-05-21T16:59:39.1921990Z 2024-05-21T16:58:38.853442Z DEBUG iroh::node::builder: rpc listening on: []
2024-05-21T16:59:39.1922890Z 2024-05-21T16:58:38.922790Z DEBUG iroh_docs::store::fs::migrations: Start migration migration_001_populate_latest_table
2024-05-21T16:59:39.1923930Z 2024-05-21T16:58:38.922829Z DEBUG iroh_docs::store::fs::migrations: Skip migration migration_001_populate_latest_table: Not needed
2024-05-21T16:59:39.1924970Z 2024-05-21T16:58:38.922842Z DEBUG iroh_docs::store::fs::migrations: Start migration migration_002_namespaces_populate_v2
2024-05-21T16:59:39.1926000Z 2024-05-21T16:58:38.922887Z DEBUG iroh_docs::store::fs::migrations: Skip migration migration_002_namespaces_populate_v2: Not needed
2024-05-21T16:59:39.1927080Z 2024-05-21T16:58:38.922898Z DEBUG iroh_docs::store::fs::migrations: Start migration migration_003_namespaces_delete_v1
2024-05-21T16:59:39.1928190Z 2024-05-21T16:58:38.922933Z DEBUG iroh_docs::store::fs::migrations: Skip migration migration_003_namespaces_delete_v1: Not needed
2024-05-21T16:59:39.1929230Z 2024-05-21T16:58:38.922943Z DEBUG iroh_docs::store::fs::migrations: Start migration migration_004_populate_by_key_index
2024-05-21T16:59:39.1930280Z 2024-05-21T16:58:38.923014Z  INFO iroh_docs::store::fs::migrations: Executed migration migration_004_populate_by_key_index (0 rows affected)
2024-05-21T16:59:39.1931790Z 2024-05-21T16:58:38.924200Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}: iroh_net::magicsock::udp_conn: binding network=V4 port=11204
2024-05-21T16:59:39.1933650Z 2024-05-21T16:58:38.924221Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}: iroh_net::magicsock::udp_conn: candidate ports ports=[11204, 0]
2024-05-21T16:59:39.1935490Z 2024-05-21T16:58:38.924329Z  WARN magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}: iroh_net::magicsock::udp_conn: failed to bind: Error {
2024-05-21T16:59:39.1936370Z     context: "0.0.0.0:11204",
2024-05-21T16:59:39.1936580Z     source: Error {
2024-05-21T16:59:39.1936760Z         context: "binding",
2024-05-21T16:59:39.1936950Z         source: Os {
2024-05-21T16:59:39.1944660Z             code: 48,
2024-05-21T16:59:39.1944840Z             kind: AddrInUse,
2024-05-21T16:59:39.1945070Z             message: "Address already in use",
2024-05-21T16:59:39.1945310Z         },
2024-05-21T16:59:39.1945650Z     },
2024-05-21T16:59:39.1945930Z } network=V4 port=11204
2024-05-21T16:59:39.1947160Z 2024-05-21T16:58:38.924380Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}: iroh_net::magicsock::udp_conn: successfully bound network=V4 local_addr=0.0.0.0:58263
2024-05-21T16:59:39.1949000Z 2024-05-21T16:58:38.924400Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}: iroh_net::magicsock::udp_conn: binding network=V6 port=58264
2024-05-21T16:59:39.1950740Z 2024-05-21T16:58:38.924413Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}: iroh_net::magicsock::udp_conn: candidate ports ports=[58264, 0]
2024-05-21T16:59:39.1952640Z 2024-05-21T16:58:38.924446Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}: iroh_net::magicsock::udp_conn: successfully bound network=V6 local_addr=[::]:58264
2024-05-21T16:59:39.1954140Z 2024-05-21T16:58:38.928986Z DEBUG iroh::node::builder: rpc listening on: []
2024-05-21T16:59:39.1955370Z 2024-05-21T16:58:38.929044Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:portmapper.service: iroh_net::portmapper: portmap starting
2024-05-21T16:59:39.1957180Z 2024-05-21T16:58:38.929270Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:portmapper.service: iroh_net::portmapper: getting a port mapping for 167.235.14.200:51664 -> None
2024-05-21T16:59:39.1958960Z 2024-05-21T16:58:38.929312Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:netcheck.actor: iroh_net::netcheck: netcheck actor starting
2024-05-21T16:59:39.1960700Z 2024-05-21T16:58:38.929414Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor: iroh_net::magicsock: scheduling periodic_stun to run immediately and in 21s
2024-05-21T16:59:39.1962440Z 2024-05-21T16:58:38.929496Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:portmapper.service: iroh_net::portmapper: portmap starting
2024-05-21T16:59:39.1964230Z 2024-05-21T16:58:38.929702Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:portmapper.service: iroh_net::portmapper: getting a port mapping for 167.235.14.200:58263 -> None
2024-05-21T16:59:39.1966010Z 2024-05-21T16:58:38.929729Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:netcheck.actor: iroh_net::netcheck: netcheck actor starting
2024-05-21T16:59:39.1967880Z 2024-05-21T16:58:38.929762Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor: iroh_net::magicsock: scheduling periodic_stun to run immediately and in 21s
2024-05-21T16:59:39.1969910Z 2024-05-21T16:58:38.929836Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:portmapper.service:upnp: igd_next::aio::tokio: sending broadcast request to: 239.255.255.250:1900 on interface: Ok(0.0.0.0:60555)    
2024-05-21T16:59:39.1972100Z 2024-05-21T16:58:38.929911Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:portmapper.service:upnp: igd_next::aio::tokio: sending broadcast request to: 239.255.255.250:1900 on interface: Ok(0.0.0.0:49572)    
2024-05-21T16:59:39.1974280Z 2024-05-21T16:58:38.930056Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:re_stun{me=nkpqjtgrfsdzojzk}: iroh_net::magicsock: re_stun: periodic
2024-05-21T16:59:39.1976190Z 2024-05-21T16:58:38.930094Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:update_endpoints: iroh_net::magicsock: starting endpoint update (periodic)
2024-05-21T16:59:39.1978230Z 2024-05-21T16:58:38.930118Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:update_endpoints:update_net_info: iroh_net::magicsock: skipping netcheck, empty RelayMap
2024-05-21T16:59:39.1980110Z 2024-05-21T16:58:38.932027Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor: iroh_net::magicsock: endpoints changed: 167.235.14.200:51664 (local)
2024-05-21T16:59:39.1981830Z 2024-05-21T16:58:38.932068Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor: iroh_net::magicsock: scheduling periodic_stun to run in 20s
2024-05-21T16:59:39.1983530Z 2024-05-21T16:58:38.932088Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor: iroh_net::magicsock: endpoint update done (periodic)
2024-05-21T16:59:39.1985310Z 2024-05-21T16:58:38.932320Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:portmapper.service: iroh_net::portmapper: getting a port mapping for 167.235.14.200:51664 -> None
2024-05-21T16:59:39.1986900Z 2024-05-21T16:58:38.932354Z DEBUG pkarr_publish{me=nkpqjtgrfsdzojzk}: iroh_net::discovery::pkarr_publish: Publish node info to pkarr (info changed)
2024-05-21T16:59:39.1988410Z 2024-05-21T16:58:38.932365Z  INFO pkarr_publish{me=nkpqjtgrfsdzojzk}: iroh_net::discovery::pkarr_publish: Publish node info to pkarr relay_url=None
2024-05-21T16:59:39.1989800Z 2024-05-21T16:58:38.932767Z DEBUG pkarr_publish{me=nkpqjtgrfsdzojzk}: reqwest::connect: starting new connection: https://dns.iroh.link/    
2024-05-21T16:59:39.1990820Z 2024-05-21T16:58:38.932846Z DEBUG hyper::client::connect::dns: resolving host="dns.iroh.link"
2024-05-21T16:59:39.1992370Z 2024-05-21T16:58:38.932856Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:portmapper.service:upnp: igd_next::aio::tokio: sending broadcast request to: 239.255.255.250:1900 on interface: Ok(0.0.0.0:49557)    
2024-05-21T16:59:39.1994070Z 2024-05-21T16:58:38.933292Z  INFO sync: node spawned i=0 me=nkpqjtgrfsdzojzk
2024-05-21T16:59:39.1995550Z 2024-05-21T16:58:38.933374Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:re_stun{me=wp3g26raw2ercopv}: iroh_net::magicsock: re_stun: periodic
2024-05-21T16:59:39.1997490Z 2024-05-21T16:58:38.933405Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:update_endpoints: iroh_net::magicsock: starting endpoint update (periodic)
2024-05-21T16:59:39.1999480Z 2024-05-21T16:58:38.933426Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:update_endpoints:update_net_info: iroh_net::magicsock: skipping netcheck, empty RelayMap
2024-05-21T16:59:39.2001370Z 2024-05-21T16:58:38.935384Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor: iroh_net::magicsock: endpoints changed: 167.235.14.200:58263 (local)
2024-05-21T16:59:39.2003080Z 2024-05-21T16:58:38.935415Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor: iroh_net::magicsock: scheduling periodic_stun to run in 23s
2024-05-21T16:59:39.2004770Z 2024-05-21T16:58:38.935433Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor: iroh_net::magicsock: endpoint update done (periodic)
2024-05-21T16:59:39.2006180Z 2024-05-21T16:58:38.935538Z DEBUG node{me=nkpqjtgrfsdzojzk}: iroh::node::builder: listening at: 0.0.0.0:51664 and [::]:51665
2024-05-21T16:59:39.2007650Z 2024-05-21T16:58:38.935567Z DEBUG node{me=nkpqjtgrfsdzojzk}: iroh::node::builder: gossip initial update: [Endpoint { addr: 167.235.14.200:51664, typ: Local }] me=PublicKey(nkpqjtgrfsdzojzk)
2024-05-21T16:59:39.2009650Z 2024-05-21T16:58:38.935820Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:portmapper.service: iroh_net::portmapper: getting a port mapping for 167.235.14.200:58263 -> None
2024-05-21T16:59:39.2011250Z 2024-05-21T16:58:38.935851Z DEBUG pkarr_publish{me=wp3g26raw2ercopv}: iroh_net::discovery::pkarr_publish: Publish node info to pkarr (info changed)
2024-05-21T16:59:39.2012650Z 2024-05-21T16:58:38.935861Z  INFO pkarr_publish{me=wp3g26raw2ercopv}: iroh_net::discovery::pkarr_publish: Publish node info to pkarr relay_url=None
2024-05-21T16:59:39.2014170Z 2024-05-21T16:58:38.936196Z DEBUG pkarr_publish{me=wp3g26raw2ercopv}: reqwest::connect: starting new connection: https://dns.iroh.link/    
2024-05-21T16:59:39.2015380Z 2024-05-21T16:58:38.936231Z DEBUG hyper::client::connect::dns: resolving host="dns.iroh.link"
2024-05-21T16:59:39.2016530Z 2024-05-21T16:58:38.936275Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle in_event  UpdatePeerData(PeerData(10b))
2024-05-21T16:59:39.2017860Z 2024-05-21T16:58:38.936316Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle in_event  UpdatePeerData(PeerData(10b))
2024-05-21T16:59:39.2019800Z 2024-05-21T16:58:38.936349Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:portmapper.service:upnp: igd_next::aio::tokio: sending broadcast request to: 239.255.255.250:1900 on interface: Ok(0.0.0.0:64545)    
2024-05-21T16:59:39.2021610Z 2024-05-21T16:58:38.936405Z DEBUG pkarr_publish{me=nkpqjtgrfsdzojzk}: hyper::client::connect::http: connecting to 49.13.207.244:443
2024-05-21T16:59:39.2022740Z 2024-05-21T16:58:38.936725Z  INFO sync: node spawned i=1 me=wp3g26raw2ercopv
2024-05-21T16:59:39.2023890Z 2024-05-21T16:58:38.936864Z DEBUG node{me=wp3g26raw2ercopv}: iroh::node::builder: listening at: 0.0.0.0:58263 and [::]:58264
2024-05-21T16:59:39.2025450Z 2024-05-21T16:58:38.936890Z DEBUG node{me=wp3g26raw2ercopv}: iroh::node::builder: gossip initial update: [Endpoint { addr: 167.235.14.200:58263, typ: Local }] me=PublicKey(wp3g26raw2ercopv)
2024-05-21T16:59:39.2027090Z 2024-05-21T16:58:38.936948Z DEBUG pkarr_publish{me=wp3g26raw2ercopv}: hyper::client::connect::http: connecting to 49.13.207.244:443
2024-05-21T16:59:39.2028420Z 2024-05-21T16:58:38.937015Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle in_event  UpdatePeerData(PeerData(10b))
2024-05-21T16:59:39.2029730Z 2024-05-21T16:58:38.937049Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle in_event  UpdatePeerData(PeerData(10b))
2024-05-21T16:59:39.2030770Z 2024-05-21T16:58:38.937078Z DEBUG iroh::node::rpc: handling rpc request: DocCreate
2024-05-21T16:59:39.2031790Z 2024-05-21T16:58:38.937520Z DEBUG sync{me=nkpqjtgrfsdzojzk}: iroh_docs::actor: open namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2032880Z 2024-05-21T16:58:38.937625Z DEBUG iroh::node::rpc: handling rpc request: AuthorCreate
2024-05-21T16:59:39.2033620Z 2024-05-21T16:58:38.937912Z DEBUG iroh::node::rpc: handling rpc request: DocShare
2024-05-21T16:59:39.2034740Z 2024-05-21T16:58:38.938151Z DEBUG sync{me=nkpqjtgrfsdzojzk}: iroh::docs_engine::live: start sync namespace=NamespaceId(6gebwlyf7po3fygx) peers=0
2024-05-21T16:59:39.2036450Z 2024-05-21T16:58:38.938258Z DEBUG sync{me=nkpqjtgrfsdzojzk}:sync{me=nkpqjtgrfsdzojzk}: iroh::docs_engine::gossip: join gossip namespace=NamespaceId(6gebwlyf7po3fygx) peers=0
2024-05-21T16:59:39.2038010Z 2024-05-21T16:58:38.938417Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle in_event  Command(TopicId(6gebwlyf7po3fygx), Join([]))
2024-05-21T16:59:39.2039070Z 2024-05-21T16:58:38.938483Z DEBUG iroh::node::rpc: handling rpc request: DocImport
2024-05-21T16:59:39.2040050Z 2024-05-21T16:58:38.938751Z DEBUG sync{me=wp3g26raw2ercopv}: iroh_docs::actor: open namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2040990Z 2024-05-21T16:58:38.938827Z DEBUG iroh::node::rpc: handling rpc request: DocStartSync
2024-05-21T16:59:39.2042120Z 2024-05-21T16:58:38.938851Z DEBUG sync{me=wp3g26raw2ercopv}: iroh::docs_engine::live: start sync namespace=NamespaceId(6gebwlyf7po3fygx) peers=1
2024-05-21T16:59:39.2044130Z 2024-05-21T16:58:38.939025Z  INFO sync{me=wp3g26raw2ercopv}:add_node_addr{me=wp3g26raw2ercopv}:add_node_addr{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map: inserting new node in NodeMap node=nkpqjtgrfsdzojzk relay_url=None
2024-05-21T16:59:39.2046710Z 2024-05-21T16:58:38.939076Z DEBUG sync{me=wp3g26raw2ercopv}:add_node_addr{me=wp3g26raw2ercopv}:add_node_addr{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: added new direct paths for endpoint new={167.235.14.200:51664} paths=[167.235.14.200:51664{ }]
2024-05-21T16:59:39.2048970Z 2024-05-21T16:58:38.939127Z DEBUG sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}: iroh::docs_engine::state: start connect reason=DirectJoin
2024-05-21T16:59:39.2050860Z 2024-05-21T16:58:38.939166Z DEBUG sync{me=wp3g26raw2ercopv}:sync{me=wp3g26raw2ercopv}: iroh::docs_engine::gossip: join gossip namespace=NamespaceId(6gebwlyf7po3fygx) peers=1
2024-05-21T16:59:39.2052940Z 2024-05-21T16:58:38.939257Z DEBUG sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}: iroh_net::endpoint: connecting to nkpqjtgrfsdzojzk6je6vwvlbyczjqpww642tiu5brvfiqttpkfq: (via [fd15:70a:510b::1]:12345 - {})
2024-05-21T16:59:39.2055040Z 2024-05-21T16:58:38.939911Z DEBUG sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}: rustls::client::hs: No cached session for DnsName("localhost")    
2024-05-21T16:59:39.2056870Z 2024-05-21T16:58:38.940138Z DEBUG sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}: rustls::client::hs: Not resuming any session    
2024-05-21T16:59:39.2058950Z 2024-05-21T16:58:38.940475Z DEBUG sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}:discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: iroh_net::discovery: discovery: start
2024-05-21T16:59:39.2061680Z 2024-05-21T16:58:38.940579Z DEBUG sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}:discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_proto::xfer::dns_handle: querying: _iroh.pkxojugtf1d3qj3k6jr6isimban3joxss6h4uew7btifeouuxkfo.dns.iroh.link. TXT
2024-05-21T16:59:39.2064860Z 2024-05-21T16:58:38.940614Z DEBUG sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}:discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_resolver::name_server::name_server_pool: sending request: [Query { name: Name("_iroh.pkxojugtf1d3qj3k6jr6isimban3joxss6h4uew7btifeouuxkfo.dns.iroh.link."), query_type: TXT, query_class: IN }]
2024-05-21T16:59:39.2068240Z 2024-05-21T16:58:38.940657Z DEBUG sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}:discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_resolver::name_server::name_server: reconnecting: NameServerConfig { socket_addr: 185.12.64.1:53, protocol: Udp, tls_dns_name: None, trust_negative_responses: false, tls_config: None, bind_addr: None }
2024-05-21T16:59:39.2071560Z 2024-05-21T16:58:38.940697Z DEBUG sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}:discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_proto::xfer: enqueueing message:QUERY:[Query { name: Name("_iroh.pkxojugtf1d3qj3k6jr6isimban3joxss6h4uew7btifeouuxkfo.dns.iroh.link."), query_type: TXT, query_class: IN }]
2024-05-21T16:59:39.2074870Z 2024-05-21T16:58:38.940722Z DEBUG sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}:discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_resolver::name_server::name_server: reconnecting: NameServerConfig { socket_addr: 185.12.64.2:53, protocol: Udp, tls_dns_name: None, trust_negative_responses: false, tls_config: None, bind_addr: None }
2024-05-21T16:59:39.2078250Z 2024-05-21T16:58:38.940742Z DEBUG sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}:discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_proto::xfer: enqueueing message:QUERY:[Query { name: Name("_iroh.pkxojugtf1d3qj3k6jr6isimban3joxss6h4uew7btifeouuxkfo.dns.iroh.link."), query_type: TXT, query_class: IN }]
2024-05-21T16:59:39.2080300Z 2024-05-21T16:58:38.940989Z DEBUG hickory_proto::udp::udp_client_stream: final message: ; header 60137:QUERY:RD:NoError:QUERY:0/0/0
2024-05-21T16:59:39.2080870Z ; query
2024-05-21T16:59:39.2081200Z ;; _iroh.pkxojugtf1d3qj3k6jr6isimban3joxss6h4uew7btifeouuxkfo.dns.iroh.link. IN TXT
2024-05-21T16:59:39.2081640Z 
2024-05-21T16:59:39.2082160Z 2024-05-21T16:58:38.941026Z DEBUG hickory_proto::udp::udp_client_stream: final message: ; header 51396:QUERY:RD:NoError:QUERY:0/0/0
2024-05-21T16:59:39.2082740Z ; query
2024-05-21T16:59:39.2083070Z ;; _iroh.pkxojugtf1d3qj3k6jr6isimban3joxss6h4uew7btifeouuxkfo.dns.iroh.link. IN TXT
2024-05-21T16:59:39.2083410Z 
2024-05-21T16:59:39.2084760Z 2024-05-21T16:58:38.941080Z DEBUG sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}:discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_proto::udp::udp_stream: created socket successfully
2024-05-21T16:59:39.2087270Z 2024-05-21T16:58:38.941114Z DEBUG sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}:discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_proto::udp::udp_stream: created socket successfully
2024-05-21T16:59:39.2089430Z 2024-05-21T16:58:38.941195Z  INFO poll_send{me=wp3g26raw2ercopv}:get_send_addrs{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: new connection type typ=direct
2024-05-21T16:59:39.2091410Z 2024-05-21T16:58:38.941218Z DEBUG poll_send{me=wp3g26raw2ercopv}:get_send_addrs{node=nkpqjtgrfsdzojzk}:want_call_me_maybe: iroh_net::magicsock::node_map::node_state: no previous full ping: need full ping
2024-05-21T16:59:39.2093400Z 2024-05-21T16:58:38.941243Z DEBUG poll_send{me=wp3g26raw2ercopv}:get_send_addrs{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: prune addresses: 0 pruned paths=[167.235.14.200:51664{ }]
2024-05-21T16:59:39.2095660Z 2024-05-21T16:58:38.941270Z DEBUG poll_send{me=wp3g26raw2ercopv}:get_send_addrs{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: sending pings to endpoint ping_dsts=[ UDP(167.235.14.200:51664) ] dst=nkpqjtgrfsdzojzk paths=[167.235.14.200:51664{ }]
2024-05-21T16:59:39.2097870Z 2024-05-21T16:58:38.941286Z DEBUG poll_send{me=wp3g26raw2ercopv}:get_send_addrs{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: can not send call-me-maybe, no relay URL
2024-05-21T16:59:39.2099780Z 2024-05-21T16:58:38.941744Z DEBUG poll_send{me=wp3g26raw2ercopv}:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:51664) tx=3604d574496039f8ae340612 purpose=Discovery
2024-05-21T16:59:39.2101490Z 2024-05-21T16:58:38.941833Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle in_event  Command(TopicId(6gebwlyf7po3fygx), Join([PublicKey(nkpqjtgrfsdzojzk)]))
2024-05-21T16:59:39.2103180Z 2024-05-21T16:58:38.941867Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle out_event SendMessage(PublicKey(nkpqjtgrfsdzojzk), Message { topic: TopicId(6gebwlyf7po3fygx), message: Swarm(Join(Some(PeerData(10b)))) })
2024-05-21T16:59:39.2104780Z 2024-05-21T16:58:38.941886Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: dial peer=PublicKey(nkpqjtgrfsdzojzk)
2024-05-21T16:59:39.2106030Z 2024-05-21T16:58:38.942006Z DEBUG iroh_net::endpoint: connecting to nkpqjtgrfsdzojzk6je6vwvlbyczjqpww642tiu5brvfiqttpkfq: (via [fd15:70a:510b::1]:12345 - {})
2024-05-21T16:59:39.2107100Z 2024-05-21T16:58:38.942588Z DEBUG rustls::client::hs: No cached session for DnsName("localhost")    
2024-05-21T16:59:39.2107890Z 2024-05-21T16:58:38.942802Z DEBUG rustls::client::hs: Not resuming any session    
2024-05-21T16:59:39.2108990Z 2024-05-21T16:58:38.943044Z DEBUG discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: iroh_net::discovery: discovery: start
2024-05-21T16:59:39.2110610Z 2024-05-21T16:58:38.943096Z DEBUG discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_proto::xfer::dns_handle: querying: _iroh.pkxojugtf1d3qj3k6jr6isimban3joxss6h4uew7btifeouuxkfo.dns.iroh.link. TXT
2024-05-21T16:59:39.2112780Z 2024-05-21T16:58:38.943116Z DEBUG discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_resolver::name_server::name_server_pool: sending request: [Query { name: Name("_iroh.pkxojugtf1d3qj3k6jr6isimban3joxss6h4uew7btifeouuxkfo.dns.iroh.link."), query_type: TXT, query_class: IN }]
2024-05-21T16:59:39.2115140Z 2024-05-21T16:58:38.943143Z DEBUG discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_resolver::name_server::name_server: existing connection: NameServerConfig { socket_addr: 185.12.64.1:53, protocol: Udp, tls_dns_name: None, trust_negative_responses: false, tls_config: None, bind_addr: None }
2024-05-21T16:59:39.2117460Z 2024-05-21T16:58:38.943155Z DEBUG discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_proto::xfer: enqueueing message:QUERY:[Query { name: Name("_iroh.pkxojugtf1d3qj3k6jr6isimban3joxss6h4uew7btifeouuxkfo.dns.iroh.link."), query_type: TXT, query_class: IN }]
2024-05-21T16:59:39.2119830Z 2024-05-21T16:58:38.943174Z DEBUG discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_resolver::name_server::name_server: existing connection: NameServerConfig { socket_addr: 185.12.64.2:53, protocol: Udp, tls_dns_name: None, trust_negative_responses: false, tls_config: None, bind_addr: None }
2024-05-21T16:59:39.2122150Z 2024-05-21T16:58:38.943184Z DEBUG discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_proto::xfer: enqueueing message:QUERY:[Query { name: Name("_iroh.pkxojugtf1d3qj3k6jr6isimban3joxss6h4uew7btifeouuxkfo.dns.iroh.link."), query_type: TXT, query_class: IN }]
2024-05-21T16:59:39.2123760Z 2024-05-21T16:58:38.943262Z DEBUG hickory_proto::udp::udp_client_stream: final message: ; header 43132:QUERY:RD:NoError:QUERY:0/0/0
2024-05-21T16:59:39.2124330Z ; query
2024-05-21T16:59:39.2124680Z ;; _iroh.pkxojugtf1d3qj3k6jr6isimban3joxss6h4uew7btifeouuxkfo.dns.iroh.link. IN TXT
2024-05-21T16:59:39.2125030Z 
2024-05-21T16:59:39.2125540Z 2024-05-21T16:58:38.943292Z DEBUG hickory_proto::udp::udp_client_stream: final message: ; header 57958:QUERY:RD:NoError:QUERY:0/0/0
2024-05-21T16:59:39.2126160Z ; query
2024-05-21T16:59:39.2126580Z ;; _iroh.pkxojugtf1d3qj3k6jr6isimban3joxss6h4uew7btifeouuxkfo.dns.iroh.link. IN TXT
2024-05-21T16:59:39.2126930Z 
2024-05-21T16:59:39.2127680Z 2024-05-21T16:58:38.943343Z DEBUG discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_proto::udp::udp_stream: created socket successfully
2024-05-21T16:59:39.2129110Z 2024-05-21T16:58:38.943367Z DEBUG discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_proto::udp::udp_stream: created socket successfully
2024-05-21T16:59:39.2130860Z 2024-05-21T16:58:38.943432Z DEBUG poll_send{me=wp3g26raw2ercopv}:get_send_addrs{node=nkpqjtgrfsdzojzk}:want_call_me_maybe: iroh_net::magicsock::node_map::node_state: best addr not set: need full ping
2024-05-21T16:59:39.2132910Z 2024-05-21T16:58:38.943454Z DEBUG poll_send{me=wp3g26raw2ercopv}:get_send_addrs{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: prune addresses: 0 pruned paths=[167.235.14.200:51664{ ping-sent(1.688875ms ago) }]
2024-05-21T16:59:39.2135210Z 2024-05-21T16:58:38.943473Z DEBUG poll_send{me=wp3g26raw2ercopv}:get_send_addrs{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: sending pings to endpoint ping_dsts=[] dst=nkpqjtgrfsdzojzk paths=[167.235.14.200:51664{ ping-sent(1.70825ms ago) }]
2024-05-21T16:59:39.2137330Z 2024-05-21T16:58:38.943488Z DEBUG poll_send{me=wp3g26raw2ercopv}:get_send_addrs{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: can not send call-me-maybe, no relay URL
2024-05-21T16:59:39.2138840Z 2024-05-21T16:58:38.943583Z DEBUG pkarr_publish{me=nkpqjtgrfsdzojzk}: hyper::client::connect::http: connected to 49.13.207.244:443
2024-05-21T16:59:39.2140110Z 2024-05-21T16:58:38.943603Z DEBUG pkarr_publish{me=nkpqjtgrfsdzojzk}: rustls::client::hs: No cached session for DnsName("dns.iroh.link")    
2024-05-21T16:59:39.2141340Z 2024-05-21T16:58:38.943821Z DEBUG pkarr_publish{me=nkpqjtgrfsdzojzk}: rustls::client::hs: Not resuming any session    
2024-05-21T16:59:39.2142640Z 2024-05-21T16:58:38.943904Z DEBUG pkarr_publish{me=wp3g26raw2ercopv}: hyper::client::connect::http: connected to 49.13.207.244:443
2024-05-21T16:59:39.2143980Z 2024-05-21T16:58:38.943921Z DEBUG pkarr_publish{me=wp3g26raw2ercopv}: rustls::client::hs: No cached session for DnsName("dns.iroh.link")    
2024-05-21T16:59:39.2145230Z 2024-05-21T16:58:38.944135Z DEBUG pkarr_publish{me=wp3g26raw2ercopv}: rustls::client::hs: Not resuming any session    
2024-05-21T16:59:39.2146850Z 2024-05-21T16:58:38.944618Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map: received ping: node unknown, add to node map
2024-05-21T16:59:39.2149060Z 2024-05-21T16:58:38.944633Z  INFO poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map: inserting new node in NodeMap node=wp3g26raw2ercopv relay_url=None
2024-05-21T16:59:39.2151300Z 2024-05-21T16:58:38.944656Z  INFO poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: new direct addr for node addr=167.235.14.200:58263
2024-05-21T16:59:39.2154040Z 2024-05-21T16:58:38.944676Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: prune addresses: 0 pruned paths=[167.235.14.200:58263{ ping-received(20.458µs ago) }]
2024-05-21T16:59:39.2156640Z 2024-05-21T16:58:38.944693Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=NewPath needs_ping_back=true paths=[167.235.14.200:58263{ ping-received(37.541µs ago) }]
2024-05-21T16:59:39.2159140Z 2024-05-21T16:58:38.944715Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock: received ping: new path src=Udp(167.235.14.200:58263) tx=3604d574496039f8ae340612
2024-05-21T16:59:39.2161540Z 2024-05-21T16:58:38.944733Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock: sending pong tx=3604d574496039f8ae340612 addr=UDP(167.235.14.200:58263) dstkey=wp3g26raw2ercopv
2024-05-21T16:59:39.2163990Z 2024-05-21T16:58:38.944754Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock: sending direct ping back addr=UDP(167.235.14.200:58263) dstkey=wp3g26raw2ercopv
2024-05-21T16:59:39.2165520Z 2024-05-21T16:58:38.945215Z DEBUG rustls::server::hs: decided upon suite TLS13_AES_128_GCM_SHA256    
2024-05-21T16:59:39.2166520Z 2024-05-21T16:58:38.945668Z DEBUG rustls::server::hs: Chosen ALPN protocol [47, 105, 114, 111, 104, 45, 115, 121, 110, 99, 47, 49]    
2024-05-21T16:59:39.2167410Z 2024-05-21T16:58:38.946012Z DEBUG iroh::node::rpc: handling rpc request: AuthorCreate
2024-05-21T16:59:39.2168200Z 2024-05-21T16:58:38.946420Z DEBUG rustls::server::hs: decided upon suite TLS13_AES_128_GCM_SHA256    
2024-05-21T16:59:39.2169170Z 2024-05-21T16:58:38.946863Z DEBUG rustls::server::hs: Chosen ALPN protocol [47, 105, 114, 111, 104, 45, 103, 111, 115, 115, 105, 112, 47, 48]    
2024-05-21T16:59:39.2170750Z 2024-05-21T16:58:38.947219Z  INFO poll_send{me=nkpqjtgrfsdzojzk}:get_send_addrs{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: new connection type typ=direct
2024-05-21T16:59:39.2172660Z 2024-05-21T16:58:38.947236Z DEBUG poll_send{me=nkpqjtgrfsdzojzk}:get_send_addrs{node=wp3g26raw2ercopv}:want_call_me_maybe: iroh_net::magicsock::node_map::node_state: no previous full ping: need full ping
2024-05-21T16:59:39.2174860Z 2024-05-21T16:58:38.947257Z DEBUG poll_send{me=nkpqjtgrfsdzojzk}:get_send_addrs{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: prune addresses: 0 pruned paths=[167.235.14.200:58263{ active ping-received(2.600833ms ago) ping-sent(2.472541ms ago) }]
2024-05-21T16:59:39.2177440Z 2024-05-21T16:58:38.947277Z DEBUG poll_send{me=nkpqjtgrfsdzojzk}:get_send_addrs{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: sending pings to endpoint ping_dsts=[] dst=wp3g26raw2ercopv paths=[167.235.14.200:58263{ active ping-received(2.620708ms ago) ping-sent(2.492166ms ago) }]
2024-05-21T16:59:39.2179660Z 2024-05-21T16:58:38.947291Z DEBUG poll_send{me=nkpqjtgrfsdzojzk}:get_send_addrs{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: can not send call-me-maybe, no relay URL
2024-05-21T16:59:39.2181530Z 2024-05-21T16:58:38.947518Z DEBUG poll_send{me=nkpqjtgrfsdzojzk}:get_send_addrs{node=wp3g26raw2ercopv}:want_call_me_maybe: iroh_net::magicsock::node_map::node_state: best addr not set: need full ping
2024-05-21T16:59:39.2183700Z 2024-05-21T16:58:38.947538Z DEBUG poll_send{me=nkpqjtgrfsdzojzk}:get_send_addrs{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: prune addresses: 0 pruned paths=[167.235.14.200:58263{ active ping-received(2.882625ms ago) ping-sent(2.754083ms ago) }]
2024-05-21T16:59:39.2186370Z 2024-05-21T16:58:38.947557Z DEBUG poll_send{me=nkpqjtgrfsdzojzk}:get_send_addrs{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: sending pings to endpoint ping_dsts=[] dst=wp3g26raw2ercopv paths=[167.235.14.200:58263{ active ping-received(2.901ms ago) ping-sent(2.772416ms ago) }]
2024-05-21T16:59:39.2188590Z 2024-05-21T16:58:38.947572Z DEBUG poll_send{me=nkpqjtgrfsdzojzk}:get_send_addrs{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: can not send call-me-maybe, no relay URL
2024-05-21T16:59:39.2190080Z 2024-05-21T16:58:38.947618Z DEBUG sync{me=nkpqjtgrfsdzojzk}:accept: iroh::docs_engine::live: incoming connection
2024-05-21T16:59:39.2191700Z 2024-05-21T16:58:38.947752Z DEBUG poll_send{me=nkpqjtgrfsdzojzk}:get_send_addrs{node=wp3g26raw2ercopv}:want_call_me_maybe: iroh_net::magicsock::node_map::node_state: best addr not set: need full ping
2024-05-21T16:59:39.2193920Z 2024-05-21T16:58:38.947773Z DEBUG poll_send{me=nkpqjtgrfsdzojzk}:get_send_addrs{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: prune addresses: 0 pruned paths=[167.235.14.200:58263{ active ping-received(3.117166ms ago) ping-sent(2.988583ms ago) }]
2024-05-21T16:59:39.2196460Z 2024-05-21T16:58:38.947791Z DEBUG poll_send{me=nkpqjtgrfsdzojzk}:get_send_addrs{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: sending pings to endpoint ping_dsts=[] dst=wp3g26raw2ercopv paths=[167.235.14.200:58263{ active ping-received(3.1355ms ago) ping-sent(3.006916ms ago) }]
2024-05-21T16:59:39.2198690Z 2024-05-21T16:58:38.947806Z DEBUG poll_send{me=nkpqjtgrfsdzojzk}:get_send_addrs{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: can not send call-me-maybe, no relay URL
2024-05-21T16:59:39.2200890Z 2024-05-21T16:58:38.947900Z DEBUG sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}:discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_proto::udp::udp_client_stream: received message id: 60137
2024-05-21T16:59:39.2203480Z 2024-05-21T16:58:38.947928Z DEBUG sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}:discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_resolver::error: Response:; header 60137:RESPONSE:RD,RA:NXDomain:QUERY:0/1/0
2024-05-21T16:59:39.2204800Z ; query
2024-05-21T16:59:39.2205130Z ;; _iroh.pkxojugtf1d3qj3k6jr6isimban3joxss6h4uew7btifeouuxkfo.dns.iroh.link. IN TXT
2024-05-21T16:59:39.2205610Z ; answers 0
2024-05-21T16:59:39.2205770Z ; nameservers 1
2024-05-21T16:59:39.2206130Z dns.iroh.link. 3454 IN SOA testdns.iroh.link. hostmaster.iroh.link. 1 7200 900 1209600 86400
2024-05-21T16:59:39.2206540Z ; additionals 0
2024-05-21T16:59:39.2206640Z 
2024-05-21T16:59:39.2208100Z 2024-05-21T16:58:38.947981Z DEBUG sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}:discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_proto::udp::udp_client_stream: received message id: 51396
2024-05-21T16:59:39.2210680Z 2024-05-21T16:58:38.948001Z DEBUG sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}:discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_resolver::error: Response:; header 51396:RESPONSE:RD,RA:NXDomain:QUERY:0/1/0
2024-05-21T16:59:39.2211960Z ; query
2024-05-21T16:59:39.2212300Z ;; _iroh.pkxojugtf1d3qj3k6jr6isimban3joxss6h4uew7btifeouuxkfo.dns.iroh.link. IN TXT
2024-05-21T16:59:39.2212780Z ; answers 0
2024-05-21T16:59:39.2212940Z ; nameservers 1
2024-05-21T16:59:39.2213290Z dns.iroh.link. 3454 IN SOA testdns.iroh.link. hostmaster.iroh.link. 1 7200 900 1209600 86400
2024-05-21T16:59:39.2213720Z ; additionals 0
2024-05-21T16:59:39.2213830Z 
2024-05-21T16:59:39.2215810Z 2024-05-21T16:58:38.948163Z  WARN sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}:discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: iroh_net::discovery: discovery service produced error err=no record found for Query { name: Name("_iroh.pkxojugtf1d3qj3k6jr6isimban3joxss6h4uew7btifeouuxkfo.dns.iroh.link."), query_type: TXT, query_class: IN }
2024-05-21T16:59:39.2217530Z 
2024-05-21T16:59:39.2217610Z Stack backtrace:
2024-05-21T16:59:39.2217840Z    0: std::backtrace_rs::backtrace::libunwind::trace
2024-05-21T16:59:39.2218410Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/../../backtrace/src/backtrace/libunwind.rs:105:5
2024-05-21T16:59:39.2219010Z    1: std::backtrace_rs::backtrace::trace_unsynchronized
2024-05-21T16:59:39.2219550Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
2024-05-21T16:59:39.2220040Z    2: std::backtrace::Backtrace::create
2024-05-21T16:59:39.2220470Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/backtrace.rs:331:13
2024-05-21T16:59:39.2220990Z    3: anyhow::error::<impl core::convert::From<E> for anyhow::Error>::from
2024-05-21T16:59:39.2221630Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/anyhow-1.0.82/src/error.rs:565:25
2024-05-21T16:59:39.2222420Z    4: <core::result::Result<T,F> as core::ops::try_trait::FromResidual<core::result::Result<core::convert::Infallible,E>>>::from_residual
2024-05-21T16:59:39.2223110Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/result.rs:1964:27
2024-05-21T16:59:39.2223720Z    5: iroh_net::dns::node_info::TxtAttrs<T>::lookup::{{closure}}
2024-05-21T16:59:39.2224240Z              at /Users/hetzner/actions-runner/_work/iroh/iroh/iroh-net/src/dns/node_info.rs:287:22
2024-05-21T16:59:39.2224740Z    6: iroh_net::dns::node_info::TxtAttrs<T>::lookup_by_id::{{closure}}
2024-05-21T16:59:39.2225300Z              at /Users/hetzner/actions-runner/_work/iroh/iroh/iroh-net/src/dns/node_info.rs:299:42
2024-05-21T16:59:39.2225770Z    7: iroh_net::dns::node_info::lookup_by_id::{{closure}}
2024-05-21T16:59:39.2226270Z              at /Users/hetzner/actions-runner/_work/iroh/iroh/iroh-net/src/dns/node_info.rs:81:79
2024-05-21T16:59:39.2226880Z    8: <iroh_net::discovery::dns::DnsDiscovery as iroh_net::discovery::Discovery>::resolve::{{closure}}
2024-05-21T16:59:39.2227520Z              at /Users/hetzner/actions-runner/_work/iroh/iroh/iroh-net/src/discovery/dns.rs:57:83
2024-05-21T16:59:39.2228160Z    9: <futures_lite::stream::OnceFuture<F> as futures_core::stream::Stream>::poll_next::{{closure}}
2024-05-21T16:59:39.2228920Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/futures-lite-2.3.0/src/stream.rs:655:57
2024-05-21T16:59:39.2229440Z   10: core::option::Option<T>::map
2024-05-21T16:59:39.2229910Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/option.rs:1073:29
2024-05-21T16:59:39.2230450Z   11: <futures_lite::stream::OnceFuture<F> as futures_core::stream::Stream>::poll_next
2024-05-21T16:59:39.2231160Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/futures-lite-2.3.0/src/stream.rs:655:15
2024-05-21T16:59:39.2231770Z   12: <core::pin::Pin<P> as futures_core::stream::Stream>::poll_next
2024-05-21T16:59:39.2232420Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/futures-core-0.3.30/src/stream.rs:120:9
2024-05-21T16:59:39.2233150Z   13: futures_buffered::futures_unordered_bounded::FuturesUnorderedBounded<F>::poll_inner_no_remove
2024-05-21T16:59:39.2234010Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/futures-buffered-0.2.4/src/futures_unordered_bounded.rs:213:35
2024-05-21T16:59:39.2234740Z   14: <futures_buffered::merge::Merge<S> as futures_core::stream::Stream>::poll_next
2024-05-21T16:59:39.2235430Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/futures-buffered-0.2.4/src/merge.rs:74:19
2024-05-21T16:59:39.2236050Z   15: <core::pin::Pin<P> as futures_core::stream::Stream>::poll_next
2024-05-21T16:59:39.2236700Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/futures-core-0.3.30/src/stream.rs:120:9
2024-05-21T16:59:39.2237250Z   16: futures_lite::stream::StreamExt::poll_next
2024-05-21T16:59:39.2237860Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/futures-lite-2.3.0/src/stream.rs:673:9
2024-05-21T16:59:39.2238490Z   17: <futures_lite::stream::NextFuture<S> as core::future::future::Future>::poll
2024-05-21T16:59:39.2239190Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/futures-lite-2.3.0/src/stream.rs:1909:9
2024-05-21T16:59:39.2239790Z   18: iroh_net::discovery::DiscoveryTask::run::{{closure}}::{{closure}}
2024-05-21T16:59:39.2240440Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/macros/select.rs:524:49
2024-05-21T16:59:39.2241060Z   19: <tokio::future::poll_fn::PollFn<F> as core::future::future::Future>::poll
2024-05-21T16:59:39.2241730Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/future/poll_fn.rs:58:9
2024-05-21T16:59:39.2242270Z   20: iroh_net::discovery::DiscoveryTask::run::{{closure}}
2024-05-21T16:59:39.2242800Z              at /Users/hetzner/actions-runner/_work/iroh/iroh/iroh-net/src/discovery.rs:240:24
2024-05-21T16:59:39.2243320Z   21: iroh_net::discovery::DiscoveryTask::maybe_start_after_delay::{{closure}}
2024-05-21T16:59:39.2243870Z              at /Users/hetzner/actions-runner/_work/iroh/iroh/iroh-net/src/discovery.rs:177:53
2024-05-21T16:59:39.2244400Z   22: <tracing::instrument::Instrumented<T> as core::future::future::Future>::poll
2024-05-21T16:59:39.2245140Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tracing-0.1.40/src/instrument.rs:321:9
2024-05-21T16:59:39.2245700Z   23: tokio::runtime::task::core::Core<T,S>::poll::{{closure}}
2024-05-21T16:59:39.2246350Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/core.rs:328:17
2024-05-21T16:59:39.2246920Z   24: tokio::loom::std::unsafe_cell::UnsafeCell<T>::with_mut
2024-05-21T16:59:39.2247560Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/loom/std/unsafe_cell.rs:16:9
2024-05-21T16:59:39.2248120Z   25: tokio::runtime::task::core::Core<T,S>::poll
2024-05-21T16:59:39.2248780Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/core.rs:317:13
2024-05-21T16:59:39.2249360Z   26: tokio::runtime::task::harness::poll_future::{{closure}}
2024-05-21T16:59:39.2250020Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:485:19
2024-05-21T16:59:39.2250730Z   27: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
2024-05-21T16:59:39.2251340Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/panic/unwind_safe.rs:272:9
2024-05-21T16:59:39.2251800Z   28: std::panicking::try::do_call
2024-05-21T16:59:39.2252240Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:552:40
2024-05-21T16:59:39.2252620Z   29: ___rust_try
2024-05-21T16:59:39.2252810Z   30: std::panicking::try
2024-05-21T16:59:39.2253270Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:516:19
2024-05-21T16:59:39.2253670Z   31: std::panic::catch_unwind
2024-05-21T16:59:39.2254070Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panic.rs:146:14
2024-05-21T16:59:39.2254490Z   32: tokio::runtime::task::harness::poll_future
2024-05-21T16:59:39.2255120Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:473:18
2024-05-21T16:59:39.2255700Z   33: tokio::runtime::task::harness::Harness<T,S>::poll_inner
2024-05-21T16:59:39.2256340Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:208:27
2024-05-21T16:59:39.2256920Z   34: tokio::runtime::task::harness::Harness<T,S>::poll
2024-05-21T16:59:39.2257540Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:153:15
2024-05-21T16:59:39.2258080Z   35: tokio::runtime::task::raw::poll
2024-05-21T16:59:39.2258660Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/raw.rs:271:5
2024-05-21T16:59:39.2259190Z   36: tokio::runtime::task::raw::RawTask::poll
2024-05-21T16:59:39.2259770Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/raw.rs:201:18
2024-05-21T16:59:39.2260360Z   37: tokio::runtime::task::LocalNotified<S>::run
2024-05-21T16:59:39.2260950Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/mod.rs:427:9
2024-05-21T16:59:39.2261620Z   38: tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}
2024-05-21T16:59:39.2262430Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:700:25
2024-05-21T16:59:39.2263030Z   39: tokio::runtime::coop::with_budget
2024-05-21T16:59:39.2263590Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/coop.rs:107:5
2024-05-21T16:59:39.2264090Z   40: tokio::runtime::coop::budget
2024-05-21T16:59:39.2264620Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/coop.rs:73:5
2024-05-21T16:59:39.2265280Z   41: tokio::runtime::scheduler::current_thread::Context::run_task::{{closure}}
2024-05-21T16:59:39.2266030Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:343:43
2024-05-21T16:59:39.2266690Z   42: tokio::runtime::scheduler::current_thread::Context::enter
2024-05-21T16:59:39.2267410Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:404:19
2024-05-21T16:59:39.2268070Z   43: tokio::runtime::scheduler::current_thread::Context::run_task
2024-05-21T16:59:39.2268870Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:343:23
2024-05-21T16:59:39.2269580Z   44: tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}
2024-05-21T16:59:39.2270350Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:699:35
2024-05-21T16:59:39.2271070Z   45: tokio::runtime::scheduler::current_thread::CoreGuard::enter::{{closure}}
2024-05-21T16:59:39.2271820Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:737:68
2024-05-21T16:59:39.2272450Z   46: tokio::runtime::context::scoped::Scoped<T>::set
2024-05-21T16:59:39.2273120Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context/scoped.rs:40:9
2024-05-21T16:59:39.2273750Z   47: tokio::runtime::context::set_scheduler::{{closure}}
2024-05-21T16:59:39.2274360Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context.rs:176:26
2024-05-21T16:59:39.2274910Z   48: std::thread::local::LocalKey<T>::try_with
2024-05-21T16:59:39.2275340Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/local.rs:284:16
2024-05-21T16:59:39.2275770Z   49: std::thread::local::LocalKey<T>::with
2024-05-21T16:59:39.2276200Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/local.rs:260:9
2024-05-21T16:59:39.2276630Z   50: tokio::runtime::context::set_scheduler
2024-05-21T16:59:39.2277200Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context.rs:176:9
2024-05-21T16:59:39.2281870Z   51: tokio::runtime::scheduler::current_thread::CoreGuard::enter
2024-05-21T16:59:39.2282620Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:737:27
2024-05-21T16:59:39.2283270Z   52: tokio::runtime::scheduler::current_thread::CoreGuard::block_on
2024-05-21T16:59:39.2283990Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:646:19
2024-05-21T16:59:39.2284680Z   53: tokio::runtime::scheduler::current_thread::CurrentThread::block_on::{{closure}}
2024-05-21T16:59:39.2285440Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:175:28
2024-05-21T16:59:39.2286050Z   54: tokio::runtime::context::runtime::enter_runtime
2024-05-21T16:59:39.2286660Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context/runtime.rs:65:16
2024-05-21T16:59:39.2287270Z   55: tokio::runtime::scheduler::current_thread::CurrentThread::block_on
2024-05-21T16:59:39.2288000Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:167:9
2024-05-21T16:59:39.2288600Z   56: tokio::runtime::runtime::Runtime::block_on
2024-05-21T16:59:39.2289170Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/runtime.rs:349:47
2024-05-21T16:59:39.2289670Z   57: sync::test_download_policies
2024-05-21T16:59:39.2289890Z              at ./tests/sync.rs:850:5
2024-05-21T16:59:39.2290140Z   58: sync::test_download_policies::{{closure}}
2024-05-21T16:59:39.2290400Z              at ./tests/sync.rs:713:38
2024-05-21T16:59:39.2290650Z   59: core::ops::function::FnOnce::call_once
2024-05-21T16:59:39.2291060Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/ops/function.rs:250:5
2024-05-21T16:59:39.2291480Z   60: core::ops::function::FnOnce::call_once
2024-05-21T16:59:39.2291960Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/ops/function.rs:250:5
2024-05-21T16:59:39.2292370Z   61: test::__rust_begin_short_backtrace
2024-05-21T16:59:39.2292750Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/test/src/lib.rs:621:18
2024-05-21T16:59:39.2293140Z   62: test::run_test_in_process::{{closure}}
2024-05-21T16:59:39.2293530Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/test/src/lib.rs:644:60
2024-05-21T16:59:39.2294080Z   63: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
2024-05-21T16:59:39.2294680Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/panic/unwind_safe.rs:272:9
2024-05-21T16:59:39.2295090Z   64: std::panicking::try::do_call
2024-05-21T16:59:39.2295470Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:552:40
2024-05-21T16:59:39.2295900Z   65: std::panicking::try
2024-05-21T16:59:39.2296250Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:516:19
2024-05-21T16:59:39.2296640Z   66: std::panic::catch_unwind
2024-05-21T16:59:39.2296990Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panic.rs:146:14
2024-05-21T16:59:39.2297360Z   67: test::run_test_in_process
2024-05-21T16:59:39.2297720Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/test/src/lib.rs:644:27
2024-05-21T16:59:39.2298090Z   68: test::run_test::{{closure}}
2024-05-21T16:59:39.2298450Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/test/src/lib.rs:567:43
2024-05-21T16:59:39.2298820Z   69: test::run_test::{{closure}}
2024-05-21T16:59:39.2299170Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/test/src/lib.rs:595:41
2024-05-21T16:59:39.2299610Z   70: std::sys_common::backtrace::__rust_begin_short_backtrace
2024-05-21T16:59:39.2300100Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/sys_common/backtrace.rs:155:18
2024-05-21T16:59:39.2300620Z   71: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}
2024-05-21T16:59:39.2301100Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/mod.rs:528:17
2024-05-21T16:59:39.2301670Z   72: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
2024-05-21T16:59:39.2302260Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/panic/unwind_safe.rs:272:9
2024-05-21T16:59:39.2302680Z   73: std::panicking::try::do_call
2024-05-21T16:59:39.2303050Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:552:40
2024-05-21T16:59:39.2303430Z   74: std::panicking::try
2024-05-21T16:59:39.2303780Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:516:19
2024-05-21T16:59:39.2304170Z   75: std::panic::catch_unwind
2024-05-21T16:59:39.2304520Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panic.rs:146:14
2024-05-21T16:59:39.2304950Z   76: std::thread::Builder::spawn_unchecked_::{{closure}}
2024-05-21T16:59:39.2305390Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/mod.rs:527:30
2024-05-21T16:59:39.2305840Z   77: core::ops::function::FnOnce::call_once{{vtable.shim}}
2024-05-21T16:59:39.2306300Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/ops/function.rs:250:5
2024-05-21T16:59:39.2306800Z   78: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once
2024-05-21T16:59:39.2307340Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/alloc/src/boxed.rs:2020:9
2024-05-21T16:59:39.2307830Z   79: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once
2024-05-21T16:59:39.2308320Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/alloc/src/boxed.rs:2020:9
2024-05-21T16:59:39.2308760Z   80: std::sys::pal::unix::thread::Thread::new::thread_start
2024-05-21T16:59:39.2309290Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/sys/pal/unix/thread.rs:108:17
2024-05-21T16:59:39.2309720Z   81: __pthread_deallocate
2024-05-21T16:59:39.2312350Z 2024-05-21T16:58:39.051698Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0x3604D574496039F8AE340612), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: received pong tx=3604d574496039f8ae340612 src=UDP(167.235.14.200:51664) reported_ping_src=UDP(167.235.14.200:58263) ping_dst=UDP(167.235.14.200:51664) is_relay=false latency=109
2024-05-21T16:59:39.2316560Z 2024-05-21T16:58:39.051734Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0x3604D574496039F8AE340612), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:51664{ pong-received(39.375µs ago) ping-sent(109.972583ms ago) }]
2024-05-21T16:59:39.2320360Z 2024-05-21T16:58:39.051751Z  INFO poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0x3604D574496039F8AE340612), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::best_addr: selecting new direct path for node addr=167.235.14.200:51664 latency=109.932ms trust_for=6.499940792s
2024-05-21T16:59:39.2322910Z 2024-05-21T16:58:39.051835Z DEBUG discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_proto::udp::udp_client_stream: received message id: 57958
2024-05-21T16:59:39.2324420Z 2024-05-21T16:58:39.051861Z DEBUG discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_resolver::error: Response:; header 57958:RESPONSE:RD,RA:NXDomain:QUERY:0/1/0
2024-05-21T16:59:39.2325230Z ; query
2024-05-21T16:59:39.2325560Z ;; _iroh.pkxojugtf1d3qj3k6jr6isimban3joxss6h4uew7btifeouuxkfo.dns.iroh.link. IN TXT
2024-05-21T16:59:39.2325960Z ; answers 0
2024-05-21T16:59:39.2326110Z ; nameservers 1
2024-05-21T16:59:39.2326450Z dns.iroh.link. 3457 IN SOA testdns.iroh.link. hostmaster.iroh.link. 1 7200 900 1209600 86400
2024-05-21T16:59:39.2326840Z ; additionals 0
2024-05-21T16:59:39.2326940Z 
2024-05-21T16:59:39.2327700Z 2024-05-21T16:58:39.051912Z DEBUG discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_proto::udp::udp_client_stream: received message id: 43132
2024-05-21T16:59:39.2329200Z 2024-05-21T16:58:39.051928Z DEBUG discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: hickory_resolver::error: Response:; header 43132:RESPONSE:RD,RA:NXDomain:QUERY:0/1/0
2024-05-21T16:59:39.2330000Z ; query
2024-05-21T16:59:39.2330390Z ;; _iroh.pkxojugtf1d3qj3k6jr6isimban3joxss6h4uew7btifeouuxkfo.dns.iroh.link. IN TXT
2024-05-21T16:59:39.2330790Z ; answers 0
2024-05-21T16:59:39.2330930Z ; nameservers 1
2024-05-21T16:59:39.2331270Z dns.iroh.link. 3457 IN SOA testdns.iroh.link. hostmaster.iroh.link. 1 7200 900 1209600 86400
2024-05-21T16:59:39.2331660Z ; additionals 0
2024-05-21T16:59:39.2331760Z 
2024-05-21T16:59:39.2333080Z 2024-05-21T16:58:39.052038Z  WARN discovery{me=wp3g26raw2ercopv node=nkpqjtgrfsdzojzk}: iroh_net::discovery: discovery service produced error err=no record found for Query { name: Name("_iroh.pkxojugtf1d3qj3k6jr6isimban3joxss6h4uew7btifeouuxkfo.dns.iroh.link."), query_type: TXT, query_class: IN }
2024-05-21T16:59:39.2334290Z 
2024-05-21T16:59:39.2334350Z Stack backtrace:
2024-05-21T16:59:39.2334570Z    0: std::backtrace_rs::backtrace::libunwind::trace
2024-05-21T16:59:39.2335290Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/../../backtrace/src/backtrace/libunwind.rs:105:5
2024-05-21T16:59:39.2335830Z    1: std::backtrace_rs::backtrace::trace_unsynchronized
2024-05-21T16:59:39.2336340Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
2024-05-21T16:59:39.2336810Z    2: std::backtrace::Backtrace::create
2024-05-21T16:59:39.2337210Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/backtrace.rs:331:13
2024-05-21T16:59:39.2337700Z    3: anyhow::error::<impl core::convert::From<E> for anyhow::Error>::from
2024-05-21T16:59:39.2338320Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/anyhow-1.0.82/src/error.rs:565:25
2024-05-21T16:59:39.2339060Z    4: <core::result::Result<T,F> as core::ops::try_trait::FromResidual<core::result::Result<core::convert::Infallible,E>>>::from_residual
2024-05-21T16:59:39.2339730Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/result.rs:1964:27
2024-05-21T16:59:39.2340180Z    5: iroh_net::dns::node_info::TxtAttrs<T>::lookup::{{closure}}
2024-05-21T16:59:39.2343790Z              at /Users/hetzner/actions-runner/_work/iroh/iroh/iroh-net/src/dns/node_info.rs:287:22
2024-05-21T16:59:39.2344290Z    6: iroh_net::dns::node_info::TxtAttrs<T>::lookup_by_id::{{closure}}
2024-05-21T16:59:39.2344810Z              at /Users/hetzner/actions-runner/_work/iroh/iroh/iroh-net/src/dns/node_info.rs:299:42
2024-05-21T16:59:39.2345260Z    7: iroh_net::dns::node_info::lookup_by_id::{{closure}}
2024-05-21T16:59:39.2345730Z              at /Users/hetzner/actions-runner/_work/iroh/iroh/iroh-net/src/dns/node_info.rs:81:79
2024-05-21T16:59:39.2346300Z    8: <iroh_net::discovery::dns::DnsDiscovery as iroh_net::discovery::Discovery>::resolve::{{closure}}
2024-05-21T16:59:39.2346910Z              at /Users/hetzner/actions-runner/_work/iroh/iroh/iroh-net/src/discovery/dns.rs:57:83
2024-05-21T16:59:39.2347470Z    9: <futures_lite::stream::OnceFuture<F> as futures_core::stream::Stream>::poll_next::{{closure}}
2024-05-21T16:59:39.2348180Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/futures-lite-2.3.0/src/stream.rs:655:57
2024-05-21T16:59:39.2348670Z   10: core::option::Option<T>::map
2024-05-21T16:59:39.2349050Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/option.rs:1073:29
2024-05-21T16:59:39.2349580Z   11: <futures_lite::stream::OnceFuture<F> as futures_core::stream::Stream>::poll_next
2024-05-21T16:59:39.2350250Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/futures-lite-2.3.0/src/stream.rs:655:15
2024-05-21T16:59:39.2350820Z   12: <core::pin::Pin<P> as futures_core::stream::Stream>::poll_next
2024-05-21T16:59:39.2351440Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/futures-core-0.3.30/src/stream.rs:120:9
2024-05-21T16:59:39.2352280Z   13: futures_buffered::futures_unordered_bounded::FuturesUnorderedBounded<F>::poll_inner_no_remove
2024-05-21T16:59:39.2353100Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/futures-buffered-0.2.4/src/futures_unordered_bounded.rs:213:35
2024-05-21T16:59:39.2353790Z   14: <futures_buffered::merge::Merge<S> as futures_core::stream::Stream>::poll_next
2024-05-21T16:59:39.2354470Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/futures-buffered-0.2.4/src/merge.rs:74:19
2024-05-21T16:59:39.2355050Z   15: <core::pin::Pin<P> as futures_core::stream::Stream>::poll_next
2024-05-21T16:59:39.2355670Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/futures-core-0.3.30/src/stream.rs:120:9
2024-05-21T16:59:39.2356180Z   16: futures_lite::stream::StreamExt::poll_next
2024-05-21T16:59:39.2356740Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/futures-lite-2.3.0/src/stream.rs:673:9
2024-05-21T16:59:39.2357390Z   17: <futures_lite::stream::NextFuture<S> as core::future::future::Future>::poll
2024-05-21T16:59:39.2358050Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/futures-lite-2.3.0/src/stream.rs:1909:9
2024-05-21T16:59:39.2358620Z   18: iroh_net::discovery::DiscoveryTask::run::{{closure}}::{{closure}}
2024-05-21T16:59:39.2359250Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/macros/select.rs:524:49
2024-05-21T16:59:39.2359850Z   19: <tokio::future::poll_fn::PollFn<F> as core::future::future::Future>::poll
2024-05-21T16:59:39.2360490Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/future/poll_fn.rs:58:9
2024-05-21T16:59:39.2361030Z   20: iroh_net::discovery::DiscoveryTask::run::{{closure}}
2024-05-21T16:59:39.2361500Z              at /Users/hetzner/actions-runner/_work/iroh/iroh/iroh-net/src/discovery.rs:240:24
2024-05-21T16:59:39.2362000Z   21: iroh_net::discovery::DiscoveryTask::maybe_start_after_delay::{{closure}}
2024-05-21T16:59:39.2362530Z              at /Users/hetzner/actions-runner/_work/iroh/iroh/iroh-net/src/discovery.rs:177:53
2024-05-21T16:59:39.2363040Z   22: <tracing::instrument::Instrumented<T> as core::future::future::Future>::poll
2024-05-21T16:59:39.2363700Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tracing-0.1.40/src/instrument.rs:321:9
2024-05-21T16:59:39.2364230Z   23: tokio::runtime::task::core::Core<T,S>::poll::{{closure}}
2024-05-21T16:59:39.2364860Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/core.rs:328:17
2024-05-21T16:59:39.2365420Z   24: tokio::loom::std::unsafe_cell::UnsafeCell<T>::with_mut
2024-05-21T16:59:39.2366030Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/loom/std/unsafe_cell.rs:16:9
2024-05-21T16:59:39.2366570Z   25: tokio::runtime::task::core::Core<T,S>::poll
2024-05-21T16:59:39.2367150Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/core.rs:317:13
2024-05-21T16:59:39.2367720Z   26: tokio::runtime::task::harness::poll_future::{{closure}}
2024-05-21T16:59:39.2368340Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:485:19
2024-05-21T16:59:39.2369030Z   27: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
2024-05-21T16:59:39.2369620Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/panic/unwind_safe.rs:272:9
2024-05-21T16:59:39.2370040Z   28: std::panicking::try::do_call
2024-05-21T16:59:39.2370420Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:552:40
2024-05-21T16:59:39.2370800Z   29: ___rust_try
2024-05-21T16:59:39.2370960Z   30: std::panicking::try
2024-05-21T16:59:39.2371380Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:516:19
2024-05-21T16:59:39.2371770Z   31: std::panic::catch_unwind
2024-05-21T16:59:39.2372130Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panic.rs:146:14
2024-05-21T16:59:39.2372540Z   32: tokio::runtime::task::harness::poll_future
2024-05-21T16:59:39.2373130Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:473:18
2024-05-21T16:59:39.2373700Z   33: tokio::runtime::task::harness::Harness<T,S>::poll_inner
2024-05-21T16:59:39.2374320Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:208:27
2024-05-21T16:59:39.2374870Z   34: tokio::runtime::task::harness::Harness<T,S>::poll
2024-05-21T16:59:39.2375480Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/harness.rs:153:15
2024-05-21T16:59:39.2376040Z   35: tokio::runtime::task::raw::poll
2024-05-21T16:59:39.2376580Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/raw.rs:271:5
2024-05-21T16:59:39.2377100Z   36: tokio::runtime::task::raw::RawTask::poll
2024-05-21T16:59:39.2377670Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/raw.rs:201:18
2024-05-21T16:59:39.2378190Z   37: tokio::runtime::task::LocalNotified<S>::run
2024-05-21T16:59:39.2378760Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/task/mod.rs:427:9
2024-05-21T16:59:39.2379410Z   38: tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}
2024-05-21T16:59:39.2380190Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:700:25
2024-05-21T16:59:39.2380770Z   39: tokio::runtime::coop::with_budget
2024-05-21T16:59:39.2381300Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/coop.rs:107:5
2024-05-21T16:59:39.2381780Z   40: tokio::runtime::coop::budget
2024-05-21T16:59:39.2382290Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/coop.rs:73:5
2024-05-21T16:59:39.2382880Z   41: tokio::runtime::scheduler::current_thread::Context::run_task::{{closure}}
2024-05-21T16:59:39.2383620Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:343:43
2024-05-21T16:59:39.2384250Z   42: tokio::runtime::scheduler::current_thread::Context::enter
2024-05-21T16:59:39.2384950Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:404:19
2024-05-21T16:59:39.2385590Z   43: tokio::runtime::scheduler::current_thread::Context::run_task
2024-05-21T16:59:39.2386300Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:343:23
2024-05-21T16:59:39.2386980Z   44: tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}
2024-05-21T16:59:39.2387730Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:699:35
2024-05-21T16:59:39.2388400Z   45: tokio::runtime::scheduler::current_thread::CoreGuard::enter::{{closure}}
2024-05-21T16:59:39.2389140Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:737:68
2024-05-21T16:59:39.2389750Z   46: tokio::runtime::context::scoped::Scoped<T>::set
2024-05-21T16:59:39.2390350Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context/scoped.rs:40:9
2024-05-21T16:59:39.2390950Z   47: tokio::runtime::context::set_scheduler::{{closure}}
2024-05-21T16:59:39.2391550Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context.rs:176:26
2024-05-21T16:59:39.2392070Z   48: std::thread::local::LocalKey<T>::try_with
2024-05-21T16:59:39.2392500Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/local.rs:284:16
2024-05-21T16:59:39.2392920Z   49: std::thread::local::LocalKey<T>::with
2024-05-21T16:59:39.2393330Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/local.rs:260:9
2024-05-21T16:59:39.2393740Z   50: tokio::runtime::context::set_scheduler
2024-05-21T16:59:39.2394300Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context.rs:176:9
2024-05-21T16:59:39.2394860Z   51: tokio::runtime::scheduler::current_thread::CoreGuard::enter
2024-05-21T16:59:39.2395630Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:737:27
2024-05-21T16:59:39.2396280Z   52: tokio::runtime::scheduler::current_thread::CoreGuard::block_on
2024-05-21T16:59:39.2396990Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:646:19
2024-05-21T16:59:39.2400750Z   53: tokio::runtime::scheduler::current_thread::CurrentThread::block_on::{{closure}}
2024-05-21T16:59:39.2401530Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:175:28
2024-05-21T16:59:39.2402140Z   54: tokio::runtime::context::runtime::enter_runtime
2024-05-21T16:59:39.2402750Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context/runtime.rs:65:16
2024-05-21T16:59:39.2403370Z   55: tokio::runtime::scheduler::current_thread::CurrentThread::block_on
2024-05-21T16:59:39.2404090Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:167:9
2024-05-21T16:59:39.2404690Z   56: tokio::runtime::runtime::Runtime::block_on
2024-05-21T16:59:39.2405270Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/runtime.rs:349:47
2024-05-21T16:59:39.2405760Z   57: sync::test_download_policies
2024-05-21T16:59:39.2405980Z              at ./tests/sync.rs:850:5
2024-05-21T16:59:39.2406240Z   58: sync::test_download_policies::{{closure}}
2024-05-21T16:59:39.2406500Z              at ./tests/sync.rs:713:38
2024-05-21T16:59:39.2406750Z   59: core::ops::function::FnOnce::call_once
2024-05-21T16:59:39.2407210Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/ops/function.rs:250:5
2024-05-21T16:59:39.2407630Z   60: core::ops::function::FnOnce::call_once
2024-05-21T16:59:39.2408050Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/ops/function.rs:250:5
2024-05-21T16:59:39.2408460Z   61: test::__rust_begin_short_backtrace
2024-05-21T16:59:39.2408840Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/test/src/lib.rs:621:18
2024-05-21T16:59:39.2409230Z   62: test::run_test_in_process::{{closure}}
2024-05-21T16:59:39.2409620Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/test/src/lib.rs:644:60
2024-05-21T16:59:39.2410170Z   63: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
2024-05-21T16:59:39.2410770Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/panic/unwind_safe.rs:272:9
2024-05-21T16:59:39.2411190Z   64: std::panicking::try::do_call
2024-05-21T16:59:39.2411560Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:552:40
2024-05-21T16:59:39.2411950Z   65: std::panicking::try
2024-05-21T16:59:39.2412370Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:516:19
2024-05-21T16:59:39.2412760Z   66: std::panic::catch_unwind
2024-05-21T16:59:39.2413110Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panic.rs:146:14
2024-05-21T16:59:39.2413480Z   67: test::run_test_in_process
2024-05-21T16:59:39.2413840Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/test/src/lib.rs:644:27
2024-05-21T16:59:39.2414210Z   68: test::run_test::{{closure}}
2024-05-21T16:59:39.2414570Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/test/src/lib.rs:567:43
2024-05-21T16:59:39.2414940Z   69: test::run_test::{{closure}}
2024-05-21T16:59:39.2415290Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/test/src/lib.rs:595:41
2024-05-21T16:59:39.2415730Z   70: std::sys_common::backtrace::__rust_begin_short_backtrace
2024-05-21T16:59:39.2416220Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/sys_common/backtrace.rs:155:18
2024-05-21T16:59:39.2416830Z   71: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}
2024-05-21T16:59:39.2417320Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/mod.rs:528:17
2024-05-21T16:59:39.2417880Z   72: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
2024-05-21T16:59:39.2418470Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/panic/unwind_safe.rs:272:9
2024-05-21T16:59:39.2418890Z   73: std::panicking::try::do_call
2024-05-21T16:59:39.2419270Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:552:40
2024-05-21T16:59:39.2419650Z   74: std::panicking::try
2024-05-21T16:59:39.2419990Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:516:19
2024-05-21T16:59:39.2420380Z   75: std::panic::catch_unwind
2024-05-21T16:59:39.2420730Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panic.rs:146:14
2024-05-21T16:59:39.2421160Z   76: std::thread::Builder::spawn_unchecked_::{{closure}}
2024-05-21T16:59:39.2421610Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/mod.rs:527:30
2024-05-21T16:59:39.2422050Z   77: core::ops::function::FnOnce::call_once{{vtable.shim}}
2024-05-21T16:59:39.2422510Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/ops/function.rs:250:5
2024-05-21T16:59:39.2423010Z   78: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once
2024-05-21T16:59:39.2423510Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/alloc/src/boxed.rs:2020:9
2024-05-21T16:59:39.2423990Z   79: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once
2024-05-21T16:59:39.2424480Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/alloc/src/boxed.rs:2020:9
2024-05-21T16:59:39.2424920Z   80: std::sys::pal::unix::thread::Thread::new::thread_start
2024-05-21T16:59:39.2425400Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/sys/pal/unix/thread.rs:108:17
2024-05-21T16:59:39.2425820Z   81: __pthread_deallocate
2024-05-21T16:59:39.2426620Z 2024-05-21T16:58:39.052550Z DEBUG pkarr_publish{me=nkpqjtgrfsdzojzk}: rustls::client::hs: Using ciphersuite TLS13_AES_256_GCM_SHA384    
2024-05-21T16:59:39.2427800Z 2024-05-21T16:58:39.052567Z DEBUG pkarr_publish{me=nkpqjtgrfsdzojzk}: rustls::client::tls13: Not resuming    
2024-05-21T16:59:39.2429000Z 2024-05-21T16:58:39.052834Z DEBUG pkarr_publish{me=nkpqjtgrfsdzojzk}: rustls::client::tls13: TLS1.3 encrypted extensions: [ServerNameAck]    
2024-05-21T16:59:39.2430280Z 2024-05-21T16:58:39.052850Z DEBUG pkarr_publish{me=nkpqjtgrfsdzojzk}: rustls::client::hs: ALPN protocol is None    
2024-05-21T16:59:39.2431490Z 2024-05-21T16:58:39.053365Z DEBUG pkarr_publish{me=wp3g26raw2ercopv}: rustls::client::hs: Using ciphersuite TLS13_AES_256_GCM_SHA384    
2024-05-21T16:59:39.2432660Z 2024-05-21T16:58:39.053380Z DEBUG pkarr_publish{me=wp3g26raw2ercopv}: rustls::client::tls13: Not resuming    
2024-05-21T16:59:39.2433860Z 2024-05-21T16:58:39.053646Z DEBUG pkarr_publish{me=wp3g26raw2ercopv}: rustls::client::tls13: TLS1.3 encrypted extensions: [ServerNameAck]    
2024-05-21T16:59:39.2435060Z 2024-05-21T16:58:39.053664Z DEBUG pkarr_publish{me=wp3g26raw2ercopv}: rustls::client::hs: ALPN protocol is None    
2024-05-21T16:59:39.2437340Z 2024-05-21T16:58:39.054214Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=Reactivate needs_ping_back=false paths=[167.235.14.200:51664{ pong-received(2.519083ms ago) ping-received(6.209µs ago) ping-sent(112.452833ms ago) }]
2024-05-21T16:59:39.2440040Z 2024-05-21T16:58:39.054234Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock: received ping: path active src=Udp(167.235.14.200:51664) tx=bda1f22095b01ce942f0e564
2024-05-21T16:59:39.2442440Z 2024-05-21T16:58:39.054252Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock: sending pong tx=bda1f22095b01ce942f0e564 addr=UDP(167.235.14.200:51664) dstkey=nkpqjtgrfsdzojzk
2024-05-21T16:59:39.2443990Z 2024-05-21T16:58:39.054314Z DEBUG iroh::node::rpc: handling rpc request: DocSetDownloadPolicy
2024-05-21T16:59:39.2444950Z 2024-05-21T16:58:39.054577Z DEBUG drive{id=0}: rustls::client::hs: Using ciphersuite TLS13_AES_128_GCM_SHA256    
2024-05-21T16:59:39.2445980Z 2024-05-21T16:58:39.054595Z DEBUG drive{id=0}: rustls::client::tls13: Not resuming    
2024-05-21T16:59:39.2448350Z 2024-05-21T16:58:39.054874Z DEBUG drive{id=0}: rustls::client::tls13: TLS1.3 encrypted extensions: [Protocols([ProtocolName(2f69726f682d73796e632f31)]), ServerNameAck, TransportParameters([1, 2, 103, 16, 3, 2, 69, 192, 4, 8, 255, 255, 255, 255, 255, 255, 255, 255, 5, 4, 128, 19, 18, 208, 6, 4, 128, 19, 18, 208, 7, 4, 128, 19, 18, 208, 8, 1, 10, 14, 1, 5, 64, 182, 0, 2, 16, 56, 142, 167, 250, 117, 192, 64, 112, 101, 28, 192, 117, 3, 18, 178, 113, 32, 4, 128, 0, 255, 255, 0, 20, 201, 55, 153, 182, 80, 68, 131, 66, 194, 129, 17, 213, 146, 37, 172, 112, 157, 41, 50, 2, 15, 8, 238, 174, 133, 6, 113, 193, 104, 250])]    
2024-05-21T16:59:39.2450600Z 2024-05-21T16:58:39.054902Z DEBUG drive{id=0}: rustls::client::hs: ALPN protocol is Some(b"/iroh-sync/1")    
2024-05-21T16:59:39.2452130Z 2024-05-21T16:58:39.054920Z DEBUG drive{id=0}: rustls::client::tls13: Got CertificateRequest CertificateRequestPayloadTLS13 { context: , extensions: [SignatureAlgorithms([ECDSA_NISTP384_SHA384, ECDSA_NISTP256_SHA256, ED25519])] }    
2024-05-21T16:59:39.2453560Z 2024-05-21T16:58:39.054937Z DEBUG drive{id=0}: rustls::client::common: Attempting client auth    
2024-05-21T16:59:39.2454380Z 2024-05-21T16:58:39.056285Z DEBUG hyper::proto::h1::io: flushed 214 bytes
2024-05-21T16:59:39.2455040Z 2024-05-21T16:58:39.056320Z DEBUG hyper::proto::h1::io: flushed 214 bytes
2024-05-21T16:59:39.2456350Z 2024-05-21T16:58:39.056352Z DEBUG sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}: iroh_docs::net: connected t_connect=117.157083ms
2024-05-21T16:59:39.2457840Z 2024-05-21T16:58:39.056428Z DEBUG drive{id=1}: rustls::client::hs: Using ciphersuite TLS13_AES_128_GCM_SHA256    
2024-05-21T16:59:39.2458890Z 2024-05-21T16:58:39.056442Z DEBUG drive{id=1}: rustls::client::tls13: Not resuming    
2024-05-21T16:59:39.2461270Z 2024-05-21T16:58:39.056716Z DEBUG drive{id=1}: rustls::client::tls13: TLS1.3 encrypted extensions: [Protocols([ProtocolName(2f69726f682d676f737369702f30)]), ServerNameAck, TransportParameters([1, 2, 103, 16, 3, 2, 69, 192, 4, 8, 255, 255, 255, 255, 255, 255, 255, 255, 5, 4, 128, 19, 18, 208, 6, 4, 128, 19, 18, 208, 7, 4, 128, 19, 18, 208, 8, 1, 10, 14, 1, 5, 64, 182, 0, 2, 16, 236, 177, 11, 80, 174, 185, 38, 111, 164, 52, 231, 175, 102, 12, 240, 224, 32, 4, 128, 0, 255, 255, 0, 20, 104, 185, 182, 19, 74, 196, 218, 187, 249, 231, 12, 77, 109, 207, 173, 105, 57, 51, 44, 4, 15, 8, 231, 175, 156, 37, 218, 2, 113, 227])]    
2024-05-21T16:59:39.2463530Z 2024-05-21T16:58:39.056742Z DEBUG drive{id=1}: rustls::client::hs: ALPN protocol is Some(b"/iroh-gossip/0")    
2024-05-21T16:59:39.2465020Z 2024-05-21T16:58:39.056758Z DEBUG drive{id=1}: rustls::client::tls13: Got CertificateRequest CertificateRequestPayloadTLS13 { context: , extensions: [SignatureAlgorithms([ECDSA_NISTP384_SHA384, ECDSA_NISTP256_SHA256, ED25519])] }    
2024-05-21T16:59:39.2466430Z 2024-05-21T16:58:39.056772Z DEBUG drive{id=1}: rustls::client::common: Attempting client auth    
2024-05-21T16:59:39.2467920Z 2024-05-21T16:58:39.058008Z DEBUG magic_ep{me=wp3g26raw2ercopv}:rtt-actor: iroh_net::endpoint::rtt_actor: Congestion controller state reset node_id=nkpqjtgrfsdzojzk new_type=Direct(167.235.14.200:51664)
2024-05-21T16:59:39.2469820Z 2024-05-21T16:58:39.058278Z DEBUG magic_ep{me=wp3g26raw2ercopv}:rtt-actor: iroh_net::endpoint::rtt_actor: Congestion controller state reset node_id=nkpqjtgrfsdzojzk new_type=Direct(167.235.14.200:51664)
2024-05-21T16:59:39.2471410Z 2024-05-21T16:58:39.058331Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: dial successful peer=PublicKey(nkpqjtgrfsdzojzk)
2024-05-21T16:59:39.2472900Z 2024-05-21T16:58:39.058489Z DEBUG gossip{me=wp3g26raw2ercopv}:gossip_conn{peer=nkpqjtgrfsdzojzk}: iroh_gossip::net: connection established
2024-05-21T16:59:39.2476080Z 2024-05-21T16:58:39.058841Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0xBDA1F22095B01CE942F0E564), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: received pong tx=bda1f22095b01ce942f0e564 src=UDP(167.235.14.200:58263) reported_ping_src=UDP(167.235.14.200:51664) ping_dst=UDP(167.235.14.200:58263) is_relay=false latency=114
2024-05-21T16:59:39.2480350Z 2024-05-21T16:58:39.058872Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0xBDA1F22095B01CE942F0E564), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:58263{ active pong-received(30.792µs ago) ping-received(114.219625ms ago) ping-sent(114.091125ms ago) }]
2024-05-21T16:59:39.2484270Z 2024-05-21T16:58:39.058888Z  INFO poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0xBDA1F22095B01CE942F0E564), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::best_addr: selecting new direct path for node addr=167.235.14.200:58263 latency=114.058541ms trust_for=6.499950541s
2024-05-21T16:59:39.2486470Z 2024-05-21T16:58:39.059141Z DEBUG iroh::node::rpc: handling rpc request: DocSetDownloadPolicy
2024-05-21T16:59:39.2487870Z 2024-05-21T16:58:39.062299Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:rtt-actor: iroh_net::endpoint::rtt_actor: Congestion controller state reset node_id=wp3g26raw2ercopv new_type=Direct(167.235.14.200:58263)
2024-05-21T16:59:39.2492850Z 2024-05-21T16:58:39.070924Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:rtt-actor: iroh_net::endpoint::rtt_actor: Congestion controller state reset node_id=wp3g26raw2ercopv new_type=Direct(167.235.14.200:58263)
2024-05-21T16:59:39.2494680Z 2024-05-21T16:58:39.071088Z DEBUG gossip{me=nkpqjtgrfsdzojzk}:gossip_conn{peer=wp3g26raw2ercopv}: iroh_gossip::net: connection established
2024-05-21T16:59:39.2496430Z 2024-05-21T16:58:39.071491Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle in_event  RecvMessage(PublicKey(wp3g26raw2ercopv), Message { topic: TopicId(6gebwlyf7po3fygx), message: Swarm(Join(Some(PeerData(10b)))) })
2024-05-21T16:59:39.2498150Z 2024-05-21T16:58:39.071535Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::proto::hyparview: add to active view other=PublicKey(wp3g26raw2ercopv)
2024-05-21T16:59:39.2499580Z 2024-05-21T16:58:39.071564Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle out_event PeerData(PublicKey(wp3g26raw2ercopv), PeerData(10b))
2024-05-21T16:59:39.2501200Z 2024-05-21T16:58:39.071581Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: add known addrs: AddrInfo { relay_url: None, direct_addresses: {167.235.14.200:58263} } peer=PublicKey(wp3g26raw2ercopv)
2024-05-21T16:59:39.2503880Z 2024-05-21T16:58:39.071634Z DEBUG gossip{me=nkpqjtgrfsdzojzk}:add_node_addr{me=nkpqjtgrfsdzojzk}:add_node_addr{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: added new direct paths for endpoint new={167.235.14.200:58263} paths=[167.235.14.200:58263{ active pong-received(12.792209ms ago) ping-received(126.981708ms ago) ping-sent(126.853166ms ago) }]
2024-05-21T16:59:39.2506720Z 2024-05-21T16:58:39.071660Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle out_event SendMessage(PublicKey(wp3g26raw2ercopv), Message { topic: TopicId(6gebwlyf7po3fygx), message: Swarm(Neighbor(Neighbor { priority: High, data: Some(PeerData(10b)) })) })
2024-05-21T16:59:39.2508510Z 2024-05-21T16:58:39.071678Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle out_event EmitEvent(TopicId(6gebwlyf7po3fygx), NeighborUp(PublicKey(wp3g26raw2ercopv)))
2024-05-21T16:59:39.2510170Z 2024-05-21T16:58:39.071723Z DEBUG sync{me=nkpqjtgrfsdzojzk}:accept:accept{peer=wp3g26raw2ercopv}: iroh_docs::net: connection established t_connect=124.009ms
2024-05-21T16:59:39.2511880Z 2024-05-21T16:58:39.072000Z DEBUG sync{me=nkpqjtgrfsdzojzk}:sync{me=nkpqjtgrfsdzojzk}: iroh::docs_engine::gossip: joined gossip namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2513440Z 2024-05-21T16:58:39.072038Z DEBUG sync{me=nkpqjtgrfsdzojzk}: iroh::docs_engine::live: neighbor up peer=wp3g26raw2ercopv namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2515150Z 2024-05-21T16:58:39.072064Z DEBUG sync{me=nkpqjtgrfsdzojzk}:connect{peer=wp3g26raw2ercopv namespace=6gebwlyf7po3fygx}: iroh::docs_engine::state: start connect reason=NewNeighbor
2024-05-21T16:59:39.2517010Z 2024-05-21T16:58:39.072077Z DEBUG sync{me=nkpqjtgrfsdzojzk}:connect{peer=wp3g26raw2ercopv namespace=6gebwlyf7po3fygx}: iroh::docs_engine::state: abort connect: sync already running
2024-05-21T16:59:39.2518630Z 2024-05-21T16:58:39.072094Z DEBUG sync{me=nkpqjtgrfsdzojzk}: iroh::docs_engine::live: emit event namespace=6gebwlyf7po3fygx event=NeighborUp
2024-05-21T16:59:39.2519740Z 2024-05-21T16:58:39.072285Z DEBUG hyper::proto::h1::io: parsed 5 headers
2024-05-21T16:59:39.2520500Z 2024-05-21T16:58:39.072292Z DEBUG hyper::proto::h1::conn: incoming body is content-length (30 bytes)
2024-05-21T16:59:39.2521260Z 2024-05-21T16:58:39.072305Z DEBUG hyper::proto::h1::conn: incoming body completed
2024-05-21T16:59:39.2521950Z 2024-05-21T16:58:39.072347Z DEBUG hyper::proto::h1::io: parsed 5 headers
2024-05-21T16:59:39.2522690Z 2024-05-21T16:58:39.072353Z DEBUG hyper::proto::h1::conn: incoming body is content-length (30 bytes)
2024-05-21T16:59:39.2523450Z 2024-05-21T16:58:39.072361Z DEBUG hyper::proto::h1::conn: incoming body completed
2024-05-21T16:59:39.2524480Z 2024-05-21T16:58:39.072427Z DEBUG pkarr_publish{me=nkpqjtgrfsdzojzk}: hyper::client::pool: pooling idle connection for ("https", dns.iroh.link)
2024-05-21T16:59:39.2526040Z 2024-05-21T16:58:39.072500Z  WARN pkarr_publish{me=nkpqjtgrfsdzojzk}: iroh_net::discovery::pkarr_publish: Failed to publish to pkarr err=Publish request failed with status 429 Too Many Requests
2024-05-21T16:59:39.2526870Z 
2024-05-21T16:59:39.2601840Z 2024-05-21T16:58:39.075409Z DEBUG pkarr_publish{me=wp3g26raw2ercopv}: hyper::client::pool: pooling idle connection for ("https", dns.iroh.link)
2024-05-21T16:59:39.2603350Z 2024-05-21T16:58:39.075518Z  WARN pkarr_publish{me=wp3g26raw2ercopv}: iroh_net::discovery::pkarr_publish: Failed to publish to pkarr err=Publish request failed with status 429 Too Many Requests
2024-05-21T16:59:39.2675360Z 2024-05-21T16:58:39.076123Z DEBUG iroh::node::rpc: handling rpc request: DocSubscribe
2024-05-21T16:59:39.2676100Z 2024-05-21T16:58:39.076678Z DEBUG iroh::node::rpc: handling rpc request: DocSubscribe
2024-05-21T16:59:39.2676820Z 2024-05-21T16:58:39.076786Z DEBUG iroh::node::rpc: handling rpc request: DocSet
2024-05-21T16:59:39.2678290Z 2024-05-21T16:58:39.077452Z DEBUG sync{me=nkpqjtgrfsdzojzk}: iroh_docs::sync: insert origin=Local hash=ydldsgkxejexaxrsxblos2s3zgyfmn2zuxoxjgitxc6bdpusdhla outcome=Inserted { removed: 0 }
2024-05-21T16:59:39.2679890Z 2024-05-21T16:58:39.077510Z DEBUG sync{me=nkpqjtgrfsdzojzk}: iroh::docs_engine::live: replica event: LocalInsert namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2681270Z 2024-05-21T16:58:39.077555Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle in_event  Command(TopicId(6gebwlyf7po3fygx), Broadcast(<271b>, Swarm))
2024-05-21T16:59:39.2683120Z 2024-05-21T16:58:39.077612Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle out_event SendMessage(PublicKey(wp3g26raw2ercopv), Message { topic: TopicId(6gebwlyf7po3fygx), message: Gossip(Gossip(Gossip { id: MessageId(eyfvyuoglqlv6ati), content: <271b>, scope: Swarm(Round(0)) })) })
2024-05-21T16:59:39.2684610Z 2024-05-21T16:58:39.077896Z DEBUG iroh::node::rpc: handling rpc request: DocSet
2024-05-21T16:59:39.2685910Z 2024-05-21T16:58:39.078563Z DEBUG sync{me=nkpqjtgrfsdzojzk}: iroh_docs::sync: insert origin=Local hash=3rmbc4x7qu2dkhamo3w5iu7bqmpt2e3odb7kq3slmlxr4xzwrtsa outcome=Inserted { removed: 0 }
2024-05-21T16:59:39.2687480Z 2024-05-21T16:58:39.078619Z DEBUG sync{me=nkpqjtgrfsdzojzk}: iroh::docs_engine::live: replica event: LocalInsert namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2688880Z 2024-05-21T16:58:39.078651Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle in_event  Command(TopicId(6gebwlyf7po3fygx), Broadcast(<273b>, Swarm))
2024-05-21T16:59:39.2690710Z 2024-05-21T16:58:39.078688Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle out_event SendMessage(PublicKey(wp3g26raw2ercopv), Message { topic: TopicId(6gebwlyf7po3fygx), message: Gossip(Gossip(Gossip { id: MessageId(uzcn5njndtzwr66y), content: <273b>, scope: Swarm(Round(0)) })) })
2024-05-21T16:59:39.2692140Z 2024-05-21T16:58:39.078958Z DEBUG iroh::node::rpc: handling rpc request: DocSet
2024-05-21T16:59:39.2693450Z 2024-05-21T16:58:39.079628Z DEBUG sync{me=nkpqjtgrfsdzojzk}: iroh_docs::sync: insert origin=Local hash=2fopzenhknazbvkejedcpu6gfjlneet7b43qwg3meu4fdhcxb3jq outcome=Inserted { removed: 0 }
2024-05-21T16:59:39.2695040Z 2024-05-21T16:58:39.079668Z DEBUG sync{me=nkpqjtgrfsdzojzk}: iroh::docs_engine::live: replica event: LocalInsert namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2696400Z 2024-05-21T16:58:39.079700Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle in_event  Command(TopicId(6gebwlyf7po3fygx), Broadcast(<272b>, Swarm))
2024-05-21T16:59:39.2698230Z 2024-05-21T16:58:39.079737Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle out_event SendMessage(PublicKey(wp3g26raw2ercopv), Message { topic: TopicId(6gebwlyf7po3fygx), message: Gossip(Gossip(Gossip { id: MessageId(le23vb7az6hpucmr), content: <272b>, scope: Swarm(Round(0)) })) })
2024-05-21T16:59:39.2699730Z 2024-05-21T16:58:39.079982Z DEBUG iroh::node::rpc: handling rpc request: DocSet
2024-05-21T16:59:39.2701040Z 2024-05-21T16:58:39.080581Z DEBUG sync{me=nkpqjtgrfsdzojzk}: iroh_docs::sync: insert origin=Local hash=5hfbkcnpai6bgfhlwxpz6dkhnmctuz5clozfozy7syh23nzsbglq outcome=Inserted { removed: 0 }
2024-05-21T16:59:39.2702620Z 2024-05-21T16:58:39.080634Z DEBUG sync{me=nkpqjtgrfsdzojzk}: iroh::docs_engine::live: replica event: LocalInsert namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2703990Z 2024-05-21T16:58:39.080664Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle in_event  Command(TopicId(6gebwlyf7po3fygx), Broadcast(<258b>, Swarm))
2024-05-21T16:59:39.2705870Z 2024-05-21T16:58:39.080705Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle out_event SendMessage(PublicKey(wp3g26raw2ercopv), Message { topic: TopicId(6gebwlyf7po3fygx), message: Gossip(Gossip(Gossip { id: MessageId(fouf4mo72theylqs), content: <258b>, scope: Swarm(Round(0)) })) })
2024-05-21T16:59:39.2707330Z 2024-05-21T16:58:39.080950Z DEBUG iroh::node::rpc: handling rpc request: DocSet
2024-05-21T16:59:39.2708630Z 2024-05-21T16:58:39.081617Z DEBUG sync{me=nkpqjtgrfsdzojzk}: iroh_docs::sync: insert origin=Local hash=4cu2rgrjzq7o5mtlj7znz5r2dfsgwo53cmzrva5z2simxgq7yxwq outcome=Inserted { removed: 0 }
2024-05-21T16:59:39.2710200Z 2024-05-21T16:58:39.081669Z DEBUG sync{me=nkpqjtgrfsdzojzk}: iroh::docs_engine::live: replica event: LocalInsert namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2711570Z 2024-05-21T16:58:39.081698Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle in_event  Command(TopicId(6gebwlyf7po3fygx), Broadcast(<271b>, Swarm))
2024-05-21T16:59:39.2713400Z 2024-05-21T16:58:39.081733Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle out_event SendMessage(PublicKey(wp3g26raw2ercopv), Message { topic: TopicId(6gebwlyf7po3fygx), message: Gossip(Gossip(Gossip { id: MessageId(e24v47kafnwa6hqi), content: <271b>, scope: Swarm(Round(0)) })) })
2024-05-21T16:59:39.2714810Z 2024-05-21T16:58:39.081959Z DEBUG iroh::node::rpc: handling rpc request: DocSet
2024-05-21T16:59:39.2716120Z 2024-05-21T16:58:39.082618Z DEBUG sync{me=nkpqjtgrfsdzojzk}: iroh_docs::sync: insert origin=Local hash=beulx57xfasqtsdxeev2swqhbhmtgt7h2skwpbh5qkhp5pph3u5q outcome=Inserted { removed: 0 }
2024-05-21T16:59:39.2717690Z 2024-05-21T16:58:39.082672Z DEBUG sync{me=nkpqjtgrfsdzojzk}: iroh::docs_engine::live: replica event: LocalInsert namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2719060Z 2024-05-21T16:58:39.082702Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle in_event  Command(TopicId(6gebwlyf7po3fygx), Broadcast(<266b>, Swarm))
2024-05-21T16:59:39.2720930Z 2024-05-21T16:58:39.082738Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle out_event SendMessage(PublicKey(wp3g26raw2ercopv), Message { topic: TopicId(6gebwlyf7po3fygx), message: Gossip(Gossip(Gossip { id: MessageId(3s2lezaka6qpjkcr), content: <266b>, scope: Swarm(Round(0)) })) })
2024-05-21T16:59:39.2722350Z 2024-05-21T16:58:39.083001Z DEBUG iroh::node::rpc: handling rpc request: DocSet
2024-05-21T16:59:39.2723660Z 2024-05-21T16:58:39.083556Z DEBUG sync{me=wp3g26raw2ercopv}: iroh_docs::sync: insert origin=Local hash=2niuhrnb3d4lfskzh4bzntodcfxxrundsexkfkysgx6i3tj3mifa outcome=Inserted { removed: 0 }
2024-05-21T16:59:39.2725240Z 2024-05-21T16:58:39.083637Z DEBUG sync{me=wp3g26raw2ercopv}: iroh::docs_engine::live: replica event: LocalInsert namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2726670Z 2024-05-21T16:58:39.083667Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle in_event  Command(TopicId(6gebwlyf7po3fygx), Broadcast(<262b>, Swarm))
2024-05-21T16:59:39.2727680Z 2024-05-21T16:58:39.083792Z DEBUG iroh::node::rpc: handling rpc request: DocSet
2024-05-21T16:59:39.2728980Z 2024-05-21T16:58:39.084354Z DEBUG sync{me=wp3g26raw2ercopv}: iroh_docs::sync: insert origin=Local hash=v7jlni3dnut4z65id574ye3nle35s7vwnoosgdoc7y22klmnffiq outcome=Inserted { removed: 0 }
2024-05-21T16:59:39.2730550Z 2024-05-21T16:58:39.084402Z DEBUG sync{me=wp3g26raw2ercopv}: iroh::docs_engine::live: replica event: LocalInsert namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2731920Z 2024-05-21T16:58:39.084428Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle in_event  Command(TopicId(6gebwlyf7po3fygx), Broadcast(<254b>, Swarm))
2024-05-21T16:59:39.2732930Z 2024-05-21T16:58:39.084543Z DEBUG iroh::node::rpc: handling rpc request: DocSet
2024-05-21T16:59:39.2734230Z 2024-05-21T16:58:39.085117Z DEBUG sync{me=wp3g26raw2ercopv}: iroh_docs::sync: insert origin=Local hash=prbbsdfb6qqmblt2xblztqvkhw6bdb2x4lebymv76mizz2vlw7ma outcome=Inserted { removed: 0 }
2024-05-21T16:59:39.2735830Z 2024-05-21T16:58:39.085152Z DEBUG sync{me=wp3g26raw2ercopv}: iroh::docs_engine::live: replica event: LocalInsert namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2737200Z 2024-05-21T16:58:39.085179Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle in_event  Command(TopicId(6gebwlyf7po3fygx), Broadcast(<258b>, Swarm))
2024-05-21T16:59:39.2738940Z 2024-05-21T16:58:39.090417Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle in_event  RecvMessage(PublicKey(nkpqjtgrfsdzojzk), Message { topic: TopicId(6gebwlyf7po3fygx), message: Swarm(Neighbor(Neighbor { priority: High, data: Some(PeerData(10b)) })) })
2024-05-21T16:59:39.2740660Z 2024-05-21T16:58:39.090464Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::proto::hyparview: add to active view other=PublicKey(nkpqjtgrfsdzojzk)
2024-05-21T16:59:39.2742100Z 2024-05-21T16:58:39.090484Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle out_event PeerData(PublicKey(nkpqjtgrfsdzojzk), PeerData(10b))
2024-05-21T16:59:39.2743660Z 2024-05-21T16:58:39.090503Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: add known addrs: AddrInfo { relay_url: None, direct_addresses: {167.235.14.200:51664} } peer=PublicKey(nkpqjtgrfsdzojzk)
2024-05-21T16:59:39.2746230Z 2024-05-21T16:58:39.090565Z DEBUG gossip{me=wp3g26raw2ercopv}:add_node_addr{me=wp3g26raw2ercopv}:add_node_addr{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: added new direct paths for endpoint new={167.235.14.200:51664} paths=[167.235.14.200:51664{ active pong-received(38.869666ms ago) ping-received(36.3575ms ago) ping-sent(148.804166ms ago) }]
2024-05-21T16:59:39.2748970Z 2024-05-21T16:58:39.090591Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle out_event SendMessage(PublicKey(nkpqjtgrfsdzojzk), Message { topic: TopicId(6gebwlyf7po3fygx), message: Swarm(Neighbor(Neighbor { priority: High, data: Some(PeerData(10b)) })) })
2024-05-21T16:59:39.2750750Z 2024-05-21T16:58:39.090610Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle out_event EmitEvent(TopicId(6gebwlyf7po3fygx), NeighborUp(PublicKey(nkpqjtgrfsdzojzk)))
2024-05-21T16:59:39.2752640Z 2024-05-21T16:58:39.090932Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle in_event  RecvMessage(PublicKey(nkpqjtgrfsdzojzk), Message { topic: TopicId(6gebwlyf7po3fygx), message: Gossip(Gossip(Gossip { id: MessageId(eyfvyuoglqlv6ati), content: <271b>, scope: Swarm(Round(0)) })) })
2024-05-21T16:59:39.2757950Z 2024-05-21T16:58:39.091001Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle out_event EmitEvent(TopicId(6gebwlyf7po3fygx), Received(GossipEvent { content: <271b>, delivered_from: PublicKey(nkpqjtgrfsdzojzk), scope: Swarm(Round(0)) }))
2024-05-21T16:59:39.2759760Z 2024-05-21T16:58:39.091162Z DEBUG sync{me=wp3g26raw2ercopv}:sync{me=wp3g26raw2ercopv}: iroh::docs_engine::gossip: joined gossip namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2761580Z 2024-05-21T16:58:39.091212Z DEBUG sync{me=wp3g26raw2ercopv}:sync{me=wp3g26raw2ercopv}: iroh::docs_engine::gossip: received entry via gossip peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2763680Z 2024-05-21T16:58:39.091238Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle in_event  RecvMessage(PublicKey(nkpqjtgrfsdzojzk), Message { topic: TopicId(6gebwlyf7po3fygx), message: Gossip(Gossip(Gossip { id: MessageId(uzcn5njndtzwr66y), content: <273b>, scope: Swarm(Round(0)) })) })
2024-05-21T16:59:39.2765750Z 2024-05-21T16:58:39.091276Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle out_event EmitEvent(TopicId(6gebwlyf7po3fygx), Received(GossipEvent { content: <273b>, delivered_from: PublicKey(nkpqjtgrfsdzojzk), scope: Swarm(Round(0)) }))
2024-05-21T16:59:39.2767510Z 2024-05-21T16:58:39.091431Z DEBUG sync{me=wp3g26raw2ercopv}: iroh::docs_engine::live: neighbor up peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2769220Z 2024-05-21T16:58:39.091459Z DEBUG sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}: iroh::docs_engine::state: start connect reason=NewNeighbor
2024-05-21T16:59:39.2771080Z 2024-05-21T16:58:39.091474Z DEBUG sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}: iroh::docs_engine::state: abort connect: sync already running
2024-05-21T16:59:39.2772700Z 2024-05-21T16:58:39.091492Z DEBUG sync{me=wp3g26raw2ercopv}: iroh::docs_engine::live: emit event namespace=6gebwlyf7po3fygx event=NeighborUp
2024-05-21T16:59:39.2774600Z 2024-05-21T16:58:39.091552Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle in_event  RecvMessage(PublicKey(nkpqjtgrfsdzojzk), Message { topic: TopicId(6gebwlyf7po3fygx), message: Gossip(Gossip(Gossip { id: MessageId(le23vb7az6hpucmr), content: <272b>, scope: Swarm(Round(0)) })) })
2024-05-21T16:59:39.2776670Z 2024-05-21T16:58:39.091591Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle out_event EmitEvent(TopicId(6gebwlyf7po3fygx), Received(GossipEvent { content: <272b>, delivered_from: PublicKey(nkpqjtgrfsdzojzk), scope: Swarm(Round(0)) }))
2024-05-21T16:59:39.2778760Z 2024-05-21T16:58:39.091738Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle in_event  RecvMessage(PublicKey(nkpqjtgrfsdzojzk), Message { topic: TopicId(6gebwlyf7po3fygx), message: Gossip(Gossip(Gossip { id: MessageId(fouf4mo72theylqs), content: <258b>, scope: Swarm(Round(0)) })) })
2024-05-21T16:59:39.2780840Z 2024-05-21T16:58:39.091778Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle out_event EmitEvent(TopicId(6gebwlyf7po3fygx), Received(GossipEvent { content: <258b>, delivered_from: PublicKey(nkpqjtgrfsdzojzk), scope: Swarm(Round(0)) }))
2024-05-21T16:59:39.2782940Z 2024-05-21T16:58:39.091910Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle in_event  RecvMessage(PublicKey(nkpqjtgrfsdzojzk), Message { topic: TopicId(6gebwlyf7po3fygx), message: Gossip(Gossip(Gossip { id: MessageId(e24v47kafnwa6hqi), content: <271b>, scope: Swarm(Round(0)) })) })
2024-05-21T16:59:39.2785010Z 2024-05-21T16:58:39.091959Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle out_event EmitEvent(TopicId(6gebwlyf7po3fygx), Received(GossipEvent { content: <271b>, delivered_from: PublicKey(nkpqjtgrfsdzojzk), scope: Swarm(Round(0)) }))
2024-05-21T16:59:39.2787090Z 2024-05-21T16:58:39.092002Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle in_event  RecvMessage(PublicKey(nkpqjtgrfsdzojzk), Message { topic: TopicId(6gebwlyf7po3fygx), message: Gossip(Gossip(Gossip { id: MessageId(3s2lezaka6qpjkcr), content: <266b>, scope: Swarm(Round(0)) })) })
2024-05-21T16:59:39.2789150Z 2024-05-21T16:58:39.092041Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle out_event EmitEvent(TopicId(6gebwlyf7po3fygx), Received(GossipEvent { content: <266b>, delivered_from: PublicKey(nkpqjtgrfsdzojzk), scope: Swarm(Round(0)) }))
2024-05-21T16:59:39.2791620Z 2024-05-21T16:58:39.092091Z DEBUG sync{me=wp3g26raw2ercopv}: iroh_docs::sync: insert origin=Sync { from: [106, 159, 4, 204, 209, 44, 135, 151, 39, 42, 242, 73, 234, 218, 171, 14, 5, 148, 193, 246, 183, 185, 169, 162, 157, 12, 106, 84, 66, 115, 122, 139], remote_content_status: Complete } hash=ydldsgkxejexaxrsxblos2s3zgyfmn2zuxoxjgitxc6bdpusdhla outcome=Inserted { removed: 0 }
2024-05-21T16:59:39.2794190Z 2024-05-21T16:58:39.092683Z DEBUG sync{me=nkpqjtgrfsdzojzk}:accept:accept{peer=wp3g26raw2ercopv namespace=6gebwlyf7po3fygx}: iroh_docs::net: done, ok t_connect=124.009ms t_process=20.9625ms sent=0 recv=0
2024-05-21T16:59:39.2796570Z 2024-05-21T16:58:39.092875Z  INFO sync{me=nkpqjtgrfsdzojzk}:accept{peer=wp3g26raw2ercopv namespace=6gebwlyf7po3fygx}: iroh::docs_engine::live: sync finished sent=0 recv=0 t_connect=124.009ms t_process=20.9625ms
2024-05-21T16:59:39.2798360Z 2024-05-21T16:58:39.092950Z DEBUG sync{me=wp3g26raw2ercopv}: iroh::docs_engine::live: replica event: RemoteInsert namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2799820Z 2024-05-21T16:58:39.093022Z DEBUG downloader{me=wp3g26raw2ercopv}: iroh_blobs::downloader: queue intent kind=ydldsgkxejexaxrs:Raw nodes=["nkpqjtgrfsdzojzk"]
2024-05-21T16:59:39.2801640Z 2024-05-21T16:58:39.093074Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle in_event  RecvMessage(PublicKey(wp3g26raw2ercopv), Message { topic: TopicId(6gebwlyf7po3fygx), message: Swarm(Neighbor(Neighbor { priority: High, data: Some(PeerData(10b)) })) })
2024-05-21T16:59:39.2803410Z 2024-05-21T16:58:39.093092Z DEBUG downloader{me=wp3g26raw2ercopv}: iroh_blobs::downloader: dial node kind=ydldsgkxejexaxrs:Raw node=nkpqjtgrfsdzojzk
2024-05-21T16:59:39.2804760Z 2024-05-21T16:58:39.093193Z DEBUG iroh_net::endpoint: connecting to nkpqjtgrfsdzojzk6je6vwvlbyczjqpww642tiu5brvfiqttpkfq: (via [fd15:70a:510b::1]:12345 - {})
2024-05-21T16:59:39.2806400Z 2024-05-21T16:58:39.093277Z DEBUG sync{me=wp3g26raw2ercopv}:sync{me=wp3g26raw2ercopv}: iroh::docs_engine::gossip: received entry via gossip peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2808490Z 2024-05-21T16:58:39.093309Z DEBUG sync{me=nkpqjtgrfsdzojzk}:accept{peer=wp3g26raw2ercopv namespace=6gebwlyf7po3fygx}: iroh::docs_engine::live: emit event namespace=6gebwlyf7po3fygx event=SyncFinished
2024-05-21T16:59:39.2810620Z 2024-05-21T16:58:39.093343Z DEBUG sync{me=nkpqjtgrfsdzojzk}:accept{peer=wp3g26raw2ercopv namespace=6gebwlyf7po3fygx}: iroh::docs_engine::live: emit event namespace=6gebwlyf7po3fygx event=PendingContentReady
2024-05-21T16:59:39.2812870Z 2024-05-21T16:58:39.093678Z DEBUG sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}: iroh_docs::net: done, ok t_connect=117.157083ms t_process=37.326875ms sent=0 recv=0
2024-05-21T16:59:39.2815180Z 2024-05-21T16:58:39.093827Z  INFO sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}: iroh::docs_engine::live: sync finished sent=0 recv=0 t_connect=117.157083ms t_process=37.326875ms
2024-05-21T16:59:39.2816740Z 2024-05-21T16:58:39.093888Z DEBUG rustls::client::hs: No cached session for DnsName("localhost")    
2024-05-21T16:59:39.2817510Z 2024-05-21T16:58:39.094107Z DEBUG rustls::client::hs: Not resuming any session    
2024-05-21T16:59:39.2819330Z 2024-05-21T16:58:39.094410Z DEBUG sync{me=wp3g26raw2ercopv}: iroh_docs::sync: insert origin=Sync { from: [106, 159, 4, 204, 209, 44, 135, 151, 39, 42, 242, 73, 234, 218, 171, 14, 5, 148, 193, 246, 183, 185, 169, 162, 157, 12, 106, 84, 66, 115, 122, 139], remote_content_status: Complete } hash=3rmbc4x7qu2dkhamo3w5iu7bqmpt2e3odb7kq3slmlxr4xzwrtsa outcome=Inserted { removed: 0 }
2024-05-21T16:59:39.2821660Z 2024-05-21T16:58:39.094525Z DEBUG sync{me=wp3g26raw2ercopv}:sync{me=wp3g26raw2ercopv}: iroh::docs_engine::gossip: received entry via gossip peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2823710Z 2024-05-21T16:58:39.094555Z DEBUG sync{me=wp3g26raw2ercopv}:connect{peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx}: iroh::docs_engine::live: emit event namespace=6gebwlyf7po3fygx event=SyncFinished
2024-05-21T16:59:39.2825410Z 2024-05-21T16:58:39.094591Z DEBUG sync{me=wp3g26raw2ercopv}: iroh::docs_engine::live: replica event: RemoteInsert namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2826880Z 2024-05-21T16:58:39.094682Z DEBUG downloader{me=wp3g26raw2ercopv}: iroh_blobs::downloader: queue intent kind=3rmbc4x7qu2dkham:Raw nodes=["nkpqjtgrfsdzojzk"]
2024-05-21T16:59:39.2828040Z 2024-05-21T16:58:39.094902Z DEBUG rustls::server::hs: decided upon suite TLS13_AES_128_GCM_SHA256    
2024-05-21T16:59:39.2828970Z 2024-05-21T16:58:39.095353Z DEBUG rustls::server::hs: Chosen ALPN protocol [47, 105, 114, 111, 104, 45, 98, 121, 116, 101, 115, 47, 52]    
2024-05-21T16:59:39.2830960Z 2024-05-21T16:58:39.095371Z DEBUG sync{me=wp3g26raw2ercopv}: iroh_docs::sync: insert origin=Sync { from: [106, 159, 4, 204, 209, 44, 135, 151, 39, 42, 242, 73, 234, 218, 171, 14, 5, 148, 193, 246, 183, 185, 169, 162, 157, 12, 106, 84, 66, 115, 122, 139], remote_content_status: Complete } hash=2fopzenhknazbvkejedcpu6gfjlneet7b43qwg3meu4fdhcxb3jq outcome=Inserted { removed: 0 }
2024-05-21T16:59:39.2833040Z 2024-05-21T16:58:39.095948Z DEBUG sync{me=wp3g26raw2ercopv}: iroh::docs_engine::live: replica event: RemoteInsert namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2834490Z 2024-05-21T16:58:39.095999Z DEBUG downloader{me=wp3g26raw2ercopv}: iroh_blobs::downloader: queue intent kind=2fopzenhknazbvke:Raw nodes=["nkpqjtgrfsdzojzk"]
2024-05-21T16:59:39.2836260Z 2024-05-21T16:58:39.096035Z DEBUG sync{me=wp3g26raw2ercopv}:sync{me=wp3g26raw2ercopv}: iroh::docs_engine::gossip: received entry via gossip peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2837760Z 2024-05-21T16:58:39.096201Z DEBUG drive{id=2}: rustls::client::hs: Using ciphersuite TLS13_AES_128_GCM_SHA256    
2024-05-21T16:59:39.2838880Z 2024-05-21T16:58:39.096218Z DEBUG drive{id=2}: rustls::client::tls13: Not resuming    
2024-05-21T16:59:39.2841270Z 2024-05-21T16:58:39.096504Z DEBUG drive{id=2}: rustls::client::tls13: TLS1.3 encrypted extensions: [Protocols([ProtocolName(2f69726f682d62797465732f34)]), ServerNameAck, TransportParameters([1, 2, 103, 16, 3, 2, 69, 192, 4, 8, 255, 255, 255, 255, 255, 255, 255, 255, 5, 4, 128, 19, 18, 208, 6, 4, 128, 19, 18, 208, 7, 4, 128, 19, 18, 208, 8, 1, 10, 14, 1, 5, 64, 182, 0, 2, 16, 191, 116, 11, 49, 229, 42, 164, 176, 113, 81, 18, 208, 74, 63, 79, 43, 32, 4, 128, 0, 255, 255, 0, 20, 210, 201, 242, 237, 187, 233, 55, 54, 121, 144, 158, 233, 126, 213, 227, 146, 64, 194, 189, 194, 15, 8, 76, 178, 231, 248, 155, 19, 154, 133])]    
2024-05-21T16:59:39.2843530Z 2024-05-21T16:58:39.096536Z DEBUG drive{id=2}: rustls::client::hs: ALPN protocol is Some(b"/iroh-bytes/4")    
2024-05-21T16:59:39.2845020Z 2024-05-21T16:58:39.096555Z DEBUG drive{id=2}: rustls::client::tls13: Got CertificateRequest CertificateRequestPayloadTLS13 { context: , extensions: [SignatureAlgorithms([ECDSA_NISTP384_SHA384, ECDSA_NISTP256_SHA256, ED25519])] }    
2024-05-21T16:59:39.2846430Z 2024-05-21T16:58:39.096572Z DEBUG drive{id=2}: rustls::client::common: Attempting client auth    
2024-05-21T16:59:39.2848380Z 2024-05-21T16:58:39.096801Z DEBUG sync{me=wp3g26raw2ercopv}: iroh_docs::sync: insert origin=Sync { from: [106, 159, 4, 204, 209, 44, 135, 151, 39, 42, 242, 73, 234, 218, 171, 14, 5, 148, 193, 246, 183, 185, 169, 162, 157, 12, 106, 84, 66, 115, 122, 139], remote_content_status: Complete } hash=5hfbkcnpai6bgfhlwxpz6dkhnmctuz5clozfozy7syh23nzsbglq outcome=Inserted { removed: 0 }
2024-05-21T16:59:39.2850400Z 2024-05-21T16:58:39.096890Z DEBUG sync{me=wp3g26raw2ercopv}: iroh::docs_engine::live: replica event: RemoteInsert namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2852090Z 2024-05-21T16:58:39.096944Z DEBUG sync{me=wp3g26raw2ercopv}:sync{me=wp3g26raw2ercopv}: iroh::docs_engine::gossip: received entry via gossip peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2854540Z 2024-05-21T16:58:39.097785Z DEBUG sync{me=wp3g26raw2ercopv}: iroh_docs::sync: insert origin=Sync { from: [106, 159, 4, 204, 209, 44, 135, 151, 39, 42, 242, 73, 234, 218, 171, 14, 5, 148, 193, 246, 183, 185, 169, 162, 157, 12, 106, 84, 66, 115, 122, 139], remote_content_status: Complete } hash=4cu2rgrjzq7o5mtlj7znz5r2dfsgwo53cmzrva5z2simxgq7yxwq outcome=Inserted { removed: 0 }
2024-05-21T16:59:39.2856850Z 2024-05-21T16:58:39.097939Z DEBUG magic_ep{me=wp3g26raw2ercopv}:rtt-actor: iroh_net::endpoint::rtt_actor: Congestion controller state reset node_id=nkpqjtgrfsdzojzk new_type=Direct(167.235.14.200:51664)
2024-05-21T16:59:39.2858460Z 2024-05-21T16:58:39.097976Z DEBUG sync{me=wp3g26raw2ercopv}: iroh::docs_engine::live: replica event: RemoteInsert namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2859960Z 2024-05-21T16:58:39.097978Z DEBUG downloader{me=wp3g26raw2ercopv}: iroh_blobs::downloader: start transfer kind=ydldsgkxejexaxrs:Raw node=nkpqjtgrfsdzojzk
2024-05-21T16:59:39.2861720Z 2024-05-21T16:58:39.098027Z DEBUG sync{me=wp3g26raw2ercopv}:sync{me=wp3g26raw2ercopv}: iroh::docs_engine::gossip: received entry via gossip peer=nkpqjtgrfsdzojzk namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2863440Z 2024-05-21T16:58:39.098048Z DEBUG downloader{me=wp3g26raw2ercopv}: iroh_blobs::downloader: start transfer kind=3rmbc4x7qu2dkham:Raw node=nkpqjtgrfsdzojzk
2024-05-21T16:59:39.2864970Z 2024-05-21T16:58:39.098090Z DEBUG downloader{me=wp3g26raw2ercopv}: iroh_blobs::downloader: start transfer kind=2fopzenhknazbvke:Raw node=nkpqjtgrfsdzojzk
2024-05-21T16:59:39.2866620Z 2024-05-21T16:58:39.098625Z DEBUG downloader{me=wp3g26raw2ercopv}:transfer{kind=ydldsgkxejexaxrs:Raw node=nkpqjtgrfsdzojzk}: iroh_blobs::get::fsm: sending request
2024-05-21T16:59:39.2868900Z 2024-05-21T16:58:39.098897Z DEBUG sync{me=wp3g26raw2ercopv}: iroh_docs::sync: insert origin=Sync { from: [106, 159, 4, 204, 209, 44, 135, 151, 39, 42, 242, 73, 234, 218, 171, 14, 5, 148, 193, 246, 183, 185, 169, 162, 157, 12, 106, 84, 66, 115, 122, 139], remote_content_status: Complete } hash=beulx57xfasqtsdxeev2swqhbhmtgt7h2skwpbh5qkhp5pph3u5q outcome=Inserted { removed: 0 }
2024-05-21T16:59:39.2871120Z 2024-05-21T16:58:39.098749Z DEBUG downloader{me=wp3g26raw2ercopv}:transfer{kind=3rmbc4x7qu2dkham:Raw node=nkpqjtgrfsdzojzk}: iroh_blobs::get::fsm: sending request
2024-05-21T16:59:39.2872850Z 2024-05-21T16:58:39.098994Z DEBUG downloader{me=wp3g26raw2ercopv}:transfer{kind=2fopzenhknazbvke:Raw node=nkpqjtgrfsdzojzk}: iroh_blobs::get::fsm: sending request
2024-05-21T16:59:39.2874700Z 2024-05-21T16:58:39.099930Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:rtt-actor: iroh_net::endpoint::rtt_actor: Congestion controller state reset node_id=wp3g26raw2ercopv new_type=Direct(167.235.14.200:58263)
2024-05-21T16:59:39.2876320Z 2024-05-21T16:58:39.099967Z DEBUG sync{me=wp3g26raw2ercopv}: iroh::docs_engine::live: replica event: RemoteInsert namespace=6gebwlyf7po3fygx
2024-05-21T16:59:39.2877910Z 2024-05-21T16:58:39.100328Z DEBUG connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=0}: iroh_blobs::provider: reading request
2024-05-21T16:59:39.2879880Z 2024-05-21T16:58:39.100377Z DEBUG connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=0}: iroh_blobs::provider: received request hash=ydldsgkxejexaxrsxblos2s3zgyfmn2zuxoxjgitxc6bdpusdhla
2024-05-21T16:59:39.2881880Z 2024-05-21T16:58:39.100376Z DEBUG connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=1}: iroh_blobs::provider: reading request
2024-05-21T16:59:39.2883580Z 2024-05-21T16:58:39.100376Z DEBUG connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=2}: iroh_blobs::provider: reading request
2024-05-21T16:59:39.2885530Z 2024-05-21T16:58:39.100412Z DEBUG connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=0}: iroh_blobs::provider: writing ranges 'all' of sequence ydldsgkxejexaxrsxblos2s3zgyfmn2zuxoxjgitxc6bdpusdhla
2024-05-21T16:59:39.2887700Z 2024-05-21T16:58:39.100515Z DEBUG connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=1}: iroh_blobs::provider: received request hash=3rmbc4x7qu2dkhamo3w5iu7bqmpt2e3odb7kq3slmlxr4xzwrtsa
2024-05-21T16:59:39.2889850Z 2024-05-21T16:58:39.100539Z DEBUG connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=1}: iroh_blobs::provider: writing ranges 'all' of sequence 3rmbc4x7qu2dkhamo3w5iu7bqmpt2e3odb7kq3slmlxr4xzwrtsa
2024-05-21T16:59:39.2892050Z 2024-05-21T16:58:39.100644Z DEBUG connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=0}: iroh_blobs::provider: finished writing ranges 'all' of collection ydldsgkxejexaxrsxblos2s3zgyfmn2zuxoxjgitxc6bdpusdhla
2024-05-21T16:59:39.2894310Z 2024-05-21T16:58:39.100651Z DEBUG connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=1}: iroh_blobs::provider: finished writing ranges 'all' of collection 3rmbc4x7qu2dkhamo3w5iu7bqmpt2e3odb7kq3slmlxr4xzwrtsa
2024-05-21T16:59:39.2896580Z 2024-05-21T16:58:39.100626Z DEBUG connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=2}: iroh_blobs::provider: received request hash=2fopzenhknazbvkejedcpu6gfjlneet7b43qwg3meu4fdhcxb3jq
2024-05-21T16:59:39.2898510Z 2024-05-21T16:58:39.100708Z DEBUG connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=1}: iroh_blobs::provider: done writing
2024-05-21T16:59:39.2900180Z 2024-05-21T16:58:39.100708Z DEBUG connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=0}: iroh_blobs::provider: done writing
2024-05-21T16:59:39.2902150Z 2024-05-21T16:58:39.100719Z DEBUG connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=2}: iroh_blobs::provider: writing ranges 'all' of sequence 2fopzenhknazbvkejedcpu6gfjlneet7b43qwg3meu4fdhcxb3jq
2024-05-21T16:59:39.2904290Z 2024-05-21T16:58:39.100754Z  INFO connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=0}: iroh_blobs::provider: transfer completed for ydldsgkxejexaxrsxblos2s3zgyfmn2zuxoxjgitxc6bdpusdhla
2024-05-21T16:59:39.2906400Z 2024-05-21T16:58:39.100754Z  INFO connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=1}: iroh_blobs::provider: transfer completed for 3rmbc4x7qu2dkhamo3w5iu7bqmpt2e3odb7kq3slmlxr4xzwrtsa
2024-05-21T16:59:39.2908380Z 2024-05-21T16:58:39.100834Z  INFO connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=0}: iroh_blobs::provider: sent 44 bytes in 0.000341625s
2024-05-21T16:59:39.2910250Z 2024-05-21T16:58:39.100850Z DEBUG connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=0}: iroh_blobs::provider: 0.000106833s sending, 0.0000085s reading, 0.000226292s other
2024-05-21T16:59:39.2912060Z 2024-05-21T16:58:39.100864Z DEBUG connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=0}: iroh_blobs::provider: finished response
2024-05-21T16:59:39.2913820Z 2024-05-21T16:58:39.100845Z  INFO connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=1}: iroh_blobs::provider: sent 46 bytes in 0.000206708s
2024-05-21T16:59:39.2915830Z 2024-05-21T16:58:39.100902Z DEBUG connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=2}: iroh_blobs::provider: finished writing ranges 'all' of collection 2fopzenhknazbvkejedcpu6gfjlneet7b43qwg3meu4fdhcxb3jq
2024-05-21T16:59:39.2917810Z 2024-05-21T16:58:39.100949Z DEBUG connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=2}: iroh_blobs::provider: done writing
2024-05-21T16:59:39.2919720Z 2024-05-21T16:58:39.100964Z  INFO connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=2}: iroh_blobs::provider: transfer completed for 2fopzenhknazbvkejedcpu6gfjlneet7b43qwg3meu4fdhcxb3jq
2024-05-21T16:59:39.2921750Z 2024-05-21T16:58:39.100897Z DEBUG connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=1}: iroh_blobs::provider: 0.000064958s sending, 0.000002334s reading, 0.000139416s other
2024-05-21T16:59:39.2929120Z 2024-05-21T16:58:39.100981Z  INFO connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=2}: iroh_blobs::provider: sent 45 bytes in 0.000251667s
2024-05-21T16:59:39.2931000Z 2024-05-21T16:58:39.100994Z DEBUG connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=2}: iroh_blobs::provider: 0.000091167s sending, 0.000001875s reading, 0.000158625s other
2024-05-21T16:59:39.2932820Z 2024-05-21T16:58:39.101008Z DEBUG connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=2}: iroh_blobs::provider: finished response
2024-05-21T16:59:39.2934530Z 2024-05-21T16:58:39.100989Z DEBUG connection{connection_id=5494943248 remote_addr=[fd15:70a:510b::2]:12345}:stream{stream_id=1}: iroh_blobs::provider: finished response
2024-05-21T16:59:39.2936160Z 2024-05-21T16:58:39.101285Z DEBUG downloader{me=wp3g26raw2ercopv}: iroh_blobs::downloader: download successful kind=ydldsgkxejexaxrs:Raw node=nkpqjtgrfsdzojzk
2024-05-21T16:59:39.2937790Z 2024-05-21T16:58:39.101370Z DEBUG sync{me=wp3g26raw2ercopv}: iroh::docs_engine::live: download ready namespace=6gebwlyf7po3fygx success=true completed_namespaces=0
2024-05-21T16:59:39.2939340Z 2024-05-21T16:58:39.101388Z DEBUG sync{me=wp3g26raw2ercopv}: iroh::docs_engine::live: emit event namespace=6gebwlyf7po3fygx event=ContentReady
2024-05-21T16:59:39.2940860Z 2024-05-21T16:58:39.101432Z DEBUG downloader{me=wp3g26raw2ercopv}: iroh_blobs::downloader: download successful kind=2fopzenhknazbvke:Raw node=nkpqjtgrfsdzojzk
2024-05-21T16:59:39.2942340Z 2024-05-21T16:58:39.101463Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle in_event  Command(TopicId(6gebwlyf7po3fygx), Broadcast(<33b>, Neighbors))
2024-05-21T16:59:39.2943930Z 2024-05-21T16:58:39.101480Z DEBUG downloader{me=wp3g26raw2ercopv}: iroh_blobs::downloader: download successful kind=3rmbc4x7qu2dkham:Raw node=nkpqjtgrfsdzojzk
2024-05-21T16:59:39.2945850Z 2024-05-21T16:58:39.101498Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle out_event SendMessage(PublicKey(nkpqjtgrfsdzojzk), Message { topic: TopicId(6gebwlyf7po3fygx), message: Gossip(Gossip(Gossip { id: MessageId(e6aeajvmjrrqkvgg), content: <33b>, scope: Neighbors })) })
2024-05-21T16:59:39.2947780Z 2024-05-21T16:58:39.101710Z DEBUG sync{me=wp3g26raw2ercopv}: iroh::docs_engine::live: download ready namespace=6gebwlyf7po3fygx success=true completed_namespaces=0
2024-05-21T16:59:39.2949330Z 2024-05-21T16:58:39.101726Z DEBUG sync{me=wp3g26raw2ercopv}: iroh::docs_engine::live: emit event namespace=6gebwlyf7po3fygx event=ContentReady
2024-05-21T16:59:39.2950800Z 2024-05-21T16:58:39.101762Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle in_event  Command(TopicId(6gebwlyf7po3fygx), Broadcast(<33b>, Neighbors))
2024-05-21T16:59:39.2952630Z 2024-05-21T16:58:39.101784Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle out_event SendMessage(PublicKey(nkpqjtgrfsdzojzk), Message { topic: TopicId(6gebwlyf7po3fygx), message: Gossip(Gossip(Gossip { id: MessageId(6jei3ipnsi4vvf6n), content: <33b>, scope: Neighbors })) })
2024-05-21T16:59:39.2954560Z 2024-05-21T16:58:39.101920Z DEBUG sync{me=wp3g26raw2ercopv}: iroh::docs_engine::live: download ready namespace=6gebwlyf7po3fygx success=true completed_namespaces=1
2024-05-21T16:59:39.2956110Z 2024-05-21T16:58:39.101936Z DEBUG sync{me=wp3g26raw2ercopv}: iroh::docs_engine::live: emit event namespace=6gebwlyf7po3fygx event=ContentReady
2024-05-21T16:59:39.2957530Z 2024-05-21T16:58:39.101969Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle in_event  Command(TopicId(6gebwlyf7po3fygx), Broadcast(<33b>, Neighbors))
2024-05-21T16:59:39.2959350Z 2024-05-21T16:58:39.101990Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle out_event SendMessage(PublicKey(nkpqjtgrfsdzojzk), Message { topic: TopicId(6gebwlyf7po3fygx), message: Gossip(Gossip(Gossip { id: MessageId(sa4mp7kt3m2q5br4), content: <33b>, scope: Neighbors })) })
2024-05-21T16:59:39.2961190Z 2024-05-21T16:58:39.102035Z DEBUG sync{me=wp3g26raw2ercopv}: iroh::docs_engine::live: emit event namespace=6gebwlyf7po3fygx event=PendingContentReady
2024-05-21T16:59:39.2963060Z 2024-05-21T16:58:39.102548Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle in_event  RecvMessage(PublicKey(wp3g26raw2ercopv), Message { topic: TopicId(6gebwlyf7po3fygx), message: Gossip(Gossip(Gossip { id: MessageId(e6aeajvmjrrqkvgg), content: <33b>, scope: Neighbors })) })
2024-05-21T16:59:39.2965110Z 2024-05-21T16:58:39.102579Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle out_event EmitEvent(TopicId(6gebwlyf7po3fygx), Received(GossipEvent { content: <33b>, delivered_from: PublicKey(wp3g26raw2ercopv), scope: Neighbors }))
2024-05-21T16:59:39.2967210Z 2024-05-21T16:58:39.102725Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle in_event  RecvMessage(PublicKey(wp3g26raw2ercopv), Message { topic: TopicId(6gebwlyf7po3fygx), message: Gossip(Gossip(Gossip { id: MessageId(6jei3ipnsi4vvf6n), content: <33b>, scope: Neighbors })) })
2024-05-21T16:59:39.2969250Z 2024-05-21T16:58:39.102752Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle out_event EmitEvent(TopicId(6gebwlyf7po3fygx), Received(GossipEvent { content: <33b>, delivered_from: PublicKey(wp3g26raw2ercopv), scope: Neighbors }))
2024-05-21T16:59:39.2971330Z 2024-05-21T16:58:39.102861Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle in_event  RecvMessage(PublicKey(wp3g26raw2ercopv), Message { topic: TopicId(6gebwlyf7po3fygx), message: Gossip(Gossip(Gossip { id: MessageId(sa4mp7kt3m2q5br4), content: <33b>, scope: Neighbors })) })
2024-05-21T16:59:39.2973410Z 2024-05-21T16:58:39.102887Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle out_event EmitEvent(TopicId(6gebwlyf7po3fygx), Received(GossipEvent { content: <33b>, delivered_from: PublicKey(wp3g26raw2ercopv), scope: Neighbors }))
2024-05-21T16:59:39.2975330Z 2024-05-21T16:58:39.933850Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:portmapper.service: iroh_net::portmapper: failed to get a port mapping IO error: search timed out
2024-05-21T16:59:39.2977250Z 2024-05-21T16:58:39.938310Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:portmapper.service: iroh_net::portmapper: failed to get a port mapping IO error: search timed out
2024-05-21T16:59:39.2978860Z 2024-05-21T16:58:40.076487Z DEBUG pkarr_publish{me=nkpqjtgrfsdzojzk}: iroh_net::discovery::pkarr_publish: Publish node info to pkarr (interval elapsed)
2024-05-21T16:59:39.2980250Z 2024-05-21T16:58:40.076527Z  INFO pkarr_publish{me=nkpqjtgrfsdzojzk}: iroh_net::discovery::pkarr_publish: Publish node info to pkarr relay_url=None
2024-05-21T16:59:39.2981600Z 2024-05-21T16:58:40.077181Z DEBUG pkarr_publish{me=nkpqjtgrfsdzojzk}: hyper::client::pool: reuse idle connection for ("https", dns.iroh.link)
2024-05-21T16:59:39.2982930Z 2024-05-21T16:58:40.077240Z DEBUG pkarr_publish{me=wp3g26raw2ercopv}: iroh_net::discovery::pkarr_publish: Publish node info to pkarr (interval elapsed)
2024-05-21T16:59:39.2984310Z 2024-05-21T16:58:40.077256Z  INFO pkarr_publish{me=wp3g26raw2ercopv}: iroh_net::discovery::pkarr_publish: Publish node info to pkarr relay_url=None
2024-05-21T16:59:39.2985650Z 2024-05-21T16:58:40.077730Z DEBUG pkarr_publish{me=wp3g26raw2ercopv}: hyper::client::pool: reuse idle connection for ("https", dns.iroh.link)
2024-05-21T16:59:39.2986610Z 2024-05-21T16:58:40.077885Z DEBUG hyper::proto::h1::io: flushed 214 bytes
2024-05-21T16:59:39.2987270Z 2024-05-21T16:58:40.077939Z DEBUG hyper::proto::h1::io: flushed 214 bytes
2024-05-21T16:59:39.2987980Z 2024-05-21T16:58:40.081222Z DEBUG hyper::proto::h1::io: parsed 5 headers
2024-05-21T16:59:39.2988730Z 2024-05-21T16:58:40.081235Z DEBUG hyper::proto::h1::conn: incoming body is content-length (30 bytes)
2024-05-21T16:59:39.2989500Z 2024-05-21T16:58:40.081260Z DEBUG hyper::proto::h1::conn: incoming body completed
2024-05-21T16:59:39.2990530Z 2024-05-21T16:58:40.081320Z DEBUG pkarr_publish{me=nkpqjtgrfsdzojzk}: hyper::client::pool: pooling idle connection for ("https", dns.iroh.link)
2024-05-21T16:59:39.2992040Z 2024-05-21T16:58:40.081461Z  WARN pkarr_publish{me=nkpqjtgrfsdzojzk}: iroh_net::discovery::pkarr_publish: Failed to publish to pkarr err=Publish request failed with status 429 Too Many Requests
2024-05-21T16:59:39.3064190Z 2024-05-21T16:58:40.082077Z DEBUG hyper::proto::h1::io: parsed 5 headers
2024-05-21T16:59:39.3065020Z 2024-05-21T16:58:40.082087Z DEBUG hyper::proto::h1::conn: incoming body is content-length (30 bytes)
2024-05-21T16:59:39.3065800Z 2024-05-21T16:58:40.082101Z DEBUG hyper::proto::h1::conn: incoming body completed
2024-05-21T16:59:39.3066840Z 2024-05-21T16:58:40.082137Z DEBUG pkarr_publish{me=wp3g26raw2ercopv}: hyper::client::pool: pooling idle connection for ("https", dns.iroh.link)
2024-05-21T16:59:39.3068350Z 2024-05-21T16:58:40.082225Z  WARN pkarr_publish{me=wp3g26raw2ercopv}: iroh_net::discovery::pkarr_publish: Failed to publish to pkarr err=Publish request failed with status 429 Too Many Requests
2024-05-21T16:59:39.3143060Z 2024-05-21T16:58:42.083395Z DEBUG pkarr_publish{me=nkpqjtgrfsdzojzk}: iroh_net::discovery::pkarr_publish: Publish node info to pkarr (interval elapsed)
2024-05-21T16:59:39.3144500Z 2024-05-21T16:58:42.083429Z  INFO pkarr_publish{me=nkpqjtgrfsdzojzk}: iroh_net::discovery::pkarr_publish: Publish node info to pkarr relay_url=None
2024-05-21T16:59:39.3145870Z 2024-05-21T16:58:42.083842Z DEBUG pkarr_publish{me=nkpqjtgrfsdzojzk}: hyper::client::pool: reuse idle connection for ("https", dns.iroh.link)
2024-05-21T16:59:39.3147190Z 2024-05-21T16:58:42.083885Z DEBUG pkarr_publish{me=wp3g26raw2ercopv}: iroh_net::discovery::pkarr_publish: Publish node info to pkarr (interval elapsed)
2024-05-21T16:59:39.3148580Z 2024-05-21T16:58:42.083897Z  INFO pkarr_publish{me=wp3g26raw2ercopv}: iroh_net::discovery::pkarr_publish: Publish node info to pkarr relay_url=None
2024-05-21T16:59:39.3149930Z 2024-05-21T16:58:42.084198Z DEBUG pkarr_publish{me=wp3g26raw2ercopv}: hyper::client::pool: reuse idle connection for ("https", dns.iroh.link)
2024-05-21T16:59:39.3150920Z 2024-05-21T16:58:42.084316Z DEBUG hyper::proto::h1::io: flushed 214 bytes
2024-05-21T16:59:39.3151580Z 2024-05-21T16:58:42.084353Z DEBUG hyper::proto::h1::io: flushed 214 bytes
2024-05-21T16:59:39.3152250Z 2024-05-21T16:58:42.088339Z DEBUG hyper::proto::h1::io: parsed 3 headers
2024-05-21T16:59:39.3152930Z 2024-05-21T16:58:42.088348Z DEBUG hyper::proto::h1::conn: incoming body is empty
2024-05-21T16:59:39.3153960Z 2024-05-21T16:58:42.088392Z DEBUG pkarr_publish{me=nkpqjtgrfsdzojzk}: hyper::client::pool: pooling idle connection for ("https", dns.iroh.link)
2024-05-21T16:59:39.3154910Z 2024-05-21T16:58:42.088470Z DEBUG hyper::proto::h1::io: parsed 5 headers
2024-05-21T16:59:39.3155660Z 2024-05-21T16:58:42.088478Z DEBUG hyper::proto::h1::conn: incoming body is content-length (30 bytes)
2024-05-21T16:59:39.3156430Z 2024-05-21T16:58:42.088491Z DEBUG hyper::proto::h1::conn: incoming body completed
2024-05-21T16:59:39.3157460Z 2024-05-21T16:58:42.088544Z DEBUG pkarr_publish{me=wp3g26raw2ercopv}: hyper::client::pool: pooling idle connection for ("https", dns.iroh.link)
2024-05-21T16:59:39.3158990Z 2024-05-21T16:58:42.088645Z  WARN pkarr_publish{me=wp3g26raw2ercopv}: iroh_net::discovery::pkarr_publish: Failed to publish to pkarr err=Publish request failed with status 429 Too Many Requests
2024-05-21T16:59:39.3232000Z 2024-05-21T16:58:43.931595Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:stayin_alive{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:58263 since_last_ping=Some(4.986962583s)
2024-05-21T16:59:39.3234610Z 2024-05-21T16:58:43.931784Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:58263) tx=bcd572b6b1ce9ac543215d9f purpose=StayinAlive
2024-05-21T16:59:39.3237220Z 2024-05-21T16:58:43.931859Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:stayin_alive{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:51664 since_last_ping=Some(4.990262s)
2024-05-21T16:59:39.3239800Z 2024-05-21T16:58:43.931957Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:51664) tx=fb00d9f28afb85723795c655 purpose=StayinAlive
2024-05-21T16:59:39.3242690Z 2024-05-21T16:58:43.932141Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=LikelyHeartbeat needs_ping_back=false paths=[167.235.14.200:51664{ active pong-received(4.880615208s ago) ping-received(8.042µs ago) ping-sent(162.375µs ago) }]
2024-05-21T16:59:39.3245500Z 2024-05-21T16:58:43.932161Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock: sending pong tx=bcd572b6b1ce9ac543215d9f addr=UDP(167.235.14.200:51664) dstkey=nkpqjtgrfsdzojzk
2024-05-21T16:59:39.3248320Z 2024-05-21T16:58:43.932247Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=LikelyHeartbeat needs_ping_back=false paths=[167.235.14.200:58263{ active pong-received(4.873576s ago) ping-received(3.709µs ago) ping-sent(436.584µs ago) }]
2024-05-21T16:59:39.3253670Z 2024-05-21T16:58:43.932266Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock: sending pong tx=fb00d9f28afb85723795c655 addr=UDP(167.235.14.200:58263) dstkey=wp3g26raw2ercopv
2024-05-21T16:59:39.3257280Z 2024-05-21T16:58:43.932499Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0xBCD572B6B1CE9AC543215D9F), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: received pong tx=bcd572b6b1ce9ac543215d9f src=UDP(167.235.14.200:58263) reported_ping_src=UDP(167.235.14.200:51664) ping_dst=UDP(167.235.14.200:58263) is_relay=false latency=0
2024-05-21T16:59:39.3261500Z 2024-05-21T16:58:43.932531Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0xBCD572B6B1CE9AC543215D9F), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:58263{ active pong-received(31.291µs ago) ping-received(287.334µs ago) ping-sent(720.25µs ago) }]
2024-05-21T16:59:39.3265740Z 2024-05-21T16:58:43.932655Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0xFB00D9F28AFB85723795C655), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: received pong tx=fb00d9f28afb85723795c655 src=UDP(167.235.14.200:51664) reported_ping_src=UDP(167.235.14.200:58263) ping_dst=UDP(167.235.14.200:51664) is_relay=false latency=0
2024-05-21T16:59:39.3270040Z 2024-05-21T16:58:43.932681Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0xFB00D9F28AFB85723795C655), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:51664{ active pong-received(24.791µs ago) ping-received(548.833µs ago) ping-sent(703.125µs ago) }]
2024-05-21T16:59:39.3272590Z 2024-05-21T16:58:45.089892Z DEBUG pkarr_publish{me=wp3g26raw2ercopv}: iroh_net::discovery::pkarr_publish: Publish node info to pkarr (interval elapsed)
2024-05-21T16:59:39.3273990Z 2024-05-21T16:58:45.089925Z  INFO pkarr_publish{me=wp3g26raw2ercopv}: iroh_net::discovery::pkarr_publish: Publish node info to pkarr relay_url=None
2024-05-21T16:59:39.3275390Z 2024-05-21T16:58:45.090335Z DEBUG pkarr_publish{me=wp3g26raw2ercopv}: hyper::client::pool: reuse idle connection for ("https", dns.iroh.link)
2024-05-21T16:59:39.3276340Z 2024-05-21T16:58:45.090467Z DEBUG hyper::proto::h1::io: flushed 214 bytes
2024-05-21T16:59:39.3277010Z 2024-05-21T16:58:45.094421Z DEBUG hyper::proto::h1::io: parsed 3 headers
2024-05-21T16:59:39.3277690Z 2024-05-21T16:58:45.094430Z DEBUG hyper::proto::h1::conn: incoming body is empty
2024-05-21T16:59:39.3278720Z 2024-05-21T16:58:45.094471Z DEBUG pkarr_publish{me=wp3g26raw2ercopv}: hyper::client::pool: pooling idle connection for ("https", dns.iroh.link)
2024-05-21T16:59:39.3280790Z 2024-05-21T16:58:48.932101Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:stayin_alive{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:58263 since_last_ping=Some(5.000440667s)
2024-05-21T16:59:39.3283390Z 2024-05-21T16:58:48.932310Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:58263) tx=5b994156cc5bbd48a3e4be12 purpose=StayinAlive
2024-05-21T16:59:39.3286010Z 2024-05-21T16:58:48.932385Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:stayin_alive{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:51664 since_last_ping=Some(5.000574334s)
2024-05-21T16:59:39.3288590Z 2024-05-21T16:58:48.932485Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:51664) tx=401d1ff01838790143a3203a purpose=StayinAlive
2024-05-21T16:59:39.3291440Z 2024-05-21T16:58:48.932665Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=Reactivate needs_ping_back=false paths=[167.235.14.200:51664{ active pong-received(5.00018125s ago) ping-received(9.041µs ago) ping-sent(156.5µs ago) }]
2024-05-21T16:59:39.3294140Z 2024-05-21T16:58:48.932684Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock: received ping: path active src=Udp(167.235.14.200:51664) tx=5b994156cc5bbd48a3e4be12
2024-05-21T16:59:39.3296590Z 2024-05-21T16:58:48.932701Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock: sending pong tx=5b994156cc5bbd48a3e4be12 addr=UDP(167.235.14.200:51664) dstkey=nkpqjtgrfsdzojzk
2024-05-21T16:59:39.3299420Z 2024-05-21T16:58:48.932792Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=Reactivate needs_ping_back=false paths=[167.235.14.200:58263{ active pong-received(5.000465541s ago) ping-received(3.958µs ago) ping-sent(453.917µs ago) }]
2024-05-21T16:59:39.3302130Z 2024-05-21T16:58:48.932809Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock: received ping: path active src=Udp(167.235.14.200:58263) tx=401d1ff01838790143a3203a
2024-05-21T16:59:39.3303410Z 2024-05-21T16:58:48.932825Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock: sending pong tx=401d1ff01838790143a3203a addr=UDP(167.235.14.200:58263) dstkey=wp3g26raw2ercopv
2024-05-21T16:59:39.3305830Z 2024-05-21T16:58:48.933065Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0x5B994156CC5BBD48A3E4BE12), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: received pong tx=5b994156cc5bbd48a3e4be12 src=UDP(167.235.14.200:58263) reported_ping_src=UDP(167.235.14.200:51664) ping_dst=UDP(167.235.14.200:58263) is_relay=false latency=0
2024-05-21T16:59:39.3308040Z 2024-05-21T16:58:48.933094Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0x5B994156CC5BBD48A3E4BE12), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:58263{ active pong-received(29.25µs ago) ping-received(306.667µs ago) ping-sent(756.584µs ago) }]
2024-05-21T16:59:39.3310460Z 2024-05-21T16:58:48.933220Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0x401D1FF01838790143A3203A), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: received pong tx=401d1ff01838790143a3203a src=UDP(167.235.14.200:51664) reported_ping_src=UDP(167.235.14.200:58263) ping_dst=UDP(167.235.14.200:51664) is_relay=false latency=0
2024-05-21T16:59:39.3312560Z 2024-05-21T16:58:48.933246Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0x401D1FF01838790143A3203A), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:51664{ active pong-received(25.875µs ago) ping-received(591µs ago) ping-sent(738.333µs ago) }]
2024-05-21T16:59:39.3314000Z 2024-05-21T16:58:53.931318Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:stayin_alive{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:58263 since_last_ping=Some(4.999034667s)
2024-05-21T16:59:39.3315310Z 2024-05-21T16:58:53.932499Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:58263) tx=9079e703bcda1f30b030c992 purpose=StayinAlive
2024-05-21T16:59:39.3316740Z 2024-05-21T16:58:53.932983Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:stayin_alive{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:51664 since_last_ping=Some(5.000604625s)
2024-05-21T16:59:39.3318040Z 2024-05-21T16:58:53.933900Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:51664) tx=5c300549a4a1892f528bb631 purpose=StayinAlive
2024-05-21T16:59:39.3319720Z 2024-05-21T16:58:53.935012Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=Reactivate needs_ping_back=false paths=[167.235.14.200:51664{ active pong-received(5.001945875s ago) ping-received(45.958µs ago) ping-sent(974.375µs ago) }]
2024-05-21T16:59:39.3320950Z 2024-05-21T16:58:53.935161Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock: received ping: path active src=Udp(167.235.14.200:51664) tx=9079e703bcda1f30b030c992
2024-05-21T16:59:39.3322250Z 2024-05-21T16:58:53.935311Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock: sending pong tx=9079e703bcda1f30b030c992 addr=UDP(167.235.14.200:51664) dstkey=nkpqjtgrfsdzojzk
2024-05-21T16:59:39.3324080Z 2024-05-21T16:58:53.935924Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=Reactivate needs_ping_back=false paths=[167.235.14.200:58263{ active pong-received(5.00301775s ago) ping-received(20.083µs ago) ping-sent(3.219958ms ago) }]
2024-05-21T16:59:39.3325300Z 2024-05-21T16:58:53.936031Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock: received ping: path active src=Udp(167.235.14.200:58263) tx=5c300549a4a1892f528bb631
2024-05-21T16:59:39.3326590Z 2024-05-21T16:58:53.936141Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock: sending pong tx=5c300549a4a1892f528bb631 addr=UDP(167.235.14.200:58263) dstkey=wp3g26raw2ercopv
2024-05-21T16:59:39.3329010Z 2024-05-21T16:58:53.937518Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0x9079E703BCDA1F30B030C992), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: received pong tx=9079e703bcda1f30b030c992 src=UDP(167.235.14.200:58263) reported_ping_src=UDP(167.235.14.200:51664) ping_dst=UDP(167.235.14.200:58263) is_relay=false latency=4
2024-05-21T16:59:39.3331280Z 2024-05-21T16:58:53.937701Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0x9079E703BCDA1F30B030C992), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:58263{ active pong-received(183.334µs ago) ping-received(1.80125ms ago) ping-sent(5.000041ms ago) }]
2024-05-21T16:59:39.3333700Z 2024-05-21T16:58:53.938366Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0x5C300549A4A1892F528BB631), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: received pong tx=5c300549a4a1892f528bb631 src=UDP(167.235.14.200:51664) reported_ping_src=UDP(167.235.14.200:58263) ping_dst=UDP(167.235.14.200:51664) is_relay=false latency=4
2024-05-21T16:59:39.3335840Z 2024-05-21T16:58:53.938492Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0x5C300549A4A1892F528BB631), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:51664{ active pong-received(122.667µs ago) ping-received(3.532875ms ago) ping-sent(4.459875ms ago) }]
2024-05-21T16:59:39.3337280Z 2024-05-21T16:58:58.932256Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:stayin_alive{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:58263 since_last_ping=Some(4.999597166s)
2024-05-21T16:59:39.3338590Z 2024-05-21T16:58:58.933536Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:58263) tx=a9f92d038565fe537db9656e purpose=StayinAlive
2024-05-21T16:59:39.3340020Z 2024-05-21T16:58:58.934043Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:stayin_alive{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:51664 since_last_ping=Some(5.00012675s)
2024-05-21T16:59:39.3341320Z 2024-05-21T16:58:58.934793Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:51664) tx=3603e96c7a01e41493749db3 purpose=StayinAlive
2024-05-21T16:59:39.3343010Z 2024-05-21T16:58:58.935927Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=Reactivate needs_ping_back=false paths=[167.235.14.200:51664{ active pong-received(4.997721375s ago) ping-received(47.834µs ago) ping-sent(979.042µs ago) }]
2024-05-21T16:59:39.3344240Z 2024-05-21T16:58:58.936118Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock: received ping: path active src=Udp(167.235.14.200:51664) tx=a9f92d038565fe537db9656e
2024-05-21T16:59:39.3345530Z 2024-05-21T16:58:58.936261Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock: sending pong tx=a9f92d038565fe537db9656e addr=UDP(167.235.14.200:51664) dstkey=nkpqjtgrfsdzojzk
2024-05-21T16:59:39.3347230Z 2024-05-21T16:58:58.936930Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=Reactivate needs_ping_back=false paths=[167.235.14.200:58263{ active pong-received(4.999580959s ago) ping-received(20.209µs ago) ping-sent(3.188666ms ago) }]
2024-05-21T16:59:39.3348450Z 2024-05-21T16:58:58.937037Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock: received ping: path active src=Udp(167.235.14.200:58263) tx=3603e96c7a01e41493749db3
2024-05-21T16:59:39.3349740Z 2024-05-21T16:58:58.937148Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock: sending pong tx=3603e96c7a01e41493749db3 addr=UDP(167.235.14.200:58263) dstkey=wp3g26raw2ercopv
2024-05-21T16:59:39.3352150Z 2024-05-21T16:58:58.938811Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0xA9F92D038565FE537DB9656E), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: received pong tx=a9f92d038565fe537db9656e src=UDP(167.235.14.200:58263) reported_ping_src=UDP(167.235.14.200:51664) ping_dst=UDP(167.235.14.200:58263) is_relay=false latency=5
2024-05-21T16:59:39.3354280Z 2024-05-21T16:58:58.939070Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0xA9F92D038565FE537DB9656E), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:58263{ active pong-received(259.083µs ago) ping-received(2.159709ms ago) ping-sent(5.328333ms ago) }]
2024-05-21T16:59:39.3356700Z 2024-05-21T16:58:58.939964Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0x3603E96C7A01E41493749DB3), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: received pong tx=3603e96c7a01e41493749db3 src=UDP(167.235.14.200:51664) reported_ping_src=UDP(167.235.14.200:58263) ping_dst=UDP(167.235.14.200:51664) is_relay=false latency=5
2024-05-21T16:59:39.3358790Z 2024-05-21T16:58:58.940135Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0x3603E96C7A01E41493749DB3), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:51664{ active pong-received(167.291µs ago) ping-received(4.260834ms ago) ping-sent(5.191875ms ago) }]
2024-05-21T16:59:39.3359870Z 2024-05-21T16:58:59.651119Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:re_stun{me=nkpqjtgrfsdzojzk}: iroh_net::magicsock: re_stun: periodic
2024-05-21T16:59:39.3360860Z 2024-05-21T16:58:59.651276Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:update_endpoints: iroh_net::magicsock: starting endpoint update (periodic)
2024-05-21T16:59:39.3361920Z 2024-05-21T16:58:59.651345Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:update_endpoints:update_net_info: iroh_net::magicsock: skipping netcheck, empty RelayMap
2024-05-21T16:59:39.3362810Z 2024-05-21T16:58:59.659994Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor: iroh_net::magicsock: scheduling periodic_stun to run in 20s
2024-05-21T16:59:39.3363680Z 2024-05-21T16:58:59.660114Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor: iroh_net::magicsock: endpoint update done (periodic)
2024-05-21T16:59:39.3364670Z 2024-05-21T16:58:59.660959Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:portmapper.service: iroh_net::portmapper: getting a port mapping for 167.235.14.200:51664 -> None
2024-05-21T16:59:39.3365860Z 2024-05-21T16:58:59.661224Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:portmapper.service:upnp: igd_next::aio::tokio: sending broadcast request to: 239.255.255.250:1900 on interface: Ok(0.0.0.0:56134)    
2024-05-21T16:59:39.3366860Z 2024-05-21T16:59:00.665636Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:portmapper.service: iroh_net::portmapper: failed to get a port mapping IO error: search timed out
2024-05-21T16:59:39.3367930Z 2024-05-21T16:59:02.930128Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:re_stun{me=wp3g26raw2ercopv}: iroh_net::magicsock: re_stun: periodic
2024-05-21T16:59:39.3368900Z 2024-05-21T16:59:02.930480Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:update_endpoints: iroh_net::magicsock: starting endpoint update (periodic)
2024-05-21T16:59:39.3370070Z 2024-05-21T16:59:02.930683Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:update_endpoints:update_net_info: iroh_net::magicsock: skipping netcheck, empty RelayMap
2024-05-21T16:59:39.3370960Z 2024-05-21T16:59:02.945709Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor: iroh_net::magicsock: scheduling periodic_stun to run in 21s
2024-05-21T16:59:39.3371830Z 2024-05-21T16:59:02.945810Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor: iroh_net::magicsock: endpoint update done (periodic)
2024-05-21T16:59:39.3372810Z 2024-05-21T16:59:02.946960Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:portmapper.service: iroh_net::portmapper: getting a port mapping for 167.235.14.200:58263 -> None
2024-05-21T16:59:39.3374010Z 2024-05-21T16:59:02.947248Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:portmapper.service:upnp: igd_next::aio::tokio: sending broadcast request to: 239.255.255.250:1900 on interface: Ok(0.0.0.0:64583)    
2024-05-21T16:59:39.3375620Z 2024-05-21T16:59:03.931543Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:stayin_alive{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:58263 since_last_ping=Some(4.997838958s)
2024-05-21T16:59:39.3377030Z 2024-05-21T16:59:03.932812Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:58263) tx=0c0c7c24621a90cc062db0bd purpose=StayinAlive
2024-05-21T16:59:39.3378650Z 2024-05-21T16:59:03.933265Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:stayin_alive{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:51664 since_last_ping=Some(4.998457583s)
2024-05-21T16:59:39.3380070Z 2024-05-21T16:59:03.934026Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:51664) tx=0abb27c0b6e4bf26f8fafa05 purpose=StayinAlive
2024-05-21T16:59:39.3381950Z 2024-05-21T16:59:03.935124Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=LikelyHeartbeat needs_ping_back=false paths=[167.235.14.200:51664{ active pong-received(4.995323833s ago) ping-received(46.916µs ago) ping-sent(954.333µs ago) }]
2024-05-21T16:59:39.3383350Z 2024-05-21T16:59:03.935309Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock: sending pong tx=0c0c7c24621a90cc062db0bd addr=UDP(167.235.14.200:51664) dstkey=nkpqjtgrfsdzojzk
2024-05-21T16:59:39.3385170Z 2024-05-21T16:59:03.935953Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=LikelyHeartbeat needs_ping_back=false paths=[167.235.14.200:58263{ active pong-received(4.997315708s ago) ping-received(20.167µs ago) ping-sent(2.944708ms ago) }]
2024-05-21T16:59:39.3386500Z 2024-05-21T16:59:03.936072Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock: sending pong tx=0abb27c0b6e4bf26f8fafa05 addr=UDP(167.235.14.200:58263) dstkey=wp3g26raw2ercopv
2024-05-21T16:59:39.3388930Z 2024-05-21T16:59:03.937697Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0x0C0C7C24621A90CC062DB0BD), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: received pong tx=0c0c7c24621a90cc062db0bd src=UDP(167.235.14.200:58263) reported_ping_src=UDP(167.235.14.200:51664) ping_dst=UDP(167.235.14.200:58263) is_relay=false latency=4
2024-05-21T16:59:39.3391060Z 2024-05-21T16:59:03.937947Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0x0C0C7C24621A90CC062DB0BD), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:58263{ active pong-received(251.042µs ago) ping-received(2.014667ms ago) ping-sent(4.939291ms ago) }]
2024-05-21T16:59:39.3393520Z 2024-05-21T16:59:03.938821Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0x0ABB27C0B6E4BF26F8FAFA05), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: received pong tx=0abb27c0b6e4bf26f8fafa05 src=UDP(167.235.14.200:51664) reported_ping_src=UDP(167.235.14.200:58263) ping_dst=UDP(167.235.14.200:51664) is_relay=false latency=4
2024-05-21T16:59:39.3395660Z 2024-05-21T16:59:03.938994Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0x0ABB27C0B6E4BF26F8FAFA05), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:51664{ active pong-received(168.667µs ago) ping-received(3.92125ms ago) ping-sent(4.828375ms ago) }]
2024-05-21T16:59:39.3396660Z 2024-05-21T16:59:03.950999Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:portmapper.service: iroh_net::portmapper: failed to get a port mapping IO error: search timed out
2024-05-21T16:59:39.3398090Z 2024-05-21T16:59:08.931955Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:stayin_alive{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:58263 since_last_ping=Some(4.999047125s)
2024-05-21T16:59:39.3399400Z 2024-05-21T16:59:08.932815Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:58263) tx=2039f5c5db9de229870b38d8 purpose=StayinAlive
2024-05-21T16:59:39.3400830Z 2024-05-21T16:59:08.933150Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:stayin_alive{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:51664 since_last_ping=Some(4.999131833s)
2024-05-21T16:59:39.3402180Z 2024-05-21T16:59:08.933650Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:51664) tx=d6b7c3f5deaf66613cb0b2e7 purpose=StayinAlive
2024-05-21T16:59:39.3403850Z 2024-05-21T16:59:08.934256Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=LikelyHeartbeat needs_ping_back=false paths=[167.235.14.200:51664{ active pong-received(4.995607917s ago) ping-received(30.125µs ago) ping-sent(526.042µs ago) }]
2024-05-21T16:59:39.3405180Z 2024-05-21T16:59:08.934339Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock: sending pong tx=2039f5c5db9de229870b38d8 addr=UDP(167.235.14.200:51664) dstkey=nkpqjtgrfsdzojzk
2024-05-21T16:59:39.3406840Z 2024-05-21T16:59:08.934662Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=LikelyHeartbeat needs_ping_back=false paths=[167.235.14.200:58263{ active pong-received(4.997146459s ago) ping-received(11.834µs ago) ping-sent(1.723125ms ago) }]
2024-05-21T16:59:39.3408150Z 2024-05-21T16:59:08.934731Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock: sending pong tx=d6b7c3f5deaf66613cb0b2e7 addr=UDP(167.235.14.200:58263) dstkey=wp3g26raw2ercopv
2024-05-21T16:59:39.3410560Z 2024-05-21T16:59:08.935648Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0x2039F5C5DB9DE229870B38D8), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: received pong tx=2039f5c5db9de229870b38d8 src=UDP(167.235.14.200:58263) reported_ping_src=UDP(167.235.14.200:51664) ping_dst=UDP(167.235.14.200:58263) is_relay=false latency=2
2024-05-21T16:59:39.3412650Z 2024-05-21T16:59:08.935762Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0x2039F5C5DB9DE229870B38D8), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:58263{ active pong-received(115.917µs ago) ping-received(1.113042ms ago) ping-sent(2.824416ms ago) }]
2024-05-21T16:59:39.3415100Z 2024-05-21T16:59:08.936231Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0xD6B7C3F5DEAF66613CB0B2E7), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: received pong tx=d6b7c3f5deaf66613cb0b2e7 src=UDP(167.235.14.200:51664) reported_ping_src=UDP(167.235.14.200:58263) ping_dst=UDP(167.235.14.200:51664) is_relay=false latency=2
2024-05-21T16:59:39.3417190Z 2024-05-21T16:59:08.936336Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0xD6B7C3F5DEAF66613CB0B2E7), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:51664{ active pong-received(102.667µs ago) ping-received(2.112375ms ago) ping-sent(2.608ms ago) }]
2024-05-21T16:59:39.3418720Z 2024-05-21T16:59:13.931820Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:stayin_alive{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:58263 since_last_ping=Some(4.998923458s)
2024-05-21T16:59:39.3420030Z 2024-05-21T16:59:13.933133Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:58263) tx=fc7d49f67970f1fca1e8a840 purpose=StayinAlive
2024-05-21T16:59:39.3421460Z 2024-05-21T16:59:13.933589Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:stayin_alive{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:51664 since_last_ping=Some(4.999993667s)
2024-05-21T16:59:39.3422770Z 2024-05-21T16:59:13.934325Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:51664) tx=07127a4e1a98a860292cd1c7 purpose=StayinAlive
2024-05-21T16:59:39.3424410Z 2024-05-21T16:59:13.935423Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=Reactivate needs_ping_back=false paths=[167.235.14.200:51664{ active pong-received(4.999351s ago) ping-received(46.125µs ago) ping-sent(960.459µs ago) }]
2024-05-21T16:59:39.3425700Z 2024-05-21T16:59:13.935598Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock: received ping: path active src=Udp(167.235.14.200:51664) tx=fc7d49f67970f1fca1e8a840
2024-05-21T16:59:39.3426990Z 2024-05-21T16:59:13.935737Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock: sending pong tx=fc7d49f67970f1fca1e8a840 addr=UDP(167.235.14.200:51664) dstkey=nkpqjtgrfsdzojzk
2024-05-21T16:59:39.3428640Z 2024-05-21T16:59:13.936369Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=Reactivate needs_ping_back=false paths=[167.235.14.200:58263{ active pong-received(5.000888375s ago) ping-received(19.959µs ago) ping-sent(3.050334ms ago) }]
2024-05-21T16:59:39.3429910Z 2024-05-21T16:59:13.936475Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock: received ping: path active src=Udp(167.235.14.200:58263) tx=07127a4e1a98a860292cd1c7
2024-05-21T16:59:39.3431200Z 2024-05-21T16:59:13.936584Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock: sending pong tx=07127a4e1a98a860292cd1c7 addr=UDP(167.235.14.200:58263) dstkey=wp3g26raw2ercopv
2024-05-21T16:59:39.3433620Z 2024-05-21T16:59:13.938218Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0xFC7D49F67970F1FCA1E8A840), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: received pong tx=fc7d49f67970f1fca1e8a840 src=UDP(167.235.14.200:58263) reported_ping_src=UDP(167.235.14.200:51664) ping_dst=UDP(167.235.14.200:58263) is_relay=false latency=4
2024-05-21T16:59:39.3435700Z 2024-05-21T16:59:13.938486Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0xFC7D49F67970F1FCA1E8A840), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:58263{ active pong-received(268µs ago) ping-received(2.136042ms ago) ping-sent(5.166584ms ago) }]
2024-05-21T16:59:39.3438150Z 2024-05-21T16:59:13.939371Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0x07127A4E1A98A860292CD1C7), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: received pong tx=07127a4e1a98a860292cd1c7 src=UDP(167.235.14.200:51664) reported_ping_src=UDP(167.235.14.200:58263) ping_dst=UDP(167.235.14.200:51664) is_relay=false latency=4
2024-05-21T16:59:39.3440260Z 2024-05-21T16:59:13.939542Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0x07127A4E1A98A860292CD1C7), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:51664{ active pong-received(166.75µs ago) ping-received(4.169833ms ago) ping-sent(5.084ms ago) }]
2024-05-21T16:59:39.3441740Z 2024-05-21T16:59:18.931350Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:stayin_alive{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:58263 since_last_ping=Some(4.9980745s)
2024-05-21T16:59:39.3443050Z 2024-05-21T16:59:18.932599Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:58263) tx=9d0d065f2d94c418ab209b89 purpose=StayinAlive
2024-05-21T16:59:39.3444480Z 2024-05-21T16:59:18.933049Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:stayin_alive{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:51664 since_last_ping=Some(4.998726292s)
2024-05-21T16:59:39.3445780Z 2024-05-21T16:59:18.933827Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:51664) tx=2d0c654d64373ecb26286c3d purpose=StayinAlive
2024-05-21T16:59:39.3447450Z 2024-05-21T16:59:18.934915Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=LikelyHeartbeat needs_ping_back=false paths=[167.235.14.200:51664{ active pong-received(4.995707042s ago) ping-received(47.792µs ago) ping-sent(944.625µs ago) }]
2024-05-21T16:59:39.3448780Z 2024-05-21T16:59:18.935097Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock: sending pong tx=9d0d065f2d94c418ab209b89 addr=UDP(167.235.14.200:51664) dstkey=nkpqjtgrfsdzojzk
2024-05-21T16:59:39.3450460Z 2024-05-21T16:59:18.935698Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=LikelyHeartbeat needs_ping_back=false paths=[167.235.14.200:58263{ active pong-received(4.997653375s ago) ping-received(20.125µs ago) ping-sent(2.906208ms ago) }]
2024-05-21T16:59:39.3451750Z 2024-05-21T16:59:18.935816Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock: sending pong tx=2d0c654d64373ecb26286c3d addr=UDP(167.235.14.200:58263) dstkey=wp3g26raw2ercopv
2024-05-21T16:59:39.3454200Z 2024-05-21T16:59:18.937477Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0x9D0D065F2D94C418AB209B89), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: received pong tx=9d0d065f2d94c418ab209b89 src=UDP(167.235.14.200:58263) reported_ping_src=UDP(167.235.14.200:51664) ping_dst=UDP(167.235.14.200:58263) is_relay=false latency=4
2024-05-21T16:59:39.3456280Z 2024-05-21T16:59:18.937704Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0x9D0D065F2D94C418AB209B89), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:58263{ active pong-received(227.917µs ago) ping-received(2.02675ms ago) ping-sent(4.913ms ago) }]
2024-05-21T16:59:39.3458690Z 2024-05-21T16:59:18.938586Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0x2D0C654D64373ECB26286C3D), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: received pong tx=2d0c654d64373ecb26286c3d src=UDP(167.235.14.200:51664) reported_ping_src=UDP(167.235.14.200:58263) ping_dst=UDP(167.235.14.200:51664) is_relay=false latency=4
2024-05-21T16:59:39.3460810Z 2024-05-21T16:59:18.938760Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0x2D0C654D64373ECB26286C3D), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:51664{ active pong-received(170.208µs ago) ping-received(3.898792ms ago) ping-sent(4.793834ms ago) }]
2024-05-21T16:59:39.3461860Z 2024-05-21T16:59:19.982275Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:re_stun{me=nkpqjtgrfsdzojzk}: iroh_net::magicsock: re_stun: periodic
2024-05-21T16:59:39.3462840Z 2024-05-21T16:59:19.982607Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:update_endpoints: iroh_net::magicsock: starting endpoint update (periodic)
2024-05-21T16:59:39.3464000Z 2024-05-21T16:59:19.982800Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:update_endpoints:update_net_info: iroh_net::magicsock: skipping netcheck, empty RelayMap
2024-05-21T16:59:39.3464890Z 2024-05-21T16:59:19.999440Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor: iroh_net::magicsock: scheduling periodic_stun to run in 23s
2024-05-21T16:59:39.3465760Z 2024-05-21T16:59:19.999601Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor: iroh_net::magicsock: endpoint update done (periodic)
2024-05-21T16:59:39.3466750Z 2024-05-21T16:59:20.000772Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:portmapper.service: iroh_net::portmapper: getting a port mapping for 167.235.14.200:51664 -> None
2024-05-21T16:59:39.3467900Z 2024-05-21T16:59:20.001120Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:portmapper.service:upnp: igd_next::aio::tokio: sending broadcast request to: 239.255.255.250:1900 on interface: Ok(0.0.0.0:53633)    
2024-05-21T16:59:39.3468890Z 2024-05-21T16:59:21.004165Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:portmapper.service: iroh_net::portmapper: failed to get a port mapping IO error: search timed out
2024-05-21T16:59:39.3470320Z 2024-05-21T16:59:23.931738Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:stayin_alive{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:58263 since_last_ping=Some(4.999006041s)
2024-05-21T16:59:39.3471700Z 2024-05-21T16:59:23.933031Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:58263) tx=afacf81d1137ecc68c1b314c purpose=StayinAlive
2024-05-21T16:59:39.3473130Z 2024-05-21T16:59:23.933503Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:stayin_alive{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:51664 since_last_ping=Some(4.999664167s)
2024-05-21T16:59:39.3474440Z 2024-05-21T16:59:23.934227Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:51664) tx=f950a46ef919914a0f488e41 purpose=StayinAlive
2024-05-21T16:59:39.3476180Z 2024-05-21T16:59:23.935291Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=Reactivate needs_ping_back=false paths=[167.235.14.200:51664{ active pong-received(4.996868375s ago) ping-received(46.458µs ago) ping-sent(926.542µs ago) }]
2024-05-21T16:59:39.3477410Z 2024-05-21T16:59:23.935459Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock: received ping: path active src=Udp(167.235.14.200:51664) tx=afacf81d1137ecc68c1b314c
2024-05-21T16:59:39.3478720Z 2024-05-21T16:59:23.935589Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock: sending pong tx=afacf81d1137ecc68c1b314c addr=UDP(167.235.14.200:51664) dstkey=nkpqjtgrfsdzojzk
2024-05-21T16:59:39.3480370Z 2024-05-21T16:59:23.936196Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=Reactivate needs_ping_back=false paths=[167.235.14.200:58263{ active pong-received(4.9988925s ago) ping-received(30.959µs ago) ping-sent(2.963083ms ago) }]
2024-05-21T16:59:39.3481590Z 2024-05-21T16:59:23.936302Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock: received ping: path active src=Udp(167.235.14.200:58263) tx=f950a46ef919914a0f488e41
2024-05-21T16:59:39.3482880Z 2024-05-21T16:59:23.936412Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock: sending pong tx=f950a46ef919914a0f488e41 addr=UDP(167.235.14.200:58263) dstkey=wp3g26raw2ercopv
2024-05-21T16:59:39.3485370Z 2024-05-21T16:59:23.938137Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0xAFACF81D1137ECC68C1B314C), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: received pong tx=afacf81d1137ecc68c1b314c src=UDP(167.235.14.200:58263) reported_ping_src=UDP(167.235.14.200:51664) ping_dst=UDP(167.235.14.200:58263) is_relay=false latency=4
2024-05-21T16:59:39.3487500Z 2024-05-21T16:59:23.938385Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0xAFACF81D1137ECC68C1B314C), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:58263{ active pong-received(247.292µs ago) ping-received(2.219875ms ago) ping-sent(5.152208ms ago) }]
2024-05-21T16:59:39.3489960Z 2024-05-21T16:59:23.939287Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0xF950A46EF919914A0F488E41), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: received pong tx=f950a46ef919914a0f488e41 src=UDP(167.235.14.200:51664) reported_ping_src=UDP(167.235.14.200:58263) ping_dst=UDP(167.235.14.200:51664) is_relay=false latency=4
2024-05-21T16:59:39.3492050Z 2024-05-21T16:59:23.939460Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0xF950A46EF919914A0F488E41), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:51664{ active pong-received(169.416µs ago) ping-received(4.221583ms ago) ping-sent(5.100917ms ago) }]
2024-05-21T16:59:39.3493100Z 2024-05-21T16:59:24.059541Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:re_stun{me=wp3g26raw2ercopv}: iroh_net::magicsock: re_stun: periodic
2024-05-21T16:59:39.3494080Z 2024-05-21T16:59:24.059745Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:update_endpoints: iroh_net::magicsock: starting endpoint update (periodic)
2024-05-21T16:59:39.3495190Z 2024-05-21T16:59:24.059931Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:update_endpoints:update_net_info: iroh_net::magicsock: skipping netcheck, empty RelayMap
2024-05-21T16:59:39.3498560Z 2024-05-21T16:59:24.075925Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor: iroh_net::magicsock: scheduling periodic_stun to run in 25s
2024-05-21T16:59:39.3499440Z 2024-05-21T16:59:24.076079Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor: iroh_net::magicsock: endpoint update done (periodic)
2024-05-21T16:59:39.3500440Z 2024-05-21T16:59:24.077496Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:portmapper.service: iroh_net::portmapper: getting a port mapping for 167.235.14.200:58263 -> None
2024-05-21T16:59:39.3501660Z 2024-05-21T16:59:24.077901Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:portmapper.service:upnp: igd_next::aio::tokio: sending broadcast request to: 239.255.255.250:1900 on interface: Ok(0.0.0.0:50229)    
2024-05-21T16:59:39.3502660Z 2024-05-21T16:59:25.082306Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:portmapper.service: iroh_net::portmapper: failed to get a port mapping IO error: search timed out
2024-05-21T16:59:39.3504090Z 2024-05-21T16:59:28.930978Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:stayin_alive{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:58263 since_last_ping=Some(4.997793542s)
2024-05-21T16:59:39.3505400Z 2024-05-21T16:59:28.932224Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:58263) tx=bd544bd83c81ac720cbada3d purpose=StayinAlive
2024-05-21T16:59:39.3506830Z 2024-05-21T16:59:28.932692Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:stayin_alive{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:51664 since_last_ping=Some(4.998467709s)
2024-05-21T16:59:39.3508140Z 2024-05-21T16:59:28.933409Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:51664) tx=9f7cc06d0e5ea0cdcb4f840c purpose=StayinAlive
2024-05-21T16:59:39.3509850Z 2024-05-21T16:59:28.934522Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=LikelyHeartbeat needs_ping_back=false paths=[167.235.14.200:51664{ active pong-received(4.995397833s ago) ping-received(47.875µs ago) ping-sent(970.625µs ago) }]
2024-05-21T16:59:39.3511150Z 2024-05-21T16:59:28.934694Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock: sending pong tx=bd544bd83c81ac720cbada3d addr=UDP(167.235.14.200:51664) dstkey=nkpqjtgrfsdzojzk
2024-05-21T16:59:39.3512820Z 2024-05-21T16:59:28.935334Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=LikelyHeartbeat needs_ping_back=false paths=[167.235.14.200:58263{ active pong-received(4.997369833s ago) ping-received(31.125µs ago) ping-sent(2.906542ms ago) }]
2024-05-21T16:59:39.3514300Z 2024-05-21T16:59:28.935452Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock: sending pong tx=9f7cc06d0e5ea0cdcb4f840c addr=UDP(167.235.14.200:58263) dstkey=wp3g26raw2ercopv
2024-05-21T16:59:39.3516730Z 2024-05-21T16:59:28.937119Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0xBD544BD83C81AC720CBADA3D), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: received pong tx=bd544bd83c81ac720cbada3d src=UDP(167.235.14.200:58263) reported_ping_src=UDP(167.235.14.200:51664) ping_dst=UDP(167.235.14.200:58263) is_relay=false latency=4
2024-05-21T16:59:39.3518830Z 2024-05-21T16:59:28.937373Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0xBD544BD83C81AC720CBADA3D), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:58263{ active pong-received(256.083µs ago) ping-received(2.071041ms ago) ping-sent(4.946375ms ago) }]
2024-05-21T16:59:39.3521400Z 2024-05-21T16:59:28.938261Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0x9F7CC06D0E5EA0CDCB4F840C), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: received pong tx=9f7cc06d0e5ea0cdcb4f840c src=UDP(167.235.14.200:51664) reported_ping_src=UDP(167.235.14.200:58263) ping_dst=UDP(167.235.14.200:51664) is_relay=false latency=4
2024-05-21T16:59:39.3523500Z 2024-05-21T16:59:28.938433Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0x9F7CC06D0E5EA0CDCB4F840C), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:51664{ active pong-received(167.583µs ago) ping-received(3.964125ms ago) ping-sent(4.885667ms ago) }]
2024-05-21T16:59:39.3524980Z 2024-05-21T16:59:33.930347Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:stayin_alive{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:58263 since_last_ping=Some(4.997967208s)
2024-05-21T16:59:39.3526290Z 2024-05-21T16:59:33.931630Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:58263) tx=a9e7ccbf6f795143f2ac6adc purpose=StayinAlive
2024-05-21T16:59:39.3527720Z 2024-05-21T16:59:33.932095Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:stayin_alive{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:51664 since_last_ping=Some(4.998684167s)
2024-05-21T16:59:39.3529030Z 2024-05-21T16:59:33.932861Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:51664) tx=4b06c35810c1a52a695778f4 purpose=StayinAlive
2024-05-21T16:59:39.3530700Z 2024-05-21T16:59:33.933952Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=LikelyHeartbeat needs_ping_back=false paths=[167.235.14.200:51664{ active pong-received(4.995853708s ago) ping-received(45.084µs ago) ping-sent(951.208µs ago) }]
2024-05-21T16:59:39.3531990Z 2024-05-21T16:59:33.934152Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock: sending pong tx=a9e7ccbf6f795143f2ac6adc addr=UDP(167.235.14.200:51664) dstkey=nkpqjtgrfsdzojzk
2024-05-21T16:59:39.3533730Z 2024-05-21T16:59:33.934798Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=LikelyHeartbeat needs_ping_back=false paths=[167.235.14.200:58263{ active pong-received(4.997854208s ago) ping-received(20.083µs ago) ping-sent(2.964208ms ago) }]
2024-05-21T16:59:39.3535200Z 2024-05-21T16:59:33.934918Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock: sending pong tx=4b06c35810c1a52a695778f4 addr=UDP(167.235.14.200:58263) dstkey=wp3g26raw2ercopv
2024-05-21T16:59:39.3537790Z 2024-05-21T16:59:33.936594Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0xA9E7CCBF6F795143F2AC6ADC), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: received pong tx=a9e7ccbf6f795143f2ac6adc src=UDP(167.235.14.200:58263) reported_ping_src=UDP(167.235.14.200:51664) ping_dst=UDP(167.235.14.200:58263) is_relay=false latency=4
2024-05-21T16:59:39.3539910Z 2024-05-21T16:59:33.936843Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0xA9E7CCBF6F795143F2AC6ADC), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:58263{ active pong-received(249.459µs ago) ping-received(2.065042ms ago) ping-sent(5.00925ms ago) }]
2024-05-21T16:59:39.3542350Z 2024-05-21T16:59:33.937501Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0x4B06C35810C1A52A695778F4), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: received pong tx=4b06c35810c1a52a695778f4 src=UDP(167.235.14.200:51664) reported_ping_src=UDP(167.235.14.200:58263) ping_dst=UDP(167.235.14.200:51664) is_relay=false latency=4
2024-05-21T16:59:39.3544440Z 2024-05-21T16:59:33.937627Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0x4B06C35810C1A52A695778F4), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:51664{ active pong-received(123.292µs ago) ping-received(3.72975ms ago) ping-sent(4.63275ms ago) }]
2024-05-21T16:59:39.3545950Z 2024-05-21T16:59:38.930496Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:stayin_alive{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:58263 since_last_ping=Some(4.998728s)
2024-05-21T16:59:39.3547280Z 2024-05-21T16:59:38.931827Z DEBUG magic_ep{me=nkpqjtgrfsdzojzk}:magicsock{me=nkpqjtgrfsdzojzk}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:58263) tx=a14f4853ddec196a51854774 purpose=StayinAlive
2024-05-21T16:59:39.3548720Z 2024-05-21T16:59:38.932319Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:stayin_alive{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: send stayin alive ping dst=167.235.14.200:51664 since_last_ping=Some(4.999443292s)
2024-05-21T16:59:39.3550070Z 2024-05-21T16:59:38.933073Z DEBUG magic_ep{me=wp3g26raw2ercopv}:magicsock{me=wp3g26raw2ercopv}:actor:handle_ping_action: iroh_net::magicsock: ping sent (polled) dst=UDP(167.235.14.200:51664) tx=bed91b85958491296023a4aa purpose=StayinAlive
2024-05-21T16:59:39.3551720Z 2024-05-21T16:59:38.934162Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=Reactivate needs_ping_back=false paths=[167.235.14.200:51664{ active pong-received(4.99681975s ago) ping-received(44.708µs ago) ping-sent(949.583µs ago) }]
2024-05-21T16:59:39.3552960Z 2024-05-21T16:59:38.934343Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock: received ping: path active src=Udp(167.235.14.200:51664) tx=a14f4853ddec196a51854774
2024-05-21T16:59:39.3554250Z 2024-05-21T16:59:38.934497Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}: iroh_net::magicsock: sending pong tx=a14f4853ddec196a51854774 addr=UDP(167.235.14.200:51664) dstkey=nkpqjtgrfsdzojzk
2024-05-21T16:59:39.3555910Z 2024-05-21T16:59:38.935105Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: endpoint handled ping role=Reactivate needs_ping_back=false paths=[167.235.14.200:58263{ active pong-received(4.998684667s ago) ping-received(20.375µs ago) ping-sent(3.070208ms ago) }]
2024-05-21T16:59:39.3557160Z 2024-05-21T16:59:38.935212Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock: received ping: path active src=Udp(167.235.14.200:58263) tx=bed91b85958491296023a4aa
2024-05-21T16:59:39.3558460Z 2024-05-21T16:59:38.935322Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}: iroh_net::magicsock: sending pong tx=bed91b85958491296023a4aa addr=UDP(167.235.14.200:58263) dstkey=wp3g26raw2ercopv
2024-05-21T16:59:39.3560900Z 2024-05-21T16:59:38.937026Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0xA14F4853DDEC196A51854774), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: received pong tx=a14f4853ddec196a51854774 src=UDP(167.235.14.200:58263) reported_ping_src=UDP(167.235.14.200:51664) ping_dst=UDP(167.235.14.200:58263) is_relay=false latency=4
2024-05-21T16:59:39.3563060Z 2024-05-21T16:59:38.937249Z DEBUG poll_recv{me=nkpqjtgrfsdzojzk}:disco_in{node=wp3g26raw2ercopv src=Udp(167.235.14.200:58263)}:handle_pong{m=Pong { tx_id: TransactionId(0xA14F4853DDEC196A51854774), ping_observed_addr: Udp(167.235.14.200:51664) } src=Udp(167.235.14.200:58263)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:58263{ active pong-received(222.625µs ago) ping-received(2.164875ms ago) ping-sent(5.215ms ago) }]
2024-05-21T16:59:39.3565470Z 2024-05-21T16:59:38.938149Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0xBED91B85958491296023A4AA), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: received pong tx=bed91b85958491296023a4aa src=UDP(167.235.14.200:51664) reported_ping_src=UDP(167.235.14.200:58263) ping_dst=UDP(167.235.14.200:51664) is_relay=false latency=4
2024-05-21T16:59:39.3567560Z 2024-05-21T16:59:38.938321Z DEBUG poll_recv{me=wp3g26raw2ercopv}:disco_in{node=nkpqjtgrfsdzojzk src=Udp(167.235.14.200:51664)}:handle_pong{m=Pong { tx_id: TransactionId(0xBED91B85958491296023A4AA), ping_observed_addr: Udp(167.235.14.200:58263) } src=Udp(167.235.14.200:51664)}: iroh_net::magicsock::node_map::node_state: handled pong paths=[167.235.14.200:51664{ active pong-received(167.917µs ago) ping-received(4.209792ms ago) ping-sent(5.114542ms ago) }]
2024-05-21T16:59:39.3568770Z 2024-05-21T16:59:38.941500Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle out_event SendMessage(PublicKey(nkpqjtgrfsdzojzk), Message { topic: TopicId(6gebwlyf7po3fygx), message: Swarm(Shuffle(Shuffle { origin: PublicKey(wp3g26raw2ercopv), nodes: [], ttl: Ttl(6) })) })
2024-05-21T16:59:39.3569910Z 2024-05-21T16:59:38.942402Z DEBUG poll_send{me=wp3g26raw2ercopv}:get_send_addrs{node=nkpqjtgrfsdzojzk}:want_call_me_maybe: iroh_net::magicsock::node_map::node_state: full ping interval expired and latency is only 109ms: need full ping
2024-05-21T16:59:39.3571240Z 2024-05-21T16:59:38.942508Z DEBUG poll_send{me=wp3g26raw2ercopv}:get_send_addrs{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: prune addresses: 0 pruned paths=[167.235.14.200:51664{ active pong-received(4.360833ms ago) ping-received(8.400792ms ago) ping-sent(9.303667ms ago) }]
2024-05-21T16:59:39.3572820Z 2024-05-21T16:59:38.942610Z DEBUG poll_send{me=wp3g26raw2ercopv}:get_send_addrs{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: sending pings to endpoint ping_dsts=[] dst=nkpqjtgrfsdzojzk paths=[167.235.14.200:51664{ active pong-received(4.463167ms ago) ping-received(8.502917ms ago) ping-sent(9.405667ms ago) }]
2024-05-21T16:59:39.3573740Z 2024-05-21T16:59:38.942693Z DEBUG poll_send{me=wp3g26raw2ercopv}:get_send_addrs{node=nkpqjtgrfsdzojzk}: iroh_net::magicsock::node_map::node_state: can not send call-me-maybe, no relay URL
2024-05-21T16:59:39.3574870Z 2024-05-21T16:59:38.943579Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle in_event  RecvMessage(PublicKey(wp3g26raw2ercopv), Message { topic: TopicId(6gebwlyf7po3fygx), message: Swarm(Shuffle(Shuffle { origin: PublicKey(wp3g26raw2ercopv), nodes: [], ttl: Ttl(6) })) })
2024-05-21T16:59:39.3575870Z 2024-05-21T16:59:38.943704Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle out_event SendMessage(PublicKey(wp3g26raw2ercopv), Message { topic: TopicId(6gebwlyf7po3fygx), message: Swarm(ShuffleReply(ShuffleReply { nodes: [] })) })
2024-05-21T16:59:39.3576850Z 2024-05-21T16:59:38.945660Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle in_event  RecvMessage(PublicKey(nkpqjtgrfsdzojzk), Message { topic: TopicId(6gebwlyf7po3fygx), message: Swarm(ShuffleReply(ShuffleReply { nodes: [] })) })
2024-05-21T16:59:39.3577970Z 2024-05-21T16:59:39.073110Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle out_event SendMessage(PublicKey(wp3g26raw2ercopv), Message { topic: TopicId(6gebwlyf7po3fygx), message: Swarm(Shuffle(Shuffle { origin: PublicKey(nkpqjtgrfsdzojzk), nodes: [], ttl: Ttl(6) })) })
2024-05-21T16:59:39.3579090Z 2024-05-21T16:59:39.073841Z DEBUG poll_send{me=nkpqjtgrfsdzojzk}:get_send_addrs{node=wp3g26raw2ercopv}:want_call_me_maybe: iroh_net::magicsock::node_map::node_state: full ping interval expired and latency is only 114ms: need full ping
2024-05-21T16:59:39.3580520Z 2024-05-21T16:59:39.073938Z DEBUG poll_send{me=nkpqjtgrfsdzojzk}:get_send_addrs{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: prune addresses: 0 pruned paths=[167.235.14.200:58263{ active pong-received(136.918083ms ago) ping-received(138.863958ms ago) ping-sent(141.912166ms ago) }]
2024-05-21T16:59:39.3582070Z 2024-05-21T16:59:39.074013Z DEBUG poll_send{me=nkpqjtgrfsdzojzk}:get_send_addrs{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: sending pings to endpoint ping_dsts=[] dst=wp3g26raw2ercopv paths=[167.235.14.200:58263{ active pong-received(136.999125ms ago) ping-received(138.938333ms ago) ping-sent(141.985958ms ago) }]
2024-05-21T16:59:39.3583000Z 2024-05-21T16:59:39.074077Z DEBUG poll_send{me=nkpqjtgrfsdzojzk}:get_send_addrs{node=wp3g26raw2ercopv}: iroh_net::magicsock::node_map::node_state: can not send call-me-maybe, no relay URL
2024-05-21T16:59:39.3584170Z 2024-05-21T16:59:39.074879Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle in_event  RecvMessage(PublicKey(nkpqjtgrfsdzojzk), Message { topic: TopicId(6gebwlyf7po3fygx), message: Swarm(Shuffle(Shuffle { origin: PublicKey(nkpqjtgrfsdzojzk), nodes: [], ttl: Ttl(6) })) })
2024-05-21T16:59:39.3585160Z 2024-05-21T16:59:39.074964Z DEBUG gossip{me=wp3g26raw2ercopv}: iroh_gossip::net: handle out_event SendMessage(PublicKey(nkpqjtgrfsdzojzk), Message { topic: TopicId(6gebwlyf7po3fygx), message: Swarm(ShuffleReply(ShuffleReply { nodes: [] })) })
2024-05-21T16:59:39.3586150Z 2024-05-21T16:59:39.075902Z DEBUG gossip{me=nkpqjtgrfsdzojzk}: iroh_gossip::net: handle in_event  RecvMessage(PublicKey(wp3g26raw2ercopv), Message { topic: TopicId(6gebwlyf7po3fygx), message: Swarm(ShuffleReply(ShuffleReply { nodes: [] })) })
2024-05-21T16:59:39.3586710Z 2024-05-21T16:59:39.089312Z DEBUG downloader{me=nkpqjtgrfsdzojzk}: iroh_blobs::downloader: shutting down
2024-05-21T16:59:39.3587200Z 2024-05-21T16:59:39.089868Z DEBUG sync{me=wp3g26raw2ercopv}: iroh_docs::actor: shutdown
2024-05-21T16:59:39.3587750Z 2024-05-21T16:59:39.146585Z DEBUG downloader{me=wp3g26raw2ercopv}: iroh_blobs::downloader: shutting down
2024-05-21T16:59:39.3588240Z 2024-05-21T16:59:39.147177Z DEBUG sync{me=nkpqjtgrfsdzojzk}: iroh_docs::actor: shutdown
2024-05-21T16:59:39.3588300Z Error: timeout elapsed
2024-05-21T16:59:39.3588310Z 
2024-05-21T16:59:39.3588370Z Caused by:
2024-05-21T16:59:39.3588430Z     deadline has elapsed
2024-05-21T16:59:39.3588430Z 
2024-05-21T16:59:39.3588490Z Stack backtrace:
2024-05-21T16:59:39.3588610Z    0: std::backtrace_rs::backtrace::libunwind::trace
2024-05-21T16:59:39.3588940Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/../../backtrace/src/backtrace/libunwind.rs:105:5
2024-05-21T16:59:39.3589060Z    1: std::backtrace_rs::backtrace::trace_unsynchronized
2024-05-21T16:59:39.3589370Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
2024-05-21T16:59:39.3589450Z    2: std::backtrace::Backtrace::create
2024-05-21T16:59:39.3589680Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/backtrace.rs:331:13
2024-05-21T16:59:39.3589800Z    3: <E as anyhow::context::ext::StdError>::ext_context
2024-05-21T16:59:39.3590210Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/anyhow-1.0.82/src/context.rs:27:29
2024-05-21T16:59:39.3590420Z    4: anyhow::context::<impl anyhow::Context<T,E> for core::result::Result<T,E>>::context
2024-05-21T16:59:39.3590780Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/anyhow-1.0.82/src/context.rs:54:31
2024-05-21T16:59:39.3590880Z    5: sync::test_download_policies::{{closure}}
2024-05-21T16:59:39.3590960Z              at ./tests/sync.rs:835:44
2024-05-21T16:59:39.3591090Z    6: <core::pin::Pin<P> as core::future::future::Future>::poll
2024-05-21T16:59:39.3591340Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/future/future.rs:123:9
2024-05-21T16:59:39.3591470Z    7: <core::pin::Pin<P> as core::future::future::Future>::poll
2024-05-21T16:59:39.3591700Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/future/future.rs:123:9
2024-05-21T16:59:39.3592000Z    8: tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}::{{closure}}
2024-05-21T16:59:39.3592480Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:659:57
2024-05-21T16:59:39.3592560Z    9: tokio::runtime::coop::with_budget
2024-05-21T16:59:39.3592920Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/coop.rs:107:5
2024-05-21T16:59:39.3593000Z   10: tokio::runtime::coop::budget
2024-05-21T16:59:39.3593360Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/coop.rs:73:5
2024-05-21T16:59:39.3593590Z   11: tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}
2024-05-21T16:59:39.3594060Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:659:25
2024-05-21T16:59:39.3594200Z   12: tokio::runtime::scheduler::current_thread::Context::enter
2024-05-21T16:59:39.3594670Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:404:19
2024-05-21T16:59:39.3594860Z   13: tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}
2024-05-21T16:59:39.3595320Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:658:36
2024-05-21T16:59:39.3595500Z   14: tokio::runtime::scheduler::current_thread::CoreGuard::enter::{{closure}}
2024-05-21T16:59:39.3595970Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:737:68
2024-05-21T16:59:39.3596080Z   15: tokio::runtime::context::scoped::Scoped<T>::set
2024-05-21T16:59:39.3596480Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context/scoped.rs:40:9
2024-05-21T16:59:39.3596600Z   16: tokio::runtime::context::set_scheduler::{{closure}}
2024-05-21T16:59:39.3596980Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context.rs:176:26
2024-05-21T16:59:39.3597080Z   17: std::thread::local::LocalKey<T>::try_with
2024-05-21T16:59:39.3597320Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/local.rs:284:16
2024-05-21T16:59:39.3597400Z   18: std::thread::local::LocalKey<T>::with
2024-05-21T16:59:39.3597640Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/local.rs:260:9
2024-05-21T16:59:39.3597720Z   19: tokio::runtime::context::set_scheduler
2024-05-21T16:59:39.3598100Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context.rs:176:9
2024-05-21T16:59:39.3598240Z   20: tokio::runtime::scheduler::current_thread::CoreGuard::enter
2024-05-21T16:59:39.3598740Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:737:27
2024-05-21T16:59:39.3598900Z   21: tokio::runtime::scheduler::current_thread::CoreGuard::block_on
2024-05-21T16:59:39.3599360Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:646:19
2024-05-21T16:59:39.3599570Z   22: tokio::runtime::scheduler::current_thread::CurrentThread::block_on::{{closure}}
2024-05-21T16:59:39.3600020Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:175:28
2024-05-21T16:59:39.3600130Z   23: tokio::runtime::context::runtime::enter_runtime
2024-05-21T16:59:39.3600540Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/context/runtime.rs:65:16
2024-05-21T16:59:39.3600800Z   24: tokio::runtime::scheduler::current_thread::CurrentThread::block_on
2024-05-21T16:59:39.3601270Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/scheduler/current_thread/mod.rs:167:9
2024-05-21T16:59:39.3601370Z   25: tokio::runtime::runtime::Runtime::block_on
2024-05-21T16:59:39.3601750Z              at /Users/hetzner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.37.0/src/runtime/runtime.rs:349:47
2024-05-21T16:59:39.3601820Z   26: sync::test_download_policies
2024-05-21T16:59:39.3601890Z              at ./tests/sync.rs:850:5
2024-05-21T16:59:39.3601990Z   27: sync::test_download_policies::{{closure}}
2024-05-21T16:59:39.3602060Z              at ./tests/sync.rs:713:38
2024-05-21T16:59:39.3602140Z   28: core::ops::function::FnOnce::call_once
2024-05-21T16:59:39.3602380Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/ops/function.rs:250:5
2024-05-21T16:59:39.3602470Z   29: core::ops::function::FnOnce::call_once
2024-05-21T16:59:39.3602710Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/ops/function.rs:250:5
2024-05-21T16:59:39.3602790Z   30: test::__rust_begin_short_backtrace
2024-05-21T16:59:39.3603000Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/test/src/lib.rs:621:18
2024-05-21T16:59:39.3603090Z   31: test::run_test_in_process::{{closure}}
2024-05-21T16:59:39.3603300Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/test/src/lib.rs:644:60
2024-05-21T16:59:39.3603540Z   32: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
2024-05-21T16:59:39.3603800Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/panic/unwind_safe.rs:272:9
2024-05-21T16:59:39.3603870Z   33: std::panicking::try::do_call
2024-05-21T16:59:39.3604100Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:552:40
2024-05-21T16:59:39.3604160Z   34: std::panicking::try
2024-05-21T16:59:39.3604390Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:516:19
2024-05-21T16:59:39.3604460Z   35: std::panic::catch_unwind
2024-05-21T16:59:39.3604670Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panic.rs:146:14
2024-05-21T16:59:39.3604740Z   36: test::run_test_in_process
2024-05-21T16:59:39.3604950Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/test/src/lib.rs:644:27
2024-05-21T16:59:39.3605020Z   37: test::run_test::{{closure}}
2024-05-21T16:59:39.3605220Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/test/src/lib.rs:567:43
2024-05-21T16:59:39.3605290Z   38: test::run_test::{{closure}}
2024-05-21T16:59:39.3605490Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/test/src/lib.rs:595:41
2024-05-21T16:59:39.3605630Z   39: std::sys_common::backtrace::__rust_begin_short_backtrace
2024-05-21T16:59:39.3605950Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/sys_common/backtrace.rs:155:18
2024-05-21T16:59:39.3606120Z   40: std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}
2024-05-21T16:59:39.3606350Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/mod.rs:528:17
2024-05-21T16:59:39.3606590Z   41: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
2024-05-21T16:59:39.3606840Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/panic/unwind_safe.rs:272:9
2024-05-21T16:59:39.3606910Z   42: std::panicking::try::do_call
2024-05-21T16:59:39.3607130Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:552:40
2024-05-21T16:59:39.3607190Z   43: std::panicking::try
2024-05-21T16:59:39.3607420Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panicking.rs:516:19
2024-05-21T16:59:39.3607530Z   44: std::panic::catch_unwind
2024-05-21T16:59:39.3607740Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/panic.rs:146:14
2024-05-21T16:59:39.3607860Z   45: std::thread::Builder::spawn_unchecked_::{{closure}}
2024-05-21T16:59:39.3608090Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/thread/mod.rs:527:30
2024-05-21T16:59:39.3608220Z   46: core::ops::function::FnOnce::call_once{{vtable.shim}}
2024-05-21T16:59:39.3608450Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/core/src/ops/function.rs:250:5
2024-05-21T16:59:39.3608630Z   47: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once
2024-05-21T16:59:39.3608850Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/alloc/src/boxed.rs:2020:9
2024-05-21T16:59:39.3609020Z   48: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once
2024-05-21T16:59:39.3609240Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/alloc/src/boxed.rs:2020:9
2024-05-21T16:59:39.3609370Z   49: std::sys::pal::unix::thread::Thread::new::thread_start
2024-05-21T16:59:39.3609630Z              at /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/sys/pal/unix/thread.rs:108:17
2024-05-21T16:59:39.3609700Z   50: __pthread_deallocate
2024-05-21T16:59:39.3609760Z 
2024-05-21T16:59:39.3609830Z ------------
2024-05-21T16:59:39.3610230Z      Summary [  67.120s] 303 tests run: 302 passed, 1 failed, 25 skipped
2024-05-21T16:59:39.3610500Z         FAIL [  60.439s] iroh::sync test_download_policies
2024-05-21T16:59:39.3610590Z error: test run failed
2024-05-21T16:59:39.3620500Z ##[error]Process completed with exit code 100.
2024-05-21T16:59:39.3665270Z Post job cleanup.
2024-05-21T16:59:39.4194340Z [command]/Users/hetzner/actions-runner/_work/_tool/sccache/0.8.0/arm64/sccache --show-stats
2024-05-21T16:59:39.4328250Z Compile requests                   1505
2024-05-21T16:59:39.4328460Z Compile requests executed          1241
2024-05-21T16:59:39.4328560Z Cache hits                         1236
2024-05-21T16:59:39.4328650Z Cache hits (C/C++)                   55
2024-05-21T16:59:39.4328740Z Cache hits (Rust)                  1181
2024-05-21T16:59:39.4328840Z Cache misses                          1
2024-05-21T16:59:39.4329310Z Cache misses (Rust)                   1
2024-05-21T16:59:39.4329390Z Cache timeouts                        0
2024-05-21T16:59:39.4329490Z Cache read errors                     0
2024-05-21T16:59:39.4329580Z Forced recaches                       0
2024-05-21T16:59:39.4329650Z Cache write errors                    0
2024-05-21T16:59:39.4329750Z Compilation failures                  4
2024-05-21T16:59:39.4329990Z Cache errors                          0
2024-05-21T16:59:39.4330250Z Non-cacheable compilations            0
2024-05-21T16:59:39.4330350Z Non-cacheable calls                 263
2024-05-21T16:59:39.4330480Z Non-compilation calls                 1
2024-05-21T16:59:39.4330580Z Unsupported compiler calls            0
2024-05-21T16:59:39.4330670Z Average cache write               0.000 s
2024-05-21T16:59:39.4330770Z Average compiler                  2.577 s
2024-05-21T16:59:39.4330860Z Average cache read hit            0.001 s
2024-05-21T16:59:39.4330950Z Failed distributed compilations       0
2024-05-21T16:59:39.4330950Z 
2024-05-21T16:59:39.4331050Z Non-cacheable reasons:
2024-05-21T16:59:39.4331190Z crate-type                          184
2024-05-21T16:59:39.4331270Z unknown source language              40
2024-05-21T16:59:39.4331370Z -                                    39
2024-05-21T16:59:39.4331370Z 
2024-05-21T16:59:39.4331610Z Cache location                  Local disk: "/Users/hetzner/Library/Caches/Mozilla.sccache"
2024-05-21T16:59:39.4331700Z Use direct/preprocessor mode?   yes
2024-05-21T16:59:39.4331810Z Version (client)                0.8.0
2024-05-21T16:59:39.4332140Z Cache size                           50 GiB
2024-05-21T16:59:39.4332270Z Max cache size                       50 GiB
2024-05-21T16:59:39.4414970Z Post job cleanup.
2024-05-21T16:59:39.5237280Z [command]/opt/homebrew/bin/git version
2024-05-21T16:59:39.5272630Z git version 2.38.1
2024-05-21T16:59:39.5293160Z Temporarily overriding HOME='/Users/hetzner/actions-runner/_work/_temp/47b7fabf-20f5-42be-bc72-9d700dd653e1' before making global git config changes
2024-05-21T16:59:39.5293440Z Adding repository directory to the temporary git global config as a safe directory
2024-05-21T16:59:39.5296930Z [command]/opt/homebrew/bin/git config --global --add safe.directory /Users/hetzner/actions-runner/_work/iroh/iroh
2024-05-21T16:59:39.5330740Z [command]/opt/homebrew/bin/git config --local --name-only --get-regexp core\.sshCommand
2024-05-21T16:59:39.5360240Z [command]/opt/homebrew/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
2024-05-21T16:59:39.5759850Z [command]/opt/homebrew/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2024-05-21T16:59:39.5785220Z http.https://github.com/.extraheader
2024-05-21T16:59:39.5791010Z [command]/opt/homebrew/bin/git config --local --unset-all http.https://github.com/.extraheader
2024-05-21T16:59:39.5824050Z [command]/opt/homebrew/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
2024-05-21T16:59:39.6321360Z Cleaning up orphan processes
2024-05-21T16:59:39.9149140Z Terminate orphan process: pid (95783) (sccache)

@divagant-martian
Copy link
Contributor Author

divagant-martian commented Jun 12, 2024

so far what I have found to be a notable difference between successful runs and this one is that the expected entries are received all via gossip in successful runs. For the silent node, there is no gossip message and no RemoteInsert.

We should look into why gossip propagation is failing. However, gossip should not be sole provider of info if sync has already started between both nodes.

Basically, this reinforces my hypothesis that it's sync itself which is not occurring in a symmetric manner. I'll give it a go to reproduce the failure by disabling/breaking gossip

@divagant-martian
Copy link
Contributor Author

from testing by ignoring entries that come from gossip, nothing seems to work at all. I would expect set reconciliation to be enough to obtain the metadata of the missing entries. If this is not the case then what's set reconciliation providing that gossip is not supplying already?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: 🏗 In progress
Development

No branches or pull requests

1 participant