Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X............................................X.] duration: 452.039398ms FAIL (2025-08-13 03:42:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:41:41.695216238 (106h15m22.426483868s) [upload=110648]: Starting upload Aug 13 03:41:41.695261673 (106h15m22.426529293s) [upload=110648]: Done starting upload Aug 13 03:41:41.695376319 (106h15m22.426643949s) [upload=110648]: Uploading segments... Aug 13 03:41:41.695478220 (106h15m22.42674584s) [upload=110648]: Got next segment. Inline: false Aug 13 03:41:41.695515841 (106h15m22.426783471s) [upload=110648]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:41:41.695519939 (106h15m22.426787559s) [upload=110648]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:41:41.698590384 (106h15m22.429858014s) [upload=110648]: Next segment err: metaclient: Too Many Requests Aug 13 03:41:41.698602507 (106h15m22.429870137s) [upload=110648]: Done uploading segments... Aug 13 03:41:41.698610883 (106h15m22.429878513s) [upload=110648]: Upload finished. err: metaclient: Too Many Requests Duration: 452.069625ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X............................................X] duration: 17.208954ms FAIL (2025-08-13 03:41:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:41:41.695216238 (106h15m22.426483868s) [upload=110648]: Starting upload Aug 13 03:41:41.695261673 (106h15m22.426529293s) [upload=110648]: Done starting upload Aug 13 03:41:41.695376319 (106h15m22.426643949s) [upload=110648]: Uploading segments... Aug 13 03:41:41.695478220 (106h15m22.42674584s) [upload=110648]: Got next segment. Inline: false Aug 13 03:41:41.695515841 (106h15m22.426783471s) [upload=110648]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:41:41.695519939 (106h15m22.426787559s) [upload=110648]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:41:41.698590384 (106h15m22.429858014s) [upload=110648]: Next segment err: metaclient: Too Many Requests Aug 13 03:41:41.698602507 (106h15m22.429870137s) [upload=110648]: Done uploading segments... Aug 13 03:41:41.698610883 (106h15m22.429878513s) [upload=110648]: Upload finished. err: metaclient: Too Many Requests Duration: 17.225316ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 568.78914ms FAIL (2025-08-13 03:40:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 568.811552ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 539.264244ms FAIL (2025-08-13 03:40:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 539.294691ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 376.484365ms FAIL (2025-08-13 03:39:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 376.512218ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 496.069377ms FAIL (2025-08-13 03:38:40 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 496.091119ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 476.447124ms FAIL (2025-08-13 03:38:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 476.468655ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 999.677022ms FAIL (2025-08-13 03:37:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:53:54.817302111 (105h27m35.54856973s) [upload=109833]: Starting upload Aug 13 02:53:54.817352535 (105h27m35.548620155s) [upload=109833]: Done starting upload Aug 13 02:53:54.817394314 (105h27m35.548661934s) [upload=109833]: Uploading segments... Aug 13 02:53:54.817421124 (105h27m35.548688735s) [upload=109833]: Got next segment. Inline: true Aug 13 02:53:54.817424330 (105h27m35.548691951s) [upload=109833]: Waiting for error group managing segments... Aug 13 02:53:54.817454598 (105h27m35.548722217s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:53:54.817459617 (105h27m35.548727237s) [upload=109833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:53:54.817462012 (105h27m35.548729631s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:53:54.820375852 (105h27m35.551643482s) [upload=109833]: Done uploading segments... Aug 13 02:53:54.820386081 (105h27m35.551653711s) [upload=109833]: Upload finished. err: metaclient: Too Many Requests Duration:* 999.705926ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 220.151493ms FAIL (2025-08-13 03:37:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:53:54.817302111 (105h27m35.54856973s) [upload=109833]: Starting upload Aug 13 02:53:54.817352535 (105h27m35.548620155s) [upload=109833]: Done starting upload Aug 13 02:53:54.817394314 (105h27m35.548661934s) [upload=109833]: Uploading segments... Aug 13 02:53:54.817421124 (105h27m35.548688735s) [upload=109833]: Got next segment. Inline: true Aug 13 02:53:54.817424330 (105h27m35.548691951s) [upload=109833]: Waiting for error group managing segments... Aug 13 02:53:54.817454598 (105h27m35.548722217s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:53:54.817459617 (105h27m35.548727237s) [upload=109833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:53:54.817462012 (105h27m35.548729631s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:53:54.820375852 (105h27m35.551643482s) [upload=109833]: Done uploading segments... Aug 13 02:53:54.820386081 (105h27m35.551653711s) [upload=109833]: Upload finished. err: metaclient: Too Many Requests Duration:* 220.199093ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 409.968888ms FAIL (2025-08-13 03:37:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 410.008252ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 334.60924ms FAIL (2025-08-13 03:36:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:53:54.817302111 (105h27m35.54856973s) [upload=109833]: Starting upload Aug 13 02:53:54.817352535 (105h27m35.548620155s) [upload=109833]: Done starting upload Aug 13 02:53:54.817394314 (105h27m35.548661934s) [upload=109833]: Uploading segments... Aug 13 02:53:54.817421124 (105h27m35.548688735s) [upload=109833]: Got next segment. Inline: true Aug 13 02:53:54.817424330 (105h27m35.548691951s) [upload=109833]: Waiting for error group managing segments... Aug 13 02:53:54.817454598 (105h27m35.548722217s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:53:54.817459617 (105h27m35.548727237s) [upload=109833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:53:54.817462012 (105h27m35.548729631s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:53:54.820375852 (105h27m35.551643482s) [upload=109833]: Done uploading segments... Aug 13 02:53:54.820386081 (105h27m35.551653711s) [upload=109833]: Upload finished. err: metaclient: Too Many Requests Duration:* 334.628796ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 365.381322ms FAIL (2025-08-13 03:36:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 365.465903ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 382.376575ms FAIL (2025-08-13 03:35:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:53:54.817302111 (105h27m35.54856973s) [upload=109833]: Starting upload Aug 13 02:53:54.817352535 (105h27m35.548620155s) [upload=109833]: Done starting upload Aug 13 02:53:54.817394314 (105h27m35.548661934s) [upload=109833]: Uploading segments... Aug 13 02:53:54.817421124 (105h27m35.548688735s) [upload=109833]: Got next segment. Inline: true Aug 13 02:53:54.817424330 (105h27m35.548691951s) [upload=109833]: Waiting for error group managing segments... Aug 13 02:53:54.817454598 (105h27m35.548722217s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:53:54.817459617 (105h27m35.548727237s) [upload=109833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:53:54.817462012 (105h27m35.548729631s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:53:54.820375852 (105h27m35.551643482s) [upload=109833]: Done uploading segments... Aug 13 02:53:54.820386081 (105h27m35.551653711s) [upload=109833]: Upload finished. err: metaclient: Too Many Requests Duration:* 382.402393ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 539.900417ms FAIL (2025-08-13 03:35:06 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 539.916859ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 150.533628ms FAIL (2025-08-13 03:35:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:53:54.817302111 (105h27m35.54856973s) [upload=109833]: Starting upload Aug 13 02:53:54.817352535 (105h27m35.548620155s) [upload=109833]: Done starting upload Aug 13 02:53:54.817394314 (105h27m35.548661934s) [upload=109833]: Uploading segments... Aug 13 02:53:54.817421124 (105h27m35.548688735s) [upload=109833]: Got next segment. Inline: true Aug 13 02:53:54.817424330 (105h27m35.548691951s) [upload=109833]: Waiting for error group managing segments... Aug 13 02:53:54.817454598 (105h27m35.548722217s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:53:54.817459617 (105h27m35.548727237s) [upload=109833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:53:54.817462012 (105h27m35.548729631s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:53:54.820375852 (105h27m35.551643482s) [upload=109833]: Done uploading segments... Aug 13 02:53:54.820386081 (105h27m35.551653711s) [upload=109833]: Upload finished. err: metaclient: Too Many Requests Duration:* 150.558885ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 145.824372ms FAIL (2025-08-13 03:34:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:53:54.817302111 (105h27m35.54856973s) [upload=109833]: Starting upload Aug 13 02:53:54.817352535 (105h27m35.548620155s) [upload=109833]: Done starting upload Aug 13 02:53:54.817394314 (105h27m35.548661934s) [upload=109833]: Uploading segments... Aug 13 02:53:54.817421124 (105h27m35.548688735s) [upload=109833]: Got next segment. Inline: true Aug 13 02:53:54.817424330 (105h27m35.548691951s) [upload=109833]: Waiting for error group managing segments... Aug 13 02:53:54.817454598 (105h27m35.548722217s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:53:54.817459617 (105h27m35.548727237s) [upload=109833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:53:54.817462012 (105h27m35.548729631s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:53:54.820375852 (105h27m35.551643482s) [upload=109833]: Done uploading segments... Aug 13 02:53:54.820386081 (105h27m35.551653711s) [upload=109833]: Upload finished. err: metaclient: Too Many Requests Duration:* 145.852143ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 452.921048ms FAIL (2025-08-13 03:33:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 452.941997ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 550.222773ms FAIL (2025-08-13 03:33:09 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 550.290521ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 402.205316ms FAIL (2025-08-13 03:33:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:53:54.817302111 (105h27m35.54856973s) [upload=109833]: Starting upload Aug 13 02:53:54.817352535 (105h27m35.548620155s) [upload=109833]: Done starting upload Aug 13 02:53:54.817394314 (105h27m35.548661934s) [upload=109833]: Uploading segments... Aug 13 02:53:54.817421124 (105h27m35.548688735s) [upload=109833]: Got next segment. Inline: true Aug 13 02:53:54.817424330 (105h27m35.548691951s) [upload=109833]: Waiting for error group managing segments... Aug 13 02:53:54.817454598 (105h27m35.548722217s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:53:54.817459617 (105h27m35.548727237s) [upload=109833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:53:54.817462012 (105h27m35.548729631s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:53:54.820375852 (105h27m35.551643482s) [upload=109833]: Done uploading segments... Aug 13 02:53:54.820386081 (105h27m35.551653711s) [upload=109833]: Upload finished. err: metaclient: Too Many Requests Duration:* 402.230393ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 506.100781ms FAIL (2025-08-13 03:32:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 506.123324ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 205.522596ms FAIL (2025-08-13 03:32:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:53:54.817302111 (105h27m35.54856973s) [upload=109833]: Starting upload Aug 13 02:53:54.817352535 (105h27m35.548620155s) [upload=109833]: Done starting upload Aug 13 02:53:54.817394314 (105h27m35.548661934s) [upload=109833]: Uploading segments... Aug 13 02:53:54.817421124 (105h27m35.548688735s) [upload=109833]: Got next segment. Inline: true Aug 13 02:53:54.817424330 (105h27m35.548691951s) [upload=109833]: Waiting for error group managing segments... Aug 13 02:53:54.817454598 (105h27m35.548722217s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:53:54.817459617 (105h27m35.548727237s) [upload=109833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:53:54.817462012 (105h27m35.548729631s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:53:54.820375852 (105h27m35.551643482s) [upload=109833]: Done uploading segments... Aug 13 02:53:54.820386081 (105h27m35.551653711s) [upload=109833]: Upload finished. err: metaclient: Too Many Requests Duration:* 205.54099ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 568.942931ms FAIL (2025-08-13 03:31:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 568.967937ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 506.8911ms FAIL (2025-08-13 03:31:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 506.908071ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 150.083021ms FAIL (2025-08-13 03:31:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:53:54.817302111 (105h27m35.54856973s) [upload=109833]: Starting upload Aug 13 02:53:54.817352535 (105h27m35.548620155s) [upload=109833]: Done starting upload Aug 13 02:53:54.817394314 (105h27m35.548661934s) [upload=109833]: Uploading segments... Aug 13 02:53:54.817421124 (105h27m35.548688735s) [upload=109833]: Got next segment. Inline: true Aug 13 02:53:54.817424330 (105h27m35.548691951s) [upload=109833]: Waiting for error group managing segments... Aug 13 02:53:54.817454598 (105h27m35.548722217s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:53:54.817459617 (105h27m35.548727237s) [upload=109833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:53:54.817462012 (105h27m35.548729631s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:53:54.820375852 (105h27m35.551643482s) [upload=109833]: Done uploading segments... Aug 13 02:53:54.820386081 (105h27m35.551653711s) [upload=109833]: Upload finished. err: metaclient: Too Many Requests Duration:* 150.105824ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 531.0743ms FAIL (2025-08-13 03:30:56 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 531.098116ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 519.900236ms FAIL (2025-08-13 03:30:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 519.921495ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 193.516115ms FAIL (2025-08-13 03:30:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:53:54.817302111 (105h27m35.54856973s) [upload=109833]: Starting upload Aug 13 02:53:54.817352535 (105h27m35.548620155s) [upload=109833]: Done starting upload Aug 13 02:53:54.817394314 (105h27m35.548661934s) [upload=109833]: Uploading segments... Aug 13 02:53:54.817421124 (105h27m35.548688735s) [upload=109833]: Got next segment. Inline: true Aug 13 02:53:54.817424330 (105h27m35.548691951s) [upload=109833]: Waiting for error group managing segments... Aug 13 02:53:54.817454598 (105h27m35.548722217s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:53:54.817459617 (105h27m35.548727237s) [upload=109833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:53:54.817462012 (105h27m35.548729631s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:53:54.820375852 (105h27m35.551643482s) [upload=109833]: Done uploading segments... Aug 13 02:53:54.820386081 (105h27m35.551653711s) [upload=109833]: Upload finished. err: metaclient: Too Many Requests Duration:* 193.541852ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 154.04427ms FAIL (2025-08-13 03:29:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:53:54.817302111 (105h27m35.54856973s) [upload=109833]: Starting upload Aug 13 02:53:54.817352535 (105h27m35.548620155s) [upload=109833]: Done starting upload Aug 13 02:53:54.817394314 (105h27m35.548661934s) [upload=109833]: Uploading segments... Aug 13 02:53:54.817421124 (105h27m35.548688735s) [upload=109833]: Got next segment. Inline: true Aug 13 02:53:54.817424330 (105h27m35.548691951s) [upload=109833]: Waiting for error group managing segments... Aug 13 02:53:54.817454598 (105h27m35.548722217s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:53:54.817459617 (105h27m35.548727237s) [upload=109833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:53:54.817462012 (105h27m35.548729631s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:53:54.820375852 (105h27m35.551643482s) [upload=109833]: Done uploading segments... Aug 13 02:53:54.820386081 (105h27m35.551653711s) [upload=109833]: Upload finished. err: metaclient: Too Many Requests Duration:* 154.070288ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 366.668793ms FAIL (2025-08-13 03:29:08 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 366.697787ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 153.258523ms FAIL (2025-08-13 03:29:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:53:54.817302111 (105h27m35.54856973s) [upload=109833]: Starting upload Aug 13 02:53:54.817352535 (105h27m35.548620155s) [upload=109833]: Done starting upload Aug 13 02:53:54.817394314 (105h27m35.548661934s) [upload=109833]: Uploading segments... Aug 13 02:53:54.817421124 (105h27m35.548688735s) [upload=109833]: Got next segment. Inline: true Aug 13 02:53:54.817424330 (105h27m35.548691951s) [upload=109833]: Waiting for error group managing segments... Aug 13 02:53:54.817454598 (105h27m35.548722217s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:53:54.817459617 (105h27m35.548727237s) [upload=109833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:53:54.817462012 (105h27m35.548729631s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:53:54.820375852 (105h27m35.551643482s) [upload=109833]: Done uploading segments... Aug 13 02:53:54.820386081 (105h27m35.551653711s) [upload=109833]: Upload finished. err: metaclient: Too Many Requests Duration:* 153.281857ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 479.684462ms FAIL (2025-08-13 03:28:40 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 479.712174ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 180.038897ms FAIL (2025-08-13 03:27:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:53:54.817302111 (105h27m35.54856973s) [upload=109833]: Starting upload Aug 13 02:53:54.817352535 (105h27m35.548620155s) [upload=109833]: Done starting upload Aug 13 02:53:54.817394314 (105h27m35.548661934s) [upload=109833]: Uploading segments... Aug 13 02:53:54.817421124 (105h27m35.548688735s) [upload=109833]: Got next segment. Inline: true Aug 13 02:53:54.817424330 (105h27m35.548691951s) [upload=109833]: Waiting for error group managing segments... Aug 13 02:53:54.817454598 (105h27m35.548722217s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:53:54.817459617 (105h27m35.548727237s) [upload=109833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:53:54.817462012 (105h27m35.548729631s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:53:54.820375852 (105h27m35.551643482s) [upload=109833]: Done uploading segments... Aug 13 02:53:54.820386081 (105h27m35.551653711s) [upload=109833]: Upload finished. err: metaclient: Too Many Requests Duration:* 180.110773ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 450.799818ms FAIL (2025-08-13 03:27:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:53:54.817302111 (105h27m35.54856973s) [upload=109833]: Starting upload Aug 13 02:53:54.817352535 (105h27m35.548620155s) [upload=109833]: Done starting upload Aug 13 02:53:54.817394314 (105h27m35.548661934s) [upload=109833]: Uploading segments... Aug 13 02:53:54.817421124 (105h27m35.548688735s) [upload=109833]: Got next segment. Inline: true Aug 13 02:53:54.817424330 (105h27m35.548691951s) [upload=109833]: Waiting for error group managing segments... Aug 13 02:53:54.817454598 (105h27m35.548722217s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:53:54.817459617 (105h27m35.548727237s) [upload=109833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:53:54.817462012 (105h27m35.548729631s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:53:54.820375852 (105h27m35.551643482s) [upload=109833]: Done uploading segments... Aug 13 02:53:54.820386081 (105h27m35.551653711s) [upload=109833]: Upload finished. err: metaclient: Too Many Requests Duration:* 450.821869ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 1.214777886s FAIL (2025-08-13 03:27:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 1.214802452s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 152.958795ms FAIL (2025-08-13 03:26:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:53:54.817302111 (105h27m35.54856973s) [upload=109833]: Starting upload Aug 13 02:53:54.817352535 (105h27m35.548620155s) [upload=109833]: Done starting upload Aug 13 02:53:54.817394314 (105h27m35.548661934s) [upload=109833]: Uploading segments... Aug 13 02:53:54.817421124 (105h27m35.548688735s) [upload=109833]: Got next segment. Inline: true Aug 13 02:53:54.817424330 (105h27m35.548691951s) [upload=109833]: Waiting for error group managing segments... Aug 13 02:53:54.817454598 (105h27m35.548722217s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:53:54.817459617 (105h27m35.548727237s) [upload=109833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:53:54.817462012 (105h27m35.548729631s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:53:54.820375852 (105h27m35.551643482s) [upload=109833]: Done uploading segments... Aug 13 02:53:54.820386081 (105h27m35.551653711s) [upload=109833]: Upload finished. err: metaclient: Too Many Requests Duration:* 152.984945ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 376.524291ms FAIL (2025-08-13 03:26:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:53:54.817302111 (105h27m35.54856973s) [upload=109833]: Starting upload Aug 13 02:53:54.817352535 (105h27m35.548620155s) [upload=109833]: Done starting upload Aug 13 02:53:54.817394314 (105h27m35.548661934s) [upload=109833]: Uploading segments... Aug 13 02:53:54.817421124 (105h27m35.548688735s) [upload=109833]: Got next segment. Inline: true Aug 13 02:53:54.817424330 (105h27m35.548691951s) [upload=109833]: Waiting for error group managing segments... Aug 13 02:53:54.817454598 (105h27m35.548722217s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:53:54.817459617 (105h27m35.548727237s) [upload=109833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:53:54.817462012 (105h27m35.548729631s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:53:54.820375852 (105h27m35.551643482s) [upload=109833]: Done uploading segments... Aug 13 02:53:54.820386081 (105h27m35.551653711s) [upload=109833]: Upload finished. err: metaclient: Too Many Requests Duration:* 376.552103ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 455.460887ms FAIL (2025-08-13 03:26:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 455.487497ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 207.758495ms FAIL (2025-08-13 03:25:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:53:54.817302111 (105h27m35.54856973s) [upload=109833]: Starting upload Aug 13 02:53:54.817352535 (105h27m35.548620155s) [upload=109833]: Done starting upload Aug 13 02:53:54.817394314 (105h27m35.548661934s) [upload=109833]: Uploading segments... Aug 13 02:53:54.817421124 (105h27m35.548688735s) [upload=109833]: Got next segment. Inline: true Aug 13 02:53:54.817424330 (105h27m35.548691951s) [upload=109833]: Waiting for error group managing segments... Aug 13 02:53:54.817454598 (105h27m35.548722217s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:53:54.817459617 (105h27m35.548727237s) [upload=109833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:53:54.817462012 (105h27m35.548729631s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:53:54.820375852 (105h27m35.551643482s) [upload=109833]: Done uploading segments... Aug 13 02:53:54.820386081 (105h27m35.551653711s) [upload=109833]: Upload finished. err: metaclient: Too Many Requests Duration:* 207.784134ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 458.890565ms FAIL (2025-08-13 03:25:49 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 458.914921ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 378.041655ms FAIL (2025-08-13 03:25:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 378.073615ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 312.112282ms FAIL (2025-08-13 03:25:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:53:54.817302111 (105h27m35.54856973s) [upload=109833]: Starting upload Aug 13 02:53:54.817352535 (105h27m35.548620155s) [upload=109833]: Done starting upload Aug 13 02:53:54.817394314 (105h27m35.548661934s) [upload=109833]: Uploading segments... Aug 13 02:53:54.817421124 (105h27m35.548688735s) [upload=109833]: Got next segment. Inline: true Aug 13 02:53:54.817424330 (105h27m35.548691951s) [upload=109833]: Waiting for error group managing segments... Aug 13 02:53:54.817454598 (105h27m35.548722217s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:53:54.817459617 (105h27m35.548727237s) [upload=109833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:53:54.817462012 (105h27m35.548729631s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:53:54.820375852 (105h27m35.551643482s) [upload=109833]: Done uploading segments... Aug 13 02:53:54.820386081 (105h27m35.551653711s) [upload=109833]: Upload finished. err: metaclient: Too Many Requests Duration:* 312.135926ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 426.775352ms FAIL (2025-08-13 03:25:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:53:54.817302111 (105h27m35.54856973s) [upload=109833]: Starting upload Aug 13 02:53:54.817352535 (105h27m35.548620155s) [upload=109833]: Done starting upload Aug 13 02:53:54.817394314 (105h27m35.548661934s) [upload=109833]: Uploading segments... Aug 13 02:53:54.817421124 (105h27m35.548688735s) [upload=109833]: Got next segment. Inline: true Aug 13 02:53:54.817424330 (105h27m35.548691951s) [upload=109833]: Waiting for error group managing segments... Aug 13 02:53:54.817454598 (105h27m35.548722217s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:53:54.817459617 (105h27m35.548727237s) [upload=109833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:53:54.817462012 (105h27m35.548729631s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:53:54.820375852 (105h27m35.551643482s) [upload=109833]: Done uploading segments... Aug 13 02:53:54.820386081 (105h27m35.551653711s) [upload=109833]: Upload finished. err: metaclient: Too Many Requests Duration:* 426.80075ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 571.530455ms FAIL (2025-08-13 03:24:56 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 571.5601ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 507.599959ms FAIL (2025-08-13 03:24:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:53:54.817302111 (105h27m35.54856973s) [upload=109833]: Starting upload Aug 13 02:53:54.817352535 (105h27m35.548620155s) [upload=109833]: Done starting upload Aug 13 02:53:54.817394314 (105h27m35.548661934s) [upload=109833]: Uploading segments... Aug 13 02:53:54.817421124 (105h27m35.548688735s) [upload=109833]: Got next segment. Inline: true Aug 13 02:53:54.817424330 (105h27m35.548691951s) [upload=109833]: Waiting for error group managing segments... Aug 13 02:53:54.817454598 (105h27m35.548722217s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:53:54.817459617 (105h27m35.548727237s) [upload=109833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:53:54.817462012 (105h27m35.548729631s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:53:54.820375852 (105h27m35.551643482s) [upload=109833]: Done uploading segments... Aug 13 02:53:54.820386081 (105h27m35.551653711s) [upload=109833]: Upload finished. err: metaclient: Too Many Requests Duration:* 507.629243ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 542.364836ms FAIL (2025-08-13 03:23:49 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 542.390634ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 632.332644ms FAIL (2025-08-13 03:23:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 632.354023ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 211.574723ms FAIL (2025-08-13 03:23:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:53:54.817302111 (105h27m35.54856973s) [upload=109833]: Starting upload Aug 13 02:53:54.817352535 (105h27m35.548620155s) [upload=109833]: Done starting upload Aug 13 02:53:54.817394314 (105h27m35.548661934s) [upload=109833]: Uploading segments... Aug 13 02:53:54.817421124 (105h27m35.548688735s) [upload=109833]: Got next segment. Inline: true Aug 13 02:53:54.817424330 (105h27m35.548691951s) [upload=109833]: Waiting for error group managing segments... Aug 13 02:53:54.817454598 (105h27m35.548722217s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:53:54.817459617 (105h27m35.548727237s) [upload=109833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:53:54.817462012 (105h27m35.548729631s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:53:54.820375852 (105h27m35.551643482s) [upload=109833]: Done uploading segments... Aug 13 02:53:54.820386081 (105h27m35.551653711s) [upload=109833]: Upload finished. err: metaclient: Too Many Requests Duration:* 211.592898ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 654.414702ms FAIL (2025-08-13 03:22:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 13 03:06:15.203251263 (105h39m55.934518893s) [upload=110042]: Starting upload Aug 13 03:06:15.203327545 (105h39m55.934595175s) [upload=110042]: Done starting upload Aug 13 03:06:15.203404941 (105h39m55.934672562s) [upload=110042]: Uploading segments... Aug 13 03:06:15.203588446 (105h39m55.934856077s) [upload=110042]: Got next segment. Inline: false Aug 13 03:06:15.203624404 (105h39m55.934892054s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:06:15.203647368 (105h39m55.934914998s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:06:15.230070653 (105h39m55.961338273s) [seg_pos={0 0}, upload=110042]: Begin upload segment... Aug 13 03:06:15.230110688 (105h39m55.961378308s) [seg_pos={0 0}, upload=110042]: Done begin upload segment. Aug 13 03:06:15.230130806 (105h39m55.961398446s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230139162 (105h39m55.961406792s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230472659 (105h39m55.961740279s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230626287 (105h39m55.961893917s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.230827967 (105h39m55.962095586s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.231530197 (105h39m55.962797858s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234514390 (105h39m55.965782021s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.234923480 (105h39m55.96619111s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236217714 (105h39m55.967485334s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.236675294 (105h39m55.967942924s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.237339394 (105h39m55.968607024s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238375332 (105h39m55.969642952s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238692278 (105h39m55.969959898s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.238998483 (105h39m55.970266103s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239287728 (105h39m55.970555348s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239590907 (105h39m55.970858528s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.239892675 (105h39m55.971160295s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.240992834 (105h39m55.972260455s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Uploading piece... Aug 13 03:06:15.329856758 (105h39m56.061124378s) [upload=110042]: Next returned nil segment Aug 13 03:06:15.329871395 (105h39m56.061139015s) [upload=110042]: Waiting for error group managing segments... Aug 13 03:06:15.346207470 (105h39m56.0774751s) [noise=true , address=104.36.82.36:4650 , piece_id=JW3UBALW27Q55UM2DX3Z34BLHDWT4LZX74JPGFAJRK5DGNWUQNTQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.349685461 (105h39m56.080953082s) [noise=true , address=77.90.31.15:4703 , piece_id=OV5LK2UWOCINUU753WVQA4RSC453NUPI7HWII3KRIZT3QPJMMXXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.350668441 (105h39m56.081936071s) [noise=true , address=104.36.82.58:4300 , piece_id=5TJ4D76CC2SR7FC6ZHAWWINPFD47E5SQVUJ5H4BY2GGSYRY46DXA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.353352709 (105h39m56.084620329s) [noise=true , address=104.36.82.51:4054 , piece_id=MLPTHE4TAS4PFW5SX7JAMFQ6JFQ542I4I2UT27HAKKZPOGLVPXCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.358563710 (105h39m56.08983134s) [noise=true , address=77.90.31.14:4695 , piece_id=SHP5N7GUTXY4T2JX7JGM376OCW45YYK3OGBIZDFKBOAKS6NP7NRQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.365766607 (105h39m56.097034227s) [noise=true , address=104.36.82.56:4251 , piece_id=ITANITIV5PPP7YP5INSNROWOIWIHLX2YZTCXSR3AVLXKTENQ5M4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.370081112 (105h39m56.101348722s) [noise=true , address=104.36.82.54:4192 , piece_id=HCQBMCZEN3FOTVI3YSMAZ2ELO3MAU76D2KLDPVTUAZHA4WWUPYPA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.372822567 (105h39m56.104090188s) [noise=true , address=104.36.82.46:4505 , piece_id=IR46M764FA44LGSUSUDXBG5PLJ7BG3YEGQI3IMHOEJJMGFRFBGFQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.373063180 (105h39m56.1043308s) [noise=true , address=104.36.82.11:4131 , piece_id=GAW43SB455DNRAG2BZ35WXR2LJVHDOLC45QM25MYZGC6C7E34H4A, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.393704963 (105h39m56.124972593s) [noise=true , address=104.36.82.62:4437 , piece_id=FKONVFZBBCEYWDQE4LYSP247SXE6RCSPMJDZIY6EUG4H3SXTSKJQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.479732022 (105h39m56.210999642s) [noise=true , address=79.127.201.215:4344 , piece_id=MN4BNPPHGIKGIUNB5RLFXYCLO3PJSIAPVIWPVL7T5UOQGARQEA2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.493730620 (105h39m56.22499824s) [noise=true , address=79.127.201.214:4291 , piece_id=6MI2QFPZS244AECFFSIKVQRE4I5MGPY7C22AKNCONH72UBHSDRRA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.501249132 (105h39m56.232516762s) [noise=true , address=104.36.82.58:4299 , piece_id=3IVFRXPYBUCP7WIBJX7UIV4EG2HCTGSDEL3ALOZMAWZJEYCS6WMA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575229032 (105h39m56.306496651s) [noise=true , address=104.36.82.37:4655 , piece_id=DPJAGWD4RQRIYZKFXOWHIQNDIZKEZPKMYSNWY5267QLO37EQNDUQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: <nil> Aug 13 03:06:15.575262434 (105h39m56.306530055s) [seg_pos={0 0}, upload=110042]: Segment reached optimal threshold of 14 pieces. Aug 13 03:06:15.575459425 (105h39m56.306727055s) [noise=true , address=104.36.82.59:4308 , piece_id=2YATZPVZHUC32PMSXGH42XOPQQH2ILXPGBOQDINEHVQGAJWMKRCA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 13 03:06:15.575560095 (105h39m56.306827714s) [noise=true , address=64.49.13.155:4922 , piece_id=CTHHTBHIKFHUVALXC4H56CL3PFUM43E7RTZFWN4P4EJSB4XZDKGQ, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57966->64.49.13.155:4922: use of closed network connection Aug 13 03:06:15.575583629 (105h39m56.306851259s) [noise=true , address=64.49.13.140:4513 , piece_id=2X7BVOSO3ZBUYGNXQ3SX6TKWX6RZMMCKSWVFRWGAFPY7OXVPQF2Q, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ac3N4hMJ66bTx2dpHBDT6W5SEGnPNfwyonwmvAANR8mM8vvpY): protocol: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35898->64.49.13.140:4513: use of closed network connection Aug 13 03:06:15.575650374 (105h39m56.306917994s) [noise=true , address=66.23.193.175:4563 , piece_id=3XVSQHJFRIZGPXFZN43E5YWIOVHNABYFRA6YEPCC53RX2IZ7YAHA, seg_pos={0 0}, upload=110042]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60556->66.23.193.175:4563: use of closed network connection Aug 13 03:06:15.575663570 (105h39m56.306931189s) [seg_pos={0 0}, upload=110042]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:06:15.575723061 (105h39m56.306990681s) [upload=110042]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:06:15.575727139 (105h39m56.306994759s) [upload=110042]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:06:15.650728361 (105h39m56.381995991s) [upload=110042]: Done uploading segments... Aug 13 03:06:15.650748028 (105h39m56.382015658s) [upload=110042]: Upload finished. err: <nil> Duration: 654.451091ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 362.97632ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-08-13 03:22:15 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 363.003331ms edge linksharing bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 181.91817ms FAIL (2025-08-13 03:21:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 02:53:54.817302111 (105h27m35.54856973s) [upload=109833]: Starting upload Aug 13 02:53:54.817352535 (105h27m35.548620155s) [upload=109833]: Done starting upload Aug 13 02:53:54.817394314 (105h27m35.548661934s) [upload=109833]: Uploading segments... Aug 13 02:53:54.817421124 (105h27m35.548688735s) [upload=109833]: Got next segment. Inline: true Aug 13 02:53:54.817424330 (105h27m35.548691951s) [upload=109833]: Waiting for error group managing segments... Aug 13 02:53:54.817454598 (105h27m35.548722217s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:53:54.817459617 (105h27m35.548727237s) [upload=109833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:53:54.817462012 (105h27m35.548729631s) [upload=109833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:53:54.820375852 (105h27m35.551643482s) [upload=109833]: Done uploading segments... Aug 13 02:53:54.820386081 (105h27m35.551653711s) [upload=109833]: Upload finished. err: metaclient: Too Many Requests Duration:* 181.941243ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)