Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................X..................XX................] duration: 709.815866ms FAIL (2025-08-27 18:17:36 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments... Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment... Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment. Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments... Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces. Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments... Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil> Duration: 709.845381ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...................X..............X.....XX..X...............] duration: 336.568463ms FAIL (2025-08-27 18:17:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 27 18:04:43.275353764 (26m6.504839141s) [upload=444]: Starting upload Aug 27 18:04:43.275413156 (26m6.504898532s) [upload=444]: Done starting upload Aug 27 18:04:43.275481715 (26m6.504967091s) [upload=444]: Uploading segments... Aug 27 18:04:43.275532750 (26m6.505018127s) [upload=444]: Got next segment. Inline: true Aug 27 18:04:43.275539142 (26m6.505024519s) [upload=444]: Waiting for error group managing segments... Aug 27 18:04:43.275591671 (26m6.505077049s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:04:43.275599667 (26m6.505085114s) [upload=444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 27 18:04:43.275606289 (26m6.505091676s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:45.342492051 (26m8.571977398s) [upload=444]: Done uploading segments... Aug 27 18:04:45.342506197 (26m8.571991555s) [upload=444]: Upload finished. err: <nil> Duration:* 336.590745ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 447.471583ms FAIL (2025-08-27 18:17:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded Duration: 447.51261ms core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 15.093579ms target: https://us1.storj.io/login FAIL (2025-08-27 18:17:23 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 15.199868ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 436.841604ms FAIL (2025-08-27 18:17:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded Duration: 436.864878ms core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 13.47617ms target: https://us1.storj.io/login FAIL (2025-08-27 18:17:06 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 13.491528ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................X..................XX...............] duration: 607.612129ms FAIL (2025-08-27 18:17:05 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments... Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment... Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment. Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments... Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces. Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments... Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil> Duration: 607.644127ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [....................X..............X.....XX..X..............] duration: 134.40885ms FAIL (2025-08-27 18:16:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 27 18:04:43.275353764 (26m6.504839141s) [upload=444]: Starting upload Aug 27 18:04:43.275413156 (26m6.504898532s) [upload=444]: Done starting upload Aug 27 18:04:43.275481715 (26m6.504967091s) [upload=444]: Uploading segments... Aug 27 18:04:43.275532750 (26m6.505018127s) [upload=444]: Got next segment. Inline: true Aug 27 18:04:43.275539142 (26m6.505024519s) [upload=444]: Waiting for error group managing segments... Aug 27 18:04:43.275591671 (26m6.505077049s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:04:43.275599667 (26m6.505085114s) [upload=444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 27 18:04:43.275606289 (26m6.505091676s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:45.342492051 (26m8.571977398s) [upload=444]: Done uploading segments... Aug 27 18:04:45.342506197 (26m8.571991555s) [upload=444]: Upload finished. err: <nil> Duration:* 134.437734ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 8.992171ms target: https://us1.storj.io/login FAIL (2025-08-27 18:16:02 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 9.009033ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 336.324675ms FAIL (2025-08-27 18:16:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded Duration: 336.346365ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................X..................XX..............] duration: 460.034485ms FAIL (2025-08-27 18:15:53 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments... Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment... Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment. Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments... Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces. Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments... Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil> Duration: 460.060123ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........................X..................XX.............] duration: 653.933552ms FAIL (2025-08-27 18:15:21 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments... Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment... Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment. Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments... Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces. Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments... Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil> Duration: 653.962327ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.....................X..............X.....XX..X.............] duration: 408.262739ms FAIL (2025-08-27 18:15:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 27 18:04:43.275353764 (26m6.504839141s) [upload=444]: Starting upload Aug 27 18:04:43.275413156 (26m6.504898532s) [upload=444]: Done starting upload Aug 27 18:04:43.275481715 (26m6.504967091s) [upload=444]: Uploading segments... Aug 27 18:04:43.275532750 (26m6.505018127s) [upload=444]: Got next segment. Inline: true Aug 27 18:04:43.275539142 (26m6.505024519s) [upload=444]: Waiting for error group managing segments... Aug 27 18:04:43.275591671 (26m6.505077049s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:04:43.275599667 (26m6.505085114s) [upload=444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 27 18:04:43.275606289 (26m6.505091676s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:45.342492051 (26m8.571977398s) [upload=444]: Done uploading segments... Aug 27 18:04:45.342506197 (26m8.571991555s) [upload=444]: Upload finished. err: <nil> Duration:* 408.289871ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 12.024932ms target: https://us1.storj.io/login FAIL (2025-08-27 18:15:13 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 12.049269ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 402.309136ms FAIL (2025-08-27 18:15:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded Duration: 402.331719ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 467.668614ms FAIL (2025-08-27 18:14:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded Duration: 467.692638ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [......................X..............X.....XX..X............] duration: 219.79095ms FAIL (2025-08-27 18:14:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 27 18:04:43.275353764 (26m6.504839141s) [upload=444]: Starting upload Aug 27 18:04:43.275413156 (26m6.504898532s) [upload=444]: Done starting upload Aug 27 18:04:43.275481715 (26m6.504967091s) [upload=444]: Uploading segments... Aug 27 18:04:43.275532750 (26m6.505018127s) [upload=444]: Got next segment. Inline: true Aug 27 18:04:43.275539142 (26m6.505024519s) [upload=444]: Waiting for error group managing segments... Aug 27 18:04:43.275591671 (26m6.505077049s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:04:43.275599667 (26m6.505085114s) [upload=444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 27 18:04:43.275606289 (26m6.505091676s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:45.342492051 (26m8.571977398s) [upload=444]: Done uploading segments... Aug 27 18:04:45.342506197 (26m8.571991555s) [upload=444]: Upload finished. err: <nil> Duration:* 219.839381ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........................X..................XX............] duration: 420.261911ms FAIL (2025-08-27 18:14:29 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments... Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment... Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment. Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments... Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces. Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments... Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil> Duration: 420.288971ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 12.556401ms target: https://us1.storj.io/login FAIL (2025-08-27 18:14:18 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 12.576158ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 421.071107ms FAIL (2025-08-27 18:14:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded Duration: 421.091815ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.......................X..............X.....XX..X...........] duration: 137.524645ms FAIL (2025-08-27 18:14:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 27 18:04:43.275353764 (26m6.504839141s) [upload=444]: Starting upload Aug 27 18:04:43.275413156 (26m6.504898532s) [upload=444]: Done starting upload Aug 27 18:04:43.275481715 (26m6.504967091s) [upload=444]: Uploading segments... Aug 27 18:04:43.275532750 (26m6.505018127s) [upload=444]: Got next segment. Inline: true Aug 27 18:04:43.275539142 (26m6.505024519s) [upload=444]: Waiting for error group managing segments... Aug 27 18:04:43.275591671 (26m6.505077049s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:04:43.275599667 (26m6.505085114s) [upload=444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 27 18:04:43.275606289 (26m6.505091676s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:45.342492051 (26m8.571977398s) [upload=444]: Done uploading segments... Aug 27 18:04:45.342506197 (26m8.571991555s) [upload=444]: Upload finished. err: <nil> Duration:* 137.544833ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 26.788311ms target: https://us1.storj.io/login FAIL (2025-08-27 18:13:42 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 26.88921ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 449.258041ms FAIL (2025-08-27 18:13:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded Duration: 449.281786ms core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 11.829845ms target: https://us1.storj.io/login FAIL (2025-08-27 18:13:22 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 11.847378ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............................X..................XX...........] duration: 378.234634ms FAIL (2025-08-27 18:13:16 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments... Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment... Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment. Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments... Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces. Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments... Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil> Duration: 378.256607ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [........................X..............X.....XX..X..........] duration: 145.015469ms FAIL (2025-08-27 18:12:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 27 18:04:43.275353764 (26m6.504839141s) [upload=444]: Starting upload Aug 27 18:04:43.275413156 (26m6.504898532s) [upload=444]: Done starting upload Aug 27 18:04:43.275481715 (26m6.504967091s) [upload=444]: Uploading segments... Aug 27 18:04:43.275532750 (26m6.505018127s) [upload=444]: Got next segment. Inline: true Aug 27 18:04:43.275539142 (26m6.505024519s) [upload=444]: Waiting for error group managing segments... Aug 27 18:04:43.275591671 (26m6.505077049s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:04:43.275599667 (26m6.505085114s) [upload=444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 27 18:04:43.275606289 (26m6.505091676s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:45.342492051 (26m8.571977398s) [upload=444]: Done uploading segments... Aug 27 18:04:45.342506197 (26m8.571991555s) [upload=444]: Upload finished. err: <nil> Duration:* 145.036547ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............................X..................XX..........] duration: 520.022898ms FAIL (2025-08-27 18:12:44 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments... Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment... Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment. Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments... Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces. Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments... Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil> Duration: 520.043487ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 11.883465ms target: https://us1.storj.io/login FAIL (2025-08-27 18:12:17 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 11.911818ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 632.683721ms FAIL (2025-08-27 18:12:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded Duration: 632.705683ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............................X..................XX.........] duration: 572.31763ms FAIL (2025-08-27 18:11:59 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments... Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment... Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment. Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments... Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces. Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments... Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil> Duration: 572.337888ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.........................X..............X.....XX..X.........] duration: 147.31023ms FAIL (2025-08-27 18:11:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 27 18:04:43.275353764 (26m6.504839141s) [upload=444]: Starting upload Aug 27 18:04:43.275413156 (26m6.504898532s) [upload=444]: Done starting upload Aug 27 18:04:43.275481715 (26m6.504967091s) [upload=444]: Uploading segments... Aug 27 18:04:43.275532750 (26m6.505018127s) [upload=444]: Got next segment. Inline: true Aug 27 18:04:43.275539142 (26m6.505024519s) [upload=444]: Waiting for error group managing segments... Aug 27 18:04:43.275591671 (26m6.505077049s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:04:43.275599667 (26m6.505085114s) [upload=444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 27 18:04:43.275606289 (26m6.505091676s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:45.342492051 (26m8.571977398s) [upload=444]: Done uploading segments... Aug 27 18:04:45.342506197 (26m8.571991555s) [upload=444]: Upload finished. err: <nil> Duration:* 147.329245ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..........................X..............X.....XX..X........] duration: 12.506555699s FAIL (2025-08-27 18:11:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 27 18:04:43.275353764 (26m6.504839141s) [upload=444]: Starting upload Aug 27 18:04:43.275413156 (26m6.504898532s) [upload=444]: Done starting upload Aug 27 18:04:43.275481715 (26m6.504967091s) [upload=444]: Uploading segments... Aug 27 18:04:43.275532750 (26m6.505018127s) [upload=444]: Got next segment. Inline: true Aug 27 18:04:43.275539142 (26m6.505024519s) [upload=444]: Waiting for error group managing segments... Aug 27 18:04:43.275591671 (26m6.505077049s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:04:43.275599667 (26m6.505085114s) [upload=444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 27 18:04:43.275606289 (26m6.505091676s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:45.342492051 (26m8.571977398s) [upload=444]: Done uploading segments... Aug 27 18:04:45.342506197 (26m8.571991555s) [upload=444]: Upload finished. err: <nil> Duration:* 12.506579315s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 523.646137ms FAIL (2025-08-27 18:11:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded Duration: 523.663021ms core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 10.307063ms target: https://us1.storj.io/login FAIL (2025-08-27 18:11:22 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 10.321279ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...........................X..............X.....XX..X.......] duration: 30.129485477s FAIL (2025-08-27 18:10:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 27 18:04:43.275353764 (26m6.504839141s) [upload=444]: Starting upload Aug 27 18:04:43.275413156 (26m6.504898532s) [upload=444]: Done starting upload Aug 27 18:04:43.275481715 (26m6.504967091s) [upload=444]: Uploading segments... Aug 27 18:04:43.275532750 (26m6.505018127s) [upload=444]: Got next segment. Inline: true Aug 27 18:04:43.275539142 (26m6.505024519s) [upload=444]: Waiting for error group managing segments... Aug 27 18:04:43.275591671 (26m6.505077049s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:04:43.275599667 (26m6.505085114s) [upload=444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 27 18:04:43.275606289 (26m6.505091676s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:45.342492051 (26m8.571977398s) [upload=444]: Done uploading segments... Aug 27 18:04:45.342506197 (26m8.571991555s) [upload=444]: Upload finished. err: <nil> Duration:* 30.129511367s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............................X..................XX........] duration: 845.547904ms FAIL (2025-08-27 18:10:56 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments... Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment... Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment. Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments... Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces. Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments... Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil> Duration: 845.571007ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 411.346794ms FAIL (2025-08-27 18:10:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded Duration: 411.363045ms core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 14.677297ms target: https://us1.storj.io/login FAIL (2025-08-27 18:10:37 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 14.789638ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................................X..................XX.......] duration: 730.651887ms FAIL (2025-08-27 18:10:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments... Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment... Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment. Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments... Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces. Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments... Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil> Duration: 730.687073ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 12.429603ms target: https://us1.storj.io/login FAIL (2025-08-27 18:10:15 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 12.448648ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 13.320957ms target: https://us1.storj.io/login FAIL (2025-08-27 18:09:59 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 13.337749ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................................X..................XX......] duration: 766.077737ms FAIL (2025-08-27 18:09:53 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments... Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment... Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment. Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments... Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces. Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments... Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil> Duration: 766.106661ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [............................X..............X.....XX..X......] duration: 225.838541ms FAIL (2025-08-27 18:09:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 27 18:04:43.275353764 (26m6.504839141s) [upload=444]: Starting upload Aug 27 18:04:43.275413156 (26m6.504898532s) [upload=444]: Done starting upload Aug 27 18:04:43.275481715 (26m6.504967091s) [upload=444]: Uploading segments... Aug 27 18:04:43.275532750 (26m6.505018127s) [upload=444]: Got next segment. Inline: true Aug 27 18:04:43.275539142 (26m6.505024519s) [upload=444]: Waiting for error group managing segments... Aug 27 18:04:43.275591671 (26m6.505077049s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:04:43.275599667 (26m6.505085114s) [upload=444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 27 18:04:43.275606289 (26m6.505091676s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:45.342492051 (26m8.571977398s) [upload=444]: Done uploading segments... Aug 27 18:04:45.342506197 (26m8.571991555s) [upload=444]: Upload finished. err: <nil> Duration:* 225.862466ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 418.544843ms FAIL (2025-08-27 18:09:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded Duration: 418.59696ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................................X..................XX.....] duration: 457.316454ms FAIL (2025-08-27 18:08:47 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments... Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment... Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment. Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece... Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments... Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil> Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces. Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments... Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil> Duration: 457.332294ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.............................X..............X.....XX..X.....] duration: 325.897917ms FAIL (2025-08-27 18:08:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 27 18:04:43.275353764 (26m6.504839141s) [upload=444]: Starting upload Aug 27 18:04:43.275413156 (26m6.504898532s) [upload=444]: Done starting upload Aug 27 18:04:43.275481715 (26m6.504967091s) [upload=444]: Uploading segments... Aug 27 18:04:43.275532750 (26m6.505018127s) [upload=444]: Got next segment. Inline: true Aug 27 18:04:43.275539142 (26m6.505024519s) [upload=444]: Waiting for error group managing segments... Aug 27 18:04:43.275591671 (26m6.505077049s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:04:43.275599667 (26m6.505085114s) [upload=444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 27 18:04:43.275606289 (26m6.505091676s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:45.342492051 (26m8.571977398s) [upload=444]: Done uploading segments... Aug 27 18:04:45.342506197 (26m8.571991555s) [upload=444]: Upload finished. err: <nil> Duration:* 325.926853ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 12.4611ms target: https://us1.storj.io/login FAIL (2025-08-27 18:08:46 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 12.478392ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 420.001445ms FAIL (2025-08-27 18:08:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded Duration: 420.028274ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..............................X..............X.....XX..X....] duration: 309.598366ms FAIL (2025-08-27 18:08:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 27 18:04:43.275353764 (26m6.504839141s) [upload=444]: Starting upload Aug 27 18:04:43.275413156 (26m6.504898532s) [upload=444]: Done starting upload Aug 27 18:04:43.275481715 (26m6.504967091s) [upload=444]: Uploading segments... Aug 27 18:04:43.275532750 (26m6.505018127s) [upload=444]: Got next segment. Inline: true Aug 27 18:04:43.275539142 (26m6.505024519s) [upload=444]: Waiting for error group managing segments... Aug 27 18:04:43.275591671 (26m6.505077049s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 27 18:04:43.275599667 (26m6.505085114s) [upload=444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 27 18:04:43.275606289 (26m6.505091676s) [upload=444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 27 18:04:45.342492051 (26m8.571977398s) [upload=444]: Done uploading segments... Aug 27 18:04:45.342506197 (26m8.571991555s) [upload=444]: Upload finished. err: <nil> Duration:* 309.630005ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 14.9303ms target: https://us1.storj.io/login FAIL (2025-08-27 18:08:13 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 14.990314ms core satellite us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)