Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 662.666645ms FAIL (2025-10-17 12:18:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:07:48.648216951 (1173h59m24.00100206s) [upload=1033149]: Starting upload Oct 17 12:07:48.648267486 (1173h59m24.001052594s) [upload=1033149]: Done starting upload Oct 17 12:07:48.648320887 (1173h59m24.001105995s) [upload=1033149]: Uploading segments... Oct 17 12:07:48.648481989 (1173h59m24.001267086s) [upload=1033149]: Got next segment. Inline: false Oct 17 12:07:48.648522164 (1173h59m24.001307272s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:07:48.648525881 (1173h59m24.001310979s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 17 12:07:48.771343347 (1173h59m24.124128455s) [seg_pos={0 0}, upload=1033149]: Begin upload segment... Oct 17 12:07:48.771371670 (1173h59m24.124156778s) [seg_pos={0 0}, upload=1033149]: Done begin upload segment. Oct 17 12:07:48.771389273 (1173h59m24.124174381s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771444157 (1173h59m24.124229254s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771675410 (1173h59m24.124460508s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771708201 (1173h59m24.124493299s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771925270 (1173h59m24.124710368s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771942893 (1173h59m24.12472799s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772110787 (1173h59m24.124895886s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772166652 (1173h59m24.12495176s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772290385 (1173h59m24.125075482s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772389611 (1173h59m24.125174719s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772479820 (1173h59m24.125264917s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772661510 (1173h59m24.125446608s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772670538 (1173h59m24.125455646s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772924384 (1173h59m24.125709492s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773170456 (1173h59m24.125955564s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773423941 (1173h59m24.126209049s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.858880232 (1173h59m24.21166532s) [upload=1033149]: Next returned nil segment Oct 17 12:07:48.858889830 (1173h59m24.211674928s) [upload=1033149]: Waiting for error group managing segments... Oct 17 12:07:48.867518371 (1173h59m24.220303469s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868096285 (1173h59m24.220881384s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868380870 (1173h59m24.221165978s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868460589 (1173h59m24.221245687s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868830242 (1173h59m24.221615341s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868848998 (1173h59m24.221634116s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.876704909 (1173h59m24.229490027s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.878550432 (1173h59m24.23133554s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.880671260 (1173h59m24.233456379s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.883113394 (1173h59m24.235898502s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.886463640 (1173h59m24.239248738s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.890006969 (1173h59m24.242792077s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897452971 (1173h59m24.250238079s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897473148 (1173h59m24.250258256s) [seg_pos={0 0}, upload=1033149]: Segment reached optimal threshold of 13 pieces. Oct 17 12:07:48.897575080 (1173h59m24.250360188s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.897763483 (1173h59m24.250548591s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection Oct 17 12:07:48.897962827 (1173h59m24.250747955s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.898010997 (1173h59m24.250796126s) [seg_pos={0 0}, upload=1033149]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 17 12:07:48.898104513 (1173h59m24.250889641s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 17 12:07:48.898110303 (1173h59m24.250895442s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:08:25.738501887 (1174h0m1.091287024s) [upload=1033149]: Done uploading segments... Oct 17 12:08:25.738547021 (1174h0m1.09133216s) [upload=1033149]: Upload finished. err: metaclient: context deadline exceeded Duration: 662.701741ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 487.253257ms FAIL (2025-10-17 12:18:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:06:29.719541347 (1173h58m5.072326475s) [upload=1033130]: Starting upload Oct 17 12:06:29.719672092 (1173h58m5.072457231s) [upload=1033130]: Done starting upload Oct 17 12:06:29.719786067 (1173h58m5.072571196s) [upload=1033130]: Uploading segments... Oct 17 12:06:29.719859776 (1173h58m5.072644913s) [upload=1033130]: Got next segment. Inline: true Oct 17 12:06:29.719869343 (1173h58m5.072654482s) [upload=1033130]: Waiting for error group managing segments... Oct 17 12:06:29.720000680 (1173h58m5.072785818s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:06:29.720012883 (1173h58m5.072798021s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 17 12:06:29.720019315 (1173h58m5.072804453s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:06:59.703230017 (1173h58m35.056015135s) [upload=1033130]: Done uploading segments... Oct 17 12:06:59.703265354 (1173h58m35.056050462s) [upload=1033130]: Upload finished. err: metaclient: context deadline exceeded Duration:* 487.269598ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X.......X............] duration: 274.260865ms FAIL (2025-10-17 12:18:25 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 274.285111ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [............................................X..X............] duration: 347.238531ms FAIL (2025-10-17 12:18:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:09:24.758354060 (1174h1m0.111139157s) [upload=1033173]: Starting upload Oct 17 12:09:24.758423911 (1174h1m0.111209008s) [upload=1033173]: Done starting upload Oct 17 12:09:24.758482571 (1174h1m0.11126767s) [upload=1033173]: Uploading segments... Oct 17 12:09:24.758513760 (1174h1m0.111298868s) [upload=1033173]: Got next segment. Inline: true Oct 17 12:09:24.758518650 (1174h1m0.111303747s) [upload=1033173]: Waiting for error group managing segments... Oct 17 12:09:24.758557622 (1174h1m0.11134272s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:09:24.758561931 (1174h1m0.111347028s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 17 12:09:24.758566238 (1174h1m0.111351337s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:10:24.741474923 (1174h2m0.094260061s) [upload=1033173]: Done uploading segments... Oct 17 12:10:24.741494339 (1174h2m0.094279467s) [upload=1033173]: Upload finished. err: metaclient: context deadline exceeded Duration:* 347.257959ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................X........X................] duration: 2.373069502s FAIL (2025-10-17 12:18:05 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.37315349s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 715.713162ms FAIL (2025-10-17 12:18:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:07:48.648216951 (1173h59m24.00100206s) [upload=1033149]: Starting upload Oct 17 12:07:48.648267486 (1173h59m24.001052594s) [upload=1033149]: Done starting upload Oct 17 12:07:48.648320887 (1173h59m24.001105995s) [upload=1033149]: Uploading segments... Oct 17 12:07:48.648481989 (1173h59m24.001267086s) [upload=1033149]: Got next segment. Inline: false Oct 17 12:07:48.648522164 (1173h59m24.001307272s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:07:48.648525881 (1173h59m24.001310979s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 17 12:07:48.771343347 (1173h59m24.124128455s) [seg_pos={0 0}, upload=1033149]: Begin upload segment... Oct 17 12:07:48.771371670 (1173h59m24.124156778s) [seg_pos={0 0}, upload=1033149]: Done begin upload segment. Oct 17 12:07:48.771389273 (1173h59m24.124174381s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771444157 (1173h59m24.124229254s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771675410 (1173h59m24.124460508s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771708201 (1173h59m24.124493299s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771925270 (1173h59m24.124710368s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771942893 (1173h59m24.12472799s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772110787 (1173h59m24.124895886s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772166652 (1173h59m24.12495176s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772290385 (1173h59m24.125075482s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772389611 (1173h59m24.125174719s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772479820 (1173h59m24.125264917s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772661510 (1173h59m24.125446608s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772670538 (1173h59m24.125455646s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772924384 (1173h59m24.125709492s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773170456 (1173h59m24.125955564s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773423941 (1173h59m24.126209049s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.858880232 (1173h59m24.21166532s) [upload=1033149]: Next returned nil segment Oct 17 12:07:48.858889830 (1173h59m24.211674928s) [upload=1033149]: Waiting for error group managing segments... Oct 17 12:07:48.867518371 (1173h59m24.220303469s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868096285 (1173h59m24.220881384s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868380870 (1173h59m24.221165978s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868460589 (1173h59m24.221245687s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868830242 (1173h59m24.221615341s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868848998 (1173h59m24.221634116s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.876704909 (1173h59m24.229490027s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.878550432 (1173h59m24.23133554s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.880671260 (1173h59m24.233456379s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.883113394 (1173h59m24.235898502s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.886463640 (1173h59m24.239248738s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.890006969 (1173h59m24.242792077s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897452971 (1173h59m24.250238079s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897473148 (1173h59m24.250258256s) [seg_pos={0 0}, upload=1033149]: Segment reached optimal threshold of 13 pieces. Oct 17 12:07:48.897575080 (1173h59m24.250360188s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.897763483 (1173h59m24.250548591s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection Oct 17 12:07:48.897962827 (1173h59m24.250747955s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.898010997 (1173h59m24.250796126s) [seg_pos={0 0}, upload=1033149]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 17 12:07:48.898104513 (1173h59m24.250889641s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 17 12:07:48.898110303 (1173h59m24.250895442s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:08:25.738501887 (1174h0m1.091287024s) [upload=1033149]: Done uploading segments... Oct 17 12:08:25.738547021 (1174h0m1.09133216s) [upload=1033149]: Upload finished. err: metaclient: context deadline exceeded Duration: 715.747656ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............................................X..X...........] duration: 239.990531ms FAIL (2025-10-17 12:17:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:09:24.758354060 (1174h1m0.111139157s) [upload=1033173]: Starting upload Oct 17 12:09:24.758423911 (1174h1m0.111209008s) [upload=1033173]: Done starting upload Oct 17 12:09:24.758482571 (1174h1m0.11126767s) [upload=1033173]: Uploading segments... Oct 17 12:09:24.758513760 (1174h1m0.111298868s) [upload=1033173]: Got next segment. Inline: true Oct 17 12:09:24.758518650 (1174h1m0.111303747s) [upload=1033173]: Waiting for error group managing segments... Oct 17 12:09:24.758557622 (1174h1m0.11134272s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:09:24.758561931 (1174h1m0.111347028s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 17 12:09:24.758566238 (1174h1m0.111351337s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:10:24.741474923 (1174h2m0.094260061s) [upload=1033173]: Done uploading segments... Oct 17 12:10:24.741494339 (1174h2m0.094279467s) [upload=1033173]: Upload finished. err: metaclient: context deadline exceeded Duration:* 240.013683ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 497.909101ms FAIL (2025-10-17 12:17:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:07:48.648216951 (1173h59m24.00100206s) [upload=1033149]: Starting upload Oct 17 12:07:48.648267486 (1173h59m24.001052594s) [upload=1033149]: Done starting upload Oct 17 12:07:48.648320887 (1173h59m24.001105995s) [upload=1033149]: Uploading segments... Oct 17 12:07:48.648481989 (1173h59m24.001267086s) [upload=1033149]: Got next segment. Inline: false Oct 17 12:07:48.648522164 (1173h59m24.001307272s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:07:48.648525881 (1173h59m24.001310979s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 17 12:07:48.771343347 (1173h59m24.124128455s) [seg_pos={0 0}, upload=1033149]: Begin upload segment... Oct 17 12:07:48.771371670 (1173h59m24.124156778s) [seg_pos={0 0}, upload=1033149]: Done begin upload segment. Oct 17 12:07:48.771389273 (1173h59m24.124174381s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771444157 (1173h59m24.124229254s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771675410 (1173h59m24.124460508s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771708201 (1173h59m24.124493299s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771925270 (1173h59m24.124710368s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771942893 (1173h59m24.12472799s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772110787 (1173h59m24.124895886s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772166652 (1173h59m24.12495176s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772290385 (1173h59m24.125075482s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772389611 (1173h59m24.125174719s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772479820 (1173h59m24.125264917s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772661510 (1173h59m24.125446608s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772670538 (1173h59m24.125455646s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772924384 (1173h59m24.125709492s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773170456 (1173h59m24.125955564s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773423941 (1173h59m24.126209049s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.858880232 (1173h59m24.21166532s) [upload=1033149]: Next returned nil segment Oct 17 12:07:48.858889830 (1173h59m24.211674928s) [upload=1033149]: Waiting for error group managing segments... Oct 17 12:07:48.867518371 (1173h59m24.220303469s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868096285 (1173h59m24.220881384s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868380870 (1173h59m24.221165978s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868460589 (1173h59m24.221245687s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868830242 (1173h59m24.221615341s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868848998 (1173h59m24.221634116s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.876704909 (1173h59m24.229490027s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.878550432 (1173h59m24.23133554s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.880671260 (1173h59m24.233456379s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.883113394 (1173h59m24.235898502s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.886463640 (1173h59m24.239248738s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.890006969 (1173h59m24.242792077s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897452971 (1173h59m24.250238079s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897473148 (1173h59m24.250258256s) [seg_pos={0 0}, upload=1033149]: Segment reached optimal threshold of 13 pieces. Oct 17 12:07:48.897575080 (1173h59m24.250360188s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.897763483 (1173h59m24.250548591s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection Oct 17 12:07:48.897962827 (1173h59m24.250747955s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.898010997 (1173h59m24.250796126s) [seg_pos={0 0}, upload=1033149]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 17 12:07:48.898104513 (1173h59m24.250889641s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 17 12:07:48.898110303 (1173h59m24.250895442s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:08:25.738501887 (1174h0m1.091287024s) [upload=1033149]: Done uploading segments... Oct 17 12:08:25.738547021 (1174h0m1.09133216s) [upload=1033149]: Upload finished. err: metaclient: context deadline exceeded Duration: 497.928748ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................X........X...............] duration: 2.082068676s FAIL (2025-10-17 12:17:40 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.082094726s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 305.271405ms FAIL (2025-10-17 12:17:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:06:29.719541347 (1173h58m5.072326475s) [upload=1033130]: Starting upload Oct 17 12:06:29.719672092 (1173h58m5.072457231s) [upload=1033130]: Done starting upload Oct 17 12:06:29.719786067 (1173h58m5.072571196s) [upload=1033130]: Uploading segments... Oct 17 12:06:29.719859776 (1173h58m5.072644913s) [upload=1033130]: Got next segment. Inline: true Oct 17 12:06:29.719869343 (1173h58m5.072654482s) [upload=1033130]: Waiting for error group managing segments... Oct 17 12:06:29.720000680 (1173h58m5.072785818s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:06:29.720012883 (1173h58m5.072798021s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 17 12:06:29.720019315 (1173h58m5.072804453s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:06:59.703230017 (1173h58m35.056015135s) [upload=1033130]: Done uploading segments... Oct 17 12:06:59.703265354 (1173h58m35.056050462s) [upload=1033130]: Upload finished. err: metaclient: context deadline exceeded Duration:* 305.29036ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................................X.......X...........] duration: 482.182173ms FAIL (2025-10-17 12:17:32 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 482.199917ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............................................X..X..........] duration: 516.468647ms FAIL (2025-10-17 12:17:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:09:24.758354060 (1174h1m0.111139157s) [upload=1033173]: Starting upload Oct 17 12:09:24.758423911 (1174h1m0.111209008s) [upload=1033173]: Done starting upload Oct 17 12:09:24.758482571 (1174h1m0.11126767s) [upload=1033173]: Uploading segments... Oct 17 12:09:24.758513760 (1174h1m0.111298868s) [upload=1033173]: Got next segment. Inline: true Oct 17 12:09:24.758518650 (1174h1m0.111303747s) [upload=1033173]: Waiting for error group managing segments... Oct 17 12:09:24.758557622 (1174h1m0.11134272s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:09:24.758561931 (1174h1m0.111347028s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 17 12:09:24.758566238 (1174h1m0.111351337s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:10:24.741474923 (1174h2m0.094260061s) [upload=1033173]: Done uploading segments... Oct 17 12:10:24.741494339 (1174h2m0.094279467s) [upload=1033173]: Upload finished. err: metaclient: context deadline exceeded Duration:* 516.49708ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................X........X..............] duration: 2.375001425s FAIL (2025-10-17 12:17:07 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.375023776s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 800.93854ms FAIL (2025-10-17 12:17:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:07:48.648216951 (1173h59m24.00100206s) [upload=1033149]: Starting upload Oct 17 12:07:48.648267486 (1173h59m24.001052594s) [upload=1033149]: Done starting upload Oct 17 12:07:48.648320887 (1173h59m24.001105995s) [upload=1033149]: Uploading segments... Oct 17 12:07:48.648481989 (1173h59m24.001267086s) [upload=1033149]: Got next segment. Inline: false Oct 17 12:07:48.648522164 (1173h59m24.001307272s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:07:48.648525881 (1173h59m24.001310979s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 17 12:07:48.771343347 (1173h59m24.124128455s) [seg_pos={0 0}, upload=1033149]: Begin upload segment... Oct 17 12:07:48.771371670 (1173h59m24.124156778s) [seg_pos={0 0}, upload=1033149]: Done begin upload segment. Oct 17 12:07:48.771389273 (1173h59m24.124174381s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771444157 (1173h59m24.124229254s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771675410 (1173h59m24.124460508s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771708201 (1173h59m24.124493299s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771925270 (1173h59m24.124710368s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771942893 (1173h59m24.12472799s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772110787 (1173h59m24.124895886s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772166652 (1173h59m24.12495176s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772290385 (1173h59m24.125075482s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772389611 (1173h59m24.125174719s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772479820 (1173h59m24.125264917s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772661510 (1173h59m24.125446608s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772670538 (1173h59m24.125455646s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772924384 (1173h59m24.125709492s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773170456 (1173h59m24.125955564s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773423941 (1173h59m24.126209049s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.858880232 (1173h59m24.21166532s) [upload=1033149]: Next returned nil segment Oct 17 12:07:48.858889830 (1173h59m24.211674928s) [upload=1033149]: Waiting for error group managing segments... Oct 17 12:07:48.867518371 (1173h59m24.220303469s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868096285 (1173h59m24.220881384s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868380870 (1173h59m24.221165978s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868460589 (1173h59m24.221245687s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868830242 (1173h59m24.221615341s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868848998 (1173h59m24.221634116s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.876704909 (1173h59m24.229490027s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.878550432 (1173h59m24.23133554s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.880671260 (1173h59m24.233456379s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.883113394 (1173h59m24.235898502s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.886463640 (1173h59m24.239248738s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.890006969 (1173h59m24.242792077s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897452971 (1173h59m24.250238079s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897473148 (1173h59m24.250258256s) [seg_pos={0 0}, upload=1033149]: Segment reached optimal threshold of 13 pieces. Oct 17 12:07:48.897575080 (1173h59m24.250360188s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.897763483 (1173h59m24.250548591s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection Oct 17 12:07:48.897962827 (1173h59m24.250747955s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.898010997 (1173h59m24.250796126s) [seg_pos={0 0}, upload=1033149]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 17 12:07:48.898104513 (1173h59m24.250889641s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 17 12:07:48.898110303 (1173h59m24.250895442s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:08:25.738501887 (1174h0m1.091287024s) [upload=1033149]: Done uploading segments... Oct 17 12:08:25.738547021 (1174h0m1.09133216s) [upload=1033149]: Upload finished. err: metaclient: context deadline exceeded Duration: 800.958467ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X........X.............] duration: 2.085310689s FAIL (2025-10-17 12:16:43 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.085340244s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X.......X..........] duration: 236.720564ms FAIL (2025-10-17 12:16:43 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 236.736134ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 532.981583ms FAIL (2025-10-17 12:16:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:07:48.648216951 (1173h59m24.00100206s) [upload=1033149]: Starting upload Oct 17 12:07:48.648267486 (1173h59m24.001052594s) [upload=1033149]: Done starting upload Oct 17 12:07:48.648320887 (1173h59m24.001105995s) [upload=1033149]: Uploading segments... Oct 17 12:07:48.648481989 (1173h59m24.001267086s) [upload=1033149]: Got next segment. Inline: false Oct 17 12:07:48.648522164 (1173h59m24.001307272s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:07:48.648525881 (1173h59m24.001310979s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 17 12:07:48.771343347 (1173h59m24.124128455s) [seg_pos={0 0}, upload=1033149]: Begin upload segment... Oct 17 12:07:48.771371670 (1173h59m24.124156778s) [seg_pos={0 0}, upload=1033149]: Done begin upload segment. Oct 17 12:07:48.771389273 (1173h59m24.124174381s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771444157 (1173h59m24.124229254s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771675410 (1173h59m24.124460508s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771708201 (1173h59m24.124493299s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771925270 (1173h59m24.124710368s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771942893 (1173h59m24.12472799s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772110787 (1173h59m24.124895886s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772166652 (1173h59m24.12495176s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772290385 (1173h59m24.125075482s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772389611 (1173h59m24.125174719s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772479820 (1173h59m24.125264917s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772661510 (1173h59m24.125446608s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772670538 (1173h59m24.125455646s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772924384 (1173h59m24.125709492s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773170456 (1173h59m24.125955564s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773423941 (1173h59m24.126209049s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.858880232 (1173h59m24.21166532s) [upload=1033149]: Next returned nil segment Oct 17 12:07:48.858889830 (1173h59m24.211674928s) [upload=1033149]: Waiting for error group managing segments... Oct 17 12:07:48.867518371 (1173h59m24.220303469s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868096285 (1173h59m24.220881384s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868380870 (1173h59m24.221165978s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868460589 (1173h59m24.221245687s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868830242 (1173h59m24.221615341s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868848998 (1173h59m24.221634116s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.876704909 (1173h59m24.229490027s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.878550432 (1173h59m24.23133554s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.880671260 (1173h59m24.233456379s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.883113394 (1173h59m24.235898502s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.886463640 (1173h59m24.239248738s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.890006969 (1173h59m24.242792077s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897452971 (1173h59m24.250238079s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897473148 (1173h59m24.250258256s) [seg_pos={0 0}, upload=1033149]: Segment reached optimal threshold of 13 pieces. Oct 17 12:07:48.897575080 (1173h59m24.250360188s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.897763483 (1173h59m24.250548591s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection Oct 17 12:07:48.897962827 (1173h59m24.250747955s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.898010997 (1173h59m24.250796126s) [seg_pos={0 0}, upload=1033149]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 17 12:07:48.898104513 (1173h59m24.250889641s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 17 12:07:48.898110303 (1173h59m24.250895442s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:08:25.738501887 (1174h0m1.091287024s) [upload=1033149]: Done uploading segments... Oct 17 12:08:25.738547021 (1174h0m1.09133216s) [upload=1033149]: Upload finished. err: metaclient: context deadline exceeded Duration: 533.001351ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............................................X..X.........] duration: 479.179767ms FAIL (2025-10-17 12:16:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:09:24.758354060 (1174h1m0.111139157s) [upload=1033173]: Starting upload Oct 17 12:09:24.758423911 (1174h1m0.111209008s) [upload=1033173]: Done starting upload Oct 17 12:09:24.758482571 (1174h1m0.11126767s) [upload=1033173]: Uploading segments... Oct 17 12:09:24.758513760 (1174h1m0.111298868s) [upload=1033173]: Got next segment. Inline: true Oct 17 12:09:24.758518650 (1174h1m0.111303747s) [upload=1033173]: Waiting for error group managing segments... Oct 17 12:09:24.758557622 (1174h1m0.11134272s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:09:24.758561931 (1174h1m0.111347028s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 17 12:09:24.758566238 (1174h1m0.111351337s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:10:24.741474923 (1174h2m0.094260061s) [upload=1033173]: Done uploading segments... Oct 17 12:10:24.741494339 (1174h2m0.094279467s) [upload=1033173]: Upload finished. err: metaclient: context deadline exceeded Duration:* 479.20229ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 374.308034ms FAIL (2025-10-17 12:16:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:06:29.719541347 (1173h58m5.072326475s) [upload=1033130]: Starting upload Oct 17 12:06:29.719672092 (1173h58m5.072457231s) [upload=1033130]: Done starting upload Oct 17 12:06:29.719786067 (1173h58m5.072571196s) [upload=1033130]: Uploading segments... Oct 17 12:06:29.719859776 (1173h58m5.072644913s) [upload=1033130]: Got next segment. Inline: true Oct 17 12:06:29.719869343 (1173h58m5.072654482s) [upload=1033130]: Waiting for error group managing segments... Oct 17 12:06:29.720000680 (1173h58m5.072785818s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:06:29.720012883 (1173h58m5.072798021s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 17 12:06:29.720019315 (1173h58m5.072804453s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:06:59.703230017 (1173h58m35.056015135s) [upload=1033130]: Done uploading segments... Oct 17 12:06:59.703265354 (1173h58m35.056050462s) [upload=1033130]: Upload finished. err: metaclient: context deadline exceeded Duration:* 374.328683ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 536.438681ms FAIL (2025-10-17 12:16:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:07:48.648216951 (1173h59m24.00100206s) [upload=1033149]: Starting upload Oct 17 12:07:48.648267486 (1173h59m24.001052594s) [upload=1033149]: Done starting upload Oct 17 12:07:48.648320887 (1173h59m24.001105995s) [upload=1033149]: Uploading segments... Oct 17 12:07:48.648481989 (1173h59m24.001267086s) [upload=1033149]: Got next segment. Inline: false Oct 17 12:07:48.648522164 (1173h59m24.001307272s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:07:48.648525881 (1173h59m24.001310979s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 17 12:07:48.771343347 (1173h59m24.124128455s) [seg_pos={0 0}, upload=1033149]: Begin upload segment... Oct 17 12:07:48.771371670 (1173h59m24.124156778s) [seg_pos={0 0}, upload=1033149]: Done begin upload segment. Oct 17 12:07:48.771389273 (1173h59m24.124174381s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771444157 (1173h59m24.124229254s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771675410 (1173h59m24.124460508s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771708201 (1173h59m24.124493299s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771925270 (1173h59m24.124710368s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771942893 (1173h59m24.12472799s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772110787 (1173h59m24.124895886s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772166652 (1173h59m24.12495176s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772290385 (1173h59m24.125075482s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772389611 (1173h59m24.125174719s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772479820 (1173h59m24.125264917s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772661510 (1173h59m24.125446608s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772670538 (1173h59m24.125455646s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772924384 (1173h59m24.125709492s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773170456 (1173h59m24.125955564s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773423941 (1173h59m24.126209049s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.858880232 (1173h59m24.21166532s) [upload=1033149]: Next returned nil segment Oct 17 12:07:48.858889830 (1173h59m24.211674928s) [upload=1033149]: Waiting for error group managing segments... Oct 17 12:07:48.867518371 (1173h59m24.220303469s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868096285 (1173h59m24.220881384s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868380870 (1173h59m24.221165978s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868460589 (1173h59m24.221245687s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868830242 (1173h59m24.221615341s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868848998 (1173h59m24.221634116s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.876704909 (1173h59m24.229490027s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.878550432 (1173h59m24.23133554s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.880671260 (1173h59m24.233456379s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.883113394 (1173h59m24.235898502s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.886463640 (1173h59m24.239248738s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.890006969 (1173h59m24.242792077s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897452971 (1173h59m24.250238079s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897473148 (1173h59m24.250258256s) [seg_pos={0 0}, upload=1033149]: Segment reached optimal threshold of 13 pieces. Oct 17 12:07:48.897575080 (1173h59m24.250360188s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.897763483 (1173h59m24.250548591s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection Oct 17 12:07:48.897962827 (1173h59m24.250747955s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.898010997 (1173h59m24.250796126s) [seg_pos={0 0}, upload=1033149]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 17 12:07:48.898104513 (1173h59m24.250889641s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 17 12:07:48.898110303 (1173h59m24.250895442s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:08:25.738501887 (1174h0m1.091287024s) [upload=1033149]: Done uploading segments... Oct 17 12:08:25.738547021 (1174h0m1.09133216s) [upload=1033149]: Upload finished. err: metaclient: context deadline exceeded Duration: 536.464519ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................X........X............] duration: 1.912380814s FAIL (2025-10-17 12:16:13 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.912403056s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 259.591693ms FAIL (2025-10-17 12:16:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:06:29.719541347 (1173h58m5.072326475s) [upload=1033130]: Starting upload Oct 17 12:06:29.719672092 (1173h58m5.072457231s) [upload=1033130]: Done starting upload Oct 17 12:06:29.719786067 (1173h58m5.072571196s) [upload=1033130]: Uploading segments... Oct 17 12:06:29.719859776 (1173h58m5.072644913s) [upload=1033130]: Got next segment. Inline: true Oct 17 12:06:29.719869343 (1173h58m5.072654482s) [upload=1033130]: Waiting for error group managing segments... Oct 17 12:06:29.720000680 (1173h58m5.072785818s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:06:29.720012883 (1173h58m5.072798021s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 17 12:06:29.720019315 (1173h58m5.072804453s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:06:59.703230017 (1173h58m35.056015135s) [upload=1033130]: Done uploading segments... Oct 17 12:06:59.703265354 (1173h58m35.056050462s) [upload=1033130]: Upload finished. err: metaclient: context deadline exceeded Duration:* 259.611579ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X.......X.........] duration: 225.484782ms FAIL (2025-10-17 12:16:05 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 225.50482ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X........X...........] duration: 1.887162521s FAIL (2025-10-17 12:15:22 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.887186486s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [................................................X..X........] duration: 243.362056ms FAIL (2025-10-17 12:15:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:09:24.758354060 (1174h1m0.111139157s) [upload=1033173]: Starting upload Oct 17 12:09:24.758423911 (1174h1m0.111209008s) [upload=1033173]: Done starting upload Oct 17 12:09:24.758482571 (1174h1m0.11126767s) [upload=1033173]: Uploading segments... Oct 17 12:09:24.758513760 (1174h1m0.111298868s) [upload=1033173]: Got next segment. Inline: true Oct 17 12:09:24.758518650 (1174h1m0.111303747s) [upload=1033173]: Waiting for error group managing segments... Oct 17 12:09:24.758557622 (1174h1m0.11134272s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:09:24.758561931 (1174h1m0.111347028s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 17 12:09:24.758566238 (1174h1m0.111351337s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:10:24.741474923 (1174h2m0.094260061s) [upload=1033173]: Done uploading segments... Oct 17 12:10:24.741494339 (1174h2m0.094279467s) [upload=1033173]: Upload finished. err: metaclient: context deadline exceeded Duration:* 243.382334ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 837.600543ms FAIL (2025-10-17 12:15:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:07:48.648216951 (1173h59m24.00100206s) [upload=1033149]: Starting upload Oct 17 12:07:48.648267486 (1173h59m24.001052594s) [upload=1033149]: Done starting upload Oct 17 12:07:48.648320887 (1173h59m24.001105995s) [upload=1033149]: Uploading segments... Oct 17 12:07:48.648481989 (1173h59m24.001267086s) [upload=1033149]: Got next segment. Inline: false Oct 17 12:07:48.648522164 (1173h59m24.001307272s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:07:48.648525881 (1173h59m24.001310979s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 17 12:07:48.771343347 (1173h59m24.124128455s) [seg_pos={0 0}, upload=1033149]: Begin upload segment... Oct 17 12:07:48.771371670 (1173h59m24.124156778s) [seg_pos={0 0}, upload=1033149]: Done begin upload segment. Oct 17 12:07:48.771389273 (1173h59m24.124174381s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771444157 (1173h59m24.124229254s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771675410 (1173h59m24.124460508s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771708201 (1173h59m24.124493299s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771925270 (1173h59m24.124710368s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771942893 (1173h59m24.12472799s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772110787 (1173h59m24.124895886s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772166652 (1173h59m24.12495176s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772290385 (1173h59m24.125075482s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772389611 (1173h59m24.125174719s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772479820 (1173h59m24.125264917s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772661510 (1173h59m24.125446608s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772670538 (1173h59m24.125455646s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772924384 (1173h59m24.125709492s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773170456 (1173h59m24.125955564s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773423941 (1173h59m24.126209049s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.858880232 (1173h59m24.21166532s) [upload=1033149]: Next returned nil segment Oct 17 12:07:48.858889830 (1173h59m24.211674928s) [upload=1033149]: Waiting for error group managing segments... Oct 17 12:07:48.867518371 (1173h59m24.220303469s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868096285 (1173h59m24.220881384s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868380870 (1173h59m24.221165978s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868460589 (1173h59m24.221245687s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868830242 (1173h59m24.221615341s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868848998 (1173h59m24.221634116s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.876704909 (1173h59m24.229490027s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.878550432 (1173h59m24.23133554s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.880671260 (1173h59m24.233456379s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.883113394 (1173h59m24.235898502s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.886463640 (1173h59m24.239248738s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.890006969 (1173h59m24.242792077s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897452971 (1173h59m24.250238079s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897473148 (1173h59m24.250258256s) [seg_pos={0 0}, upload=1033149]: Segment reached optimal threshold of 13 pieces. Oct 17 12:07:48.897575080 (1173h59m24.250360188s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.897763483 (1173h59m24.250548591s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection Oct 17 12:07:48.897962827 (1173h59m24.250747955s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.898010997 (1173h59m24.250796126s) [seg_pos={0 0}, upload=1033149]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 17 12:07:48.898104513 (1173h59m24.250889641s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 17 12:07:48.898110303 (1173h59m24.250895442s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:08:25.738501887 (1174h0m1.091287024s) [upload=1033149]: Done uploading segments... Oct 17 12:08:25.738547021 (1174h0m1.09133216s) [upload=1033149]: Upload finished. err: metaclient: context deadline exceeded Duration: 837.624037ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................X........X..........] duration: 1.939503134s FAIL (2025-10-17 12:15:06 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.939518842s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X.......X........] duration: 295.412534ms FAIL (2025-10-17 12:15:05 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 295.42653ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 306.79774ms FAIL (2025-10-17 12:15:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:06:29.719541347 (1173h58m5.072326475s) [upload=1033130]: Starting upload Oct 17 12:06:29.719672092 (1173h58m5.072457231s) [upload=1033130]: Done starting upload Oct 17 12:06:29.719786067 (1173h58m5.072571196s) [upload=1033130]: Uploading segments... Oct 17 12:06:29.719859776 (1173h58m5.072644913s) [upload=1033130]: Got next segment. Inline: true Oct 17 12:06:29.719869343 (1173h58m5.072654482s) [upload=1033130]: Waiting for error group managing segments... Oct 17 12:06:29.720000680 (1173h58m5.072785818s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:06:29.720012883 (1173h58m5.072798021s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 17 12:06:29.720019315 (1173h58m5.072804453s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:06:59.703230017 (1173h58m35.056015135s) [upload=1033130]: Done uploading segments... Oct 17 12:06:59.703265354 (1173h58m35.056050462s) [upload=1033130]: Upload finished. err: metaclient: context deadline exceeded Duration:* 306.818829ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 802.240251ms FAIL (2025-10-17 12:15:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:07:48.648216951 (1173h59m24.00100206s) [upload=1033149]: Starting upload Oct 17 12:07:48.648267486 (1173h59m24.001052594s) [upload=1033149]: Done starting upload Oct 17 12:07:48.648320887 (1173h59m24.001105995s) [upload=1033149]: Uploading segments... Oct 17 12:07:48.648481989 (1173h59m24.001267086s) [upload=1033149]: Got next segment. Inline: false Oct 17 12:07:48.648522164 (1173h59m24.001307272s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:07:48.648525881 (1173h59m24.001310979s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 17 12:07:48.771343347 (1173h59m24.124128455s) [seg_pos={0 0}, upload=1033149]: Begin upload segment... Oct 17 12:07:48.771371670 (1173h59m24.124156778s) [seg_pos={0 0}, upload=1033149]: Done begin upload segment. Oct 17 12:07:48.771389273 (1173h59m24.124174381s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771444157 (1173h59m24.124229254s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771675410 (1173h59m24.124460508s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771708201 (1173h59m24.124493299s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771925270 (1173h59m24.124710368s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771942893 (1173h59m24.12472799s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772110787 (1173h59m24.124895886s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772166652 (1173h59m24.12495176s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772290385 (1173h59m24.125075482s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772389611 (1173h59m24.125174719s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772479820 (1173h59m24.125264917s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772661510 (1173h59m24.125446608s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772670538 (1173h59m24.125455646s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772924384 (1173h59m24.125709492s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773170456 (1173h59m24.125955564s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773423941 (1173h59m24.126209049s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.858880232 (1173h59m24.21166532s) [upload=1033149]: Next returned nil segment Oct 17 12:07:48.858889830 (1173h59m24.211674928s) [upload=1033149]: Waiting for error group managing segments... Oct 17 12:07:48.867518371 (1173h59m24.220303469s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868096285 (1173h59m24.220881384s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868380870 (1173h59m24.221165978s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868460589 (1173h59m24.221245687s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868830242 (1173h59m24.221615341s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868848998 (1173h59m24.221634116s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.876704909 (1173h59m24.229490027s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.878550432 (1173h59m24.23133554s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.880671260 (1173h59m24.233456379s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.883113394 (1173h59m24.235898502s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.886463640 (1173h59m24.239248738s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.890006969 (1173h59m24.242792077s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897452971 (1173h59m24.250238079s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897473148 (1173h59m24.250258256s) [seg_pos={0 0}, upload=1033149]: Segment reached optimal threshold of 13 pieces. Oct 17 12:07:48.897575080 (1173h59m24.250360188s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.897763483 (1173h59m24.250548591s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection Oct 17 12:07:48.897962827 (1173h59m24.250747955s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.898010997 (1173h59m24.250796126s) [seg_pos={0 0}, upload=1033149]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 17 12:07:48.898104513 (1173h59m24.250889641s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 17 12:07:48.898110303 (1173h59m24.250895442s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:08:25.738501887 (1174h0m1.091287024s) [upload=1033149]: Done uploading segments... Oct 17 12:08:25.738547021 (1174h0m1.09133216s) [upload=1033149]: Upload finished. err: metaclient: context deadline exceeded Duration: 802.26613ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................................................X..X.......] duration: 310.224949ms FAIL (2025-10-17 12:14:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:09:24.758354060 (1174h1m0.111139157s) [upload=1033173]: Starting upload Oct 17 12:09:24.758423911 (1174h1m0.111209008s) [upload=1033173]: Done starting upload Oct 17 12:09:24.758482571 (1174h1m0.11126767s) [upload=1033173]: Uploading segments... Oct 17 12:09:24.758513760 (1174h1m0.111298868s) [upload=1033173]: Got next segment. Inline: true Oct 17 12:09:24.758518650 (1174h1m0.111303747s) [upload=1033173]: Waiting for error group managing segments... Oct 17 12:09:24.758557622 (1174h1m0.11134272s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:09:24.758561931 (1174h1m0.111347028s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 17 12:09:24.758566238 (1174h1m0.111351337s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:10:24.741474923 (1174h2m0.094260061s) [upload=1033173]: Done uploading segments... Oct 17 12:10:24.741494339 (1174h2m0.094279467s) [upload=1033173]: Upload finished. err: metaclient: context deadline exceeded Duration:* 310.248874ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X........X.........] duration: 2.205462161s FAIL (2025-10-17 12:14:40 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.205483s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................................................X..X......] duration: 310.226773ms FAIL (2025-10-17 12:14:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:09:24.758354060 (1174h1m0.111139157s) [upload=1033173]: Starting upload Oct 17 12:09:24.758423911 (1174h1m0.111209008s) [upload=1033173]: Done starting upload Oct 17 12:09:24.758482571 (1174h1m0.11126767s) [upload=1033173]: Uploading segments... Oct 17 12:09:24.758513760 (1174h1m0.111298868s) [upload=1033173]: Got next segment. Inline: true Oct 17 12:09:24.758518650 (1174h1m0.111303747s) [upload=1033173]: Waiting for error group managing segments... Oct 17 12:09:24.758557622 (1174h1m0.11134272s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:09:24.758561931 (1174h1m0.111347028s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 17 12:09:24.758566238 (1174h1m0.111351337s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:10:24.741474923 (1174h2m0.094260061s) [upload=1033173]: Done uploading segments... Oct 17 12:10:24.741494339 (1174h2m0.094279467s) [upload=1033173]: Upload finished. err: metaclient: context deadline exceeded Duration:* 310.247202ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 302.240626ms FAIL (2025-10-17 12:14:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:06:29.719541347 (1173h58m5.072326475s) [upload=1033130]: Starting upload Oct 17 12:06:29.719672092 (1173h58m5.072457231s) [upload=1033130]: Done starting upload Oct 17 12:06:29.719786067 (1173h58m5.072571196s) [upload=1033130]: Uploading segments... Oct 17 12:06:29.719859776 (1173h58m5.072644913s) [upload=1033130]: Got next segment. Inline: true Oct 17 12:06:29.719869343 (1173h58m5.072654482s) [upload=1033130]: Waiting for error group managing segments... Oct 17 12:06:29.720000680 (1173h58m5.072785818s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:06:29.720012883 (1173h58m5.072798021s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 17 12:06:29.720019315 (1173h58m5.072804453s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:06:59.703230017 (1173h58m35.056015135s) [upload=1033130]: Done uploading segments... Oct 17 12:06:59.703265354 (1173h58m35.056050462s) [upload=1033130]: Upload finished. err: metaclient: context deadline exceeded Duration:* 302.262228ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 539.680483ms FAIL (2025-10-17 12:14:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:07:48.648216951 (1173h59m24.00100206s) [upload=1033149]: Starting upload Oct 17 12:07:48.648267486 (1173h59m24.001052594s) [upload=1033149]: Done starting upload Oct 17 12:07:48.648320887 (1173h59m24.001105995s) [upload=1033149]: Uploading segments... Oct 17 12:07:48.648481989 (1173h59m24.001267086s) [upload=1033149]: Got next segment. Inline: false Oct 17 12:07:48.648522164 (1173h59m24.001307272s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:07:48.648525881 (1173h59m24.001310979s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 17 12:07:48.771343347 (1173h59m24.124128455s) [seg_pos={0 0}, upload=1033149]: Begin upload segment... Oct 17 12:07:48.771371670 (1173h59m24.124156778s) [seg_pos={0 0}, upload=1033149]: Done begin upload segment. Oct 17 12:07:48.771389273 (1173h59m24.124174381s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771444157 (1173h59m24.124229254s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771675410 (1173h59m24.124460508s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771708201 (1173h59m24.124493299s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771925270 (1173h59m24.124710368s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771942893 (1173h59m24.12472799s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772110787 (1173h59m24.124895886s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772166652 (1173h59m24.12495176s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772290385 (1173h59m24.125075482s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772389611 (1173h59m24.125174719s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772479820 (1173h59m24.125264917s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772661510 (1173h59m24.125446608s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772670538 (1173h59m24.125455646s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772924384 (1173h59m24.125709492s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773170456 (1173h59m24.125955564s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773423941 (1173h59m24.126209049s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.858880232 (1173h59m24.21166532s) [upload=1033149]: Next returned nil segment Oct 17 12:07:48.858889830 (1173h59m24.211674928s) [upload=1033149]: Waiting for error group managing segments... Oct 17 12:07:48.867518371 (1173h59m24.220303469s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868096285 (1173h59m24.220881384s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868380870 (1173h59m24.221165978s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868460589 (1173h59m24.221245687s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868830242 (1173h59m24.221615341s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868848998 (1173h59m24.221634116s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.876704909 (1173h59m24.229490027s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.878550432 (1173h59m24.23133554s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.880671260 (1173h59m24.233456379s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.883113394 (1173h59m24.235898502s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.886463640 (1173h59m24.239248738s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.890006969 (1173h59m24.242792077s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897452971 (1173h59m24.250238079s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897473148 (1173h59m24.250258256s) [seg_pos={0 0}, upload=1033149]: Segment reached optimal threshold of 13 pieces. Oct 17 12:07:48.897575080 (1173h59m24.250360188s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.897763483 (1173h59m24.250548591s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection Oct 17 12:07:48.897962827 (1173h59m24.250747955s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.898010997 (1173h59m24.250796126s) [seg_pos={0 0}, upload=1033149]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 17 12:07:48.898104513 (1173h59m24.250889641s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 17 12:07:48.898110303 (1173h59m24.250895442s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:08:25.738501887 (1174h0m1.091287024s) [upload=1033149]: Done uploading segments... Oct 17 12:08:25.738547021 (1174h0m1.09133216s) [upload=1033149]: Upload finished. err: metaclient: context deadline exceeded Duration: 539.704209ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X........X........] duration: 1.887903203s FAIL (2025-10-17 12:13:58 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.887922779s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [............................................X.......X.......] duration: 264.440699ms FAIL (2025-10-17 12:13:53 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 264.455598ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................................................X..X.....] duration: 588.284184ms FAIL (2025-10-17 12:13:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:09:24.758354060 (1174h1m0.111139157s) [upload=1033173]: Starting upload Oct 17 12:09:24.758423911 (1174h1m0.111209008s) [upload=1033173]: Done starting upload Oct 17 12:09:24.758482571 (1174h1m0.11126767s) [upload=1033173]: Uploading segments... Oct 17 12:09:24.758513760 (1174h1m0.111298868s) [upload=1033173]: Got next segment. Inline: true Oct 17 12:09:24.758518650 (1174h1m0.111303747s) [upload=1033173]: Waiting for error group managing segments... Oct 17 12:09:24.758557622 (1174h1m0.11134272s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:09:24.758561931 (1174h1m0.111347028s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 17 12:09:24.758566238 (1174h1m0.111351337s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:10:24.741474923 (1174h2m0.094260061s) [upload=1033173]: Done uploading segments... Oct 17 12:10:24.741494339 (1174h2m0.094279467s) [upload=1033173]: Upload finished. err: metaclient: context deadline exceeded Duration:* 588.311905ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............................................X.......X......] duration: 520.9954ms FAIL (2025-10-17 12:13:17 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 521.018163ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 863.467228ms FAIL (2025-10-17 12:13:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:07:48.648216951 (1173h59m24.00100206s) [upload=1033149]: Starting upload Oct 17 12:07:48.648267486 (1173h59m24.001052594s) [upload=1033149]: Done starting upload Oct 17 12:07:48.648320887 (1173h59m24.001105995s) [upload=1033149]: Uploading segments... Oct 17 12:07:48.648481989 (1173h59m24.001267086s) [upload=1033149]: Got next segment. Inline: false Oct 17 12:07:48.648522164 (1173h59m24.001307272s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:07:48.648525881 (1173h59m24.001310979s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 17 12:07:48.771343347 (1173h59m24.124128455s) [seg_pos={0 0}, upload=1033149]: Begin upload segment... Oct 17 12:07:48.771371670 (1173h59m24.124156778s) [seg_pos={0 0}, upload=1033149]: Done begin upload segment. Oct 17 12:07:48.771389273 (1173h59m24.124174381s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771444157 (1173h59m24.124229254s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771675410 (1173h59m24.124460508s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771708201 (1173h59m24.124493299s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771925270 (1173h59m24.124710368s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771942893 (1173h59m24.12472799s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772110787 (1173h59m24.124895886s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772166652 (1173h59m24.12495176s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772290385 (1173h59m24.125075482s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772389611 (1173h59m24.125174719s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772479820 (1173h59m24.125264917s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772661510 (1173h59m24.125446608s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772670538 (1173h59m24.125455646s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772924384 (1173h59m24.125709492s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773170456 (1173h59m24.125955564s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773423941 (1173h59m24.126209049s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.858880232 (1173h59m24.21166532s) [upload=1033149]: Next returned nil segment Oct 17 12:07:48.858889830 (1173h59m24.211674928s) [upload=1033149]: Waiting for error group managing segments... Oct 17 12:07:48.867518371 (1173h59m24.220303469s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868096285 (1173h59m24.220881384s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868380870 (1173h59m24.221165978s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868460589 (1173h59m24.221245687s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868830242 (1173h59m24.221615341s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868848998 (1173h59m24.221634116s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.876704909 (1173h59m24.229490027s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.878550432 (1173h59m24.23133554s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.880671260 (1173h59m24.233456379s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.883113394 (1173h59m24.235898502s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.886463640 (1173h59m24.239248738s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.890006969 (1173h59m24.242792077s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897452971 (1173h59m24.250238079s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897473148 (1173h59m24.250258256s) [seg_pos={0 0}, upload=1033149]: Segment reached optimal threshold of 13 pieces. Oct 17 12:07:48.897575080 (1173h59m24.250360188s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.897763483 (1173h59m24.250548591s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection Oct 17 12:07:48.897962827 (1173h59m24.250747955s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.898010997 (1173h59m24.250796126s) [seg_pos={0 0}, upload=1033149]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 17 12:07:48.898104513 (1173h59m24.250889641s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 17 12:07:48.898110303 (1173h59m24.250895442s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:08:25.738501887 (1174h0m1.091287024s) [upload=1033149]: Done uploading segments... Oct 17 12:08:25.738547021 (1174h0m1.09133216s) [upload=1033149]: Upload finished. err: metaclient: context deadline exceeded Duration: 863.49493ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 396.826419ms FAIL (2025-10-17 12:12:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:06:29.719541347 (1173h58m5.072326475s) [upload=1033130]: Starting upload Oct 17 12:06:29.719672092 (1173h58m5.072457231s) [upload=1033130]: Done starting upload Oct 17 12:06:29.719786067 (1173h58m5.072571196s) [upload=1033130]: Uploading segments... Oct 17 12:06:29.719859776 (1173h58m5.072644913s) [upload=1033130]: Got next segment. Inline: true Oct 17 12:06:29.719869343 (1173h58m5.072654482s) [upload=1033130]: Waiting for error group managing segments... Oct 17 12:06:29.720000680 (1173h58m5.072785818s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:06:29.720012883 (1173h58m5.072798021s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 17 12:06:29.720019315 (1173h58m5.072804453s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:06:59.703230017 (1173h58m35.056015135s) [upload=1033130]: Done uploading segments... Oct 17 12:06:59.703265354 (1173h58m35.056050462s) [upload=1033130]: Upload finished. err: metaclient: context deadline exceeded Duration:* 396.846988ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X........X.......] duration: 2.149322863s FAIL (2025-10-17 12:12:46 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.149346276s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 868.852514ms FAIL (2025-10-17 12:12:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:07:48.648216951 (1173h59m24.00100206s) [upload=1033149]: Starting upload Oct 17 12:07:48.648267486 (1173h59m24.001052594s) [upload=1033149]: Done starting upload Oct 17 12:07:48.648320887 (1173h59m24.001105995s) [upload=1033149]: Uploading segments... Oct 17 12:07:48.648481989 (1173h59m24.001267086s) [upload=1033149]: Got next segment. Inline: false Oct 17 12:07:48.648522164 (1173h59m24.001307272s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:07:48.648525881 (1173h59m24.001310979s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 17 12:07:48.771343347 (1173h59m24.124128455s) [seg_pos={0 0}, upload=1033149]: Begin upload segment... Oct 17 12:07:48.771371670 (1173h59m24.124156778s) [seg_pos={0 0}, upload=1033149]: Done begin upload segment. Oct 17 12:07:48.771389273 (1173h59m24.124174381s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771444157 (1173h59m24.124229254s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771675410 (1173h59m24.124460508s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771708201 (1173h59m24.124493299s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771925270 (1173h59m24.124710368s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771942893 (1173h59m24.12472799s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772110787 (1173h59m24.124895886s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772166652 (1173h59m24.12495176s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772290385 (1173h59m24.125075482s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772389611 (1173h59m24.125174719s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772479820 (1173h59m24.125264917s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772661510 (1173h59m24.125446608s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772670538 (1173h59m24.125455646s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772924384 (1173h59m24.125709492s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773170456 (1173h59m24.125955564s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773423941 (1173h59m24.126209049s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.858880232 (1173h59m24.21166532s) [upload=1033149]: Next returned nil segment Oct 17 12:07:48.858889830 (1173h59m24.211674928s) [upload=1033149]: Waiting for error group managing segments... Oct 17 12:07:48.867518371 (1173h59m24.220303469s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868096285 (1173h59m24.220881384s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868380870 (1173h59m24.221165978s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868460589 (1173h59m24.221245687s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868830242 (1173h59m24.221615341s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868848998 (1173h59m24.221634116s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.876704909 (1173h59m24.229490027s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.878550432 (1173h59m24.23133554s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.880671260 (1173h59m24.233456379s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.883113394 (1173h59m24.235898502s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.886463640 (1173h59m24.239248738s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.890006969 (1173h59m24.242792077s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897452971 (1173h59m24.250238079s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897473148 (1173h59m24.250258256s) [seg_pos={0 0}, upload=1033149]: Segment reached optimal threshold of 13 pieces. Oct 17 12:07:48.897575080 (1173h59m24.250360188s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.897763483 (1173h59m24.250548591s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection Oct 17 12:07:48.897962827 (1173h59m24.250747955s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.898010997 (1173h59m24.250796126s) [seg_pos={0 0}, upload=1033149]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 17 12:07:48.898104513 (1173h59m24.250889641s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 17 12:07:48.898110303 (1173h59m24.250895442s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:08:25.738501887 (1174h0m1.091287024s) [upload=1033149]: Done uploading segments... Oct 17 12:08:25.738547021 (1174h0m1.09133216s) [upload=1033149]: Upload finished. err: metaclient: context deadline exceeded Duration: 868.874305ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................................................X..X....] duration: 248.710774ms FAIL (2025-10-17 12:12:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:09:24.758354060 (1174h1m0.111139157s) [upload=1033173]: Starting upload Oct 17 12:09:24.758423911 (1174h1m0.111209008s) [upload=1033173]: Done starting upload Oct 17 12:09:24.758482571 (1174h1m0.11126767s) [upload=1033173]: Uploading segments... Oct 17 12:09:24.758513760 (1174h1m0.111298868s) [upload=1033173]: Got next segment. Inline: true Oct 17 12:09:24.758518650 (1174h1m0.111303747s) [upload=1033173]: Waiting for error group managing segments... Oct 17 12:09:24.758557622 (1174h1m0.11134272s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:09:24.758561931 (1174h1m0.111347028s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 17 12:09:24.758566238 (1174h1m0.111351337s) [upload=1033173]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:10:24.741474923 (1174h2m0.094260061s) [upload=1033173]: Done uploading segments... Oct 17 12:10:24.741494339 (1174h2m0.094279467s) [upload=1033173]: Upload finished. err: metaclient: context deadline exceeded Duration:* 248.728388ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 370.788762ms FAIL (2025-10-17 12:12:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:06:29.719541347 (1173h58m5.072326475s) [upload=1033130]: Starting upload Oct 17 12:06:29.719672092 (1173h58m5.072457231s) [upload=1033130]: Done starting upload Oct 17 12:06:29.719786067 (1173h58m5.072571196s) [upload=1033130]: Uploading segments... Oct 17 12:06:29.719859776 (1173h58m5.072644913s) [upload=1033130]: Got next segment. Inline: true Oct 17 12:06:29.719869343 (1173h58m5.072654482s) [upload=1033130]: Waiting for error group managing segments... Oct 17 12:06:29.720000680 (1173h58m5.072785818s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:06:29.720012883 (1173h58m5.072798021s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 17 12:06:29.720019315 (1173h58m5.072804453s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:06:59.703230017 (1173h58m35.056015135s) [upload=1033130]: Done uploading segments... Oct 17 12:06:59.703265354 (1173h58m35.056050462s) [upload=1033130]: Upload finished. err: metaclient: context deadline exceeded Duration:* 370.808199ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............................................X.......X.....] duration: 314.32931ms FAIL (2025-10-17 12:12:25 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 314.352314ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 669.530335ms FAIL (2025-10-17 12:12:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:07:48.648216951 (1173h59m24.00100206s) [upload=1033149]: Starting upload Oct 17 12:07:48.648267486 (1173h59m24.001052594s) [upload=1033149]: Done starting upload Oct 17 12:07:48.648320887 (1173h59m24.001105995s) [upload=1033149]: Uploading segments... Oct 17 12:07:48.648481989 (1173h59m24.001267086s) [upload=1033149]: Got next segment. Inline: false Oct 17 12:07:48.648522164 (1173h59m24.001307272s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:07:48.648525881 (1173h59m24.001310979s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 17 12:07:48.771343347 (1173h59m24.124128455s) [seg_pos={0 0}, upload=1033149]: Begin upload segment... Oct 17 12:07:48.771371670 (1173h59m24.124156778s) [seg_pos={0 0}, upload=1033149]: Done begin upload segment. Oct 17 12:07:48.771389273 (1173h59m24.124174381s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771444157 (1173h59m24.124229254s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771675410 (1173h59m24.124460508s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771708201 (1173h59m24.124493299s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771925270 (1173h59m24.124710368s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.771942893 (1173h59m24.12472799s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772110787 (1173h59m24.124895886s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772166652 (1173h59m24.12495176s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772290385 (1173h59m24.125075482s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772389611 (1173h59m24.125174719s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772479820 (1173h59m24.125264917s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772661510 (1173h59m24.125446608s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772670538 (1173h59m24.125455646s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.772924384 (1173h59m24.125709492s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773170456 (1173h59m24.125955564s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.773423941 (1173h59m24.126209049s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Uploading piece... Oct 17 12:07:48.858880232 (1173h59m24.21166532s) [upload=1033149]: Next returned nil segment Oct 17 12:07:48.858889830 (1173h59m24.211674928s) [upload=1033149]: Waiting for error group managing segments... Oct 17 12:07:48.867518371 (1173h59m24.220303469s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868096285 (1173h59m24.220881384s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868380870 (1173h59m24.221165978s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868460589 (1173h59m24.221245687s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868830242 (1173h59m24.221615341s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.868848998 (1173h59m24.221634116s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.876704909 (1173h59m24.229490027s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.878550432 (1173h59m24.23133554s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.880671260 (1173h59m24.233456379s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.883113394 (1173h59m24.235898502s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.886463640 (1173h59m24.239248738s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.890006969 (1173h59m24.242792077s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897452971 (1173h59m24.250238079s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil> Oct 17 12:07:48.897473148 (1173h59m24.250258256s) [seg_pos={0 0}, upload=1033149]: Segment reached optimal threshold of 13 pieces. Oct 17 12:07:48.897575080 (1173h59m24.250360188s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.897763483 (1173h59m24.250548591s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection Oct 17 12:07:48.897962827 (1173h59m24.250747955s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Oct 17 12:07:48.898010997 (1173h59m24.250796126s) [seg_pos={0 0}, upload=1033149]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Oct 17 12:07:48.898104513 (1173h59m24.250889641s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 17 12:07:48.898110303 (1173h59m24.250895442s) [upload=1033149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:08:25.738501887 (1174h0m1.091287024s) [upload=1033149]: Done uploading segments... Oct 17 12:08:25.738547021 (1174h0m1.09133216s) [upload=1033149]: Upload finished. err: metaclient: context deadline exceeded Duration: 669.551063ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................................X........X......] duration: 2.034130992s FAIL (2025-10-17 12:11:57 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.034151311s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............................................X.......X....] duration: 246.86511ms FAIL (2025-10-17 12:11:48 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 246.892291ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 1.153315734s FAIL (2025-10-17 12:11:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:06:29.719541347 (1173h58m5.072326475s) [upload=1033130]: Starting upload Oct 17 12:06:29.719672092 (1173h58m5.072457231s) [upload=1033130]: Done starting upload Oct 17 12:06:29.719786067 (1173h58m5.072571196s) [upload=1033130]: Uploading segments... Oct 17 12:06:29.719859776 (1173h58m5.072644913s) [upload=1033130]: Got next segment. Inline: true Oct 17 12:06:29.719869343 (1173h58m5.072654482s) [upload=1033130]: Waiting for error group managing segments... Oct 17 12:06:29.720000680 (1173h58m5.072785818s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 17 12:06:29.720012883 (1173h58m5.072798021s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 17 12:06:29.720019315 (1173h58m5.072804453s) [upload=1033130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 17 12:06:59.703230017 (1173h58m35.056015135s) [upload=1033130]: Done uploading segments... Oct 17 12:06:59.703265354 (1173h58m35.056050462s) [upload=1033130]: Upload finished. err: metaclient: context deadline exceeded Duration:* 1.153340491s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)