Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
428.437824ms
FAIL (2025-10-17 12:25:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:06:29.719541347 (1173h58m5.072326475s) [upload=1033130]: Starting upload Oct 17 12:06:29.719672092 (1173h58m5.072457231s) [upload=1033130]: Done starting upload Oct 17 12:06:29.719786067 (1173h58m5.072571196s) [upload=1033130]: Uploading segments... Oct 17 12:06:29.719859776 (1173h58m5.072644913s) [upload=1033130]: Got next segment. Inline: true Oct 17 12:06:29.719869343 (1173h58m5.072654482s) [upload=1033130]: Waiting for error group managing segments... Oct 17 12:06:29.720000680 (1173h58m5.072785818s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 17 12:06:29.720012883 (1173h58m5.072798021s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 17 12:06:29.720019315 (1173h58m5.072804453s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 17 12:06:59.703230017 (1173h58m35.056015135s) [upload=1033130]: Done uploading segments... Oct 17 12:06:59.703265354 (1173h58m35.056050462s) [upload=1033130]: Upload finished. err: metaclient: context deadline exceeded
Duration: 428.465064ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
576.955755ms
FAIL (2025-10-17 12:25:26 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 17 12:07:48.648216951 (1173h59m24.00100206s) [upload=1033149]: Starting upload
Oct 17 12:07:48.648267486 (1173h59m24.001052594s) [upload=1033149]: Done starting upload
Oct 17 12:07:48.648320887 (1173h59m24.001105995s) [upload=1033149]: Uploading segments...
Oct 17 12:07:48.648481989 (1173h59m24.001267086s) [upload=1033149]: Got next segment. Inline: false
Oct 17 12:07:48.648522164 (1173h59m24.001307272s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 17 12:07:48.648525881 (1173h59m24.001310979s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 17 12:07:48.771343347 (1173h59m24.124128455s) [seg_pos={0 0}, upload=1033149]: Begin upload segment...
Oct 17 12:07:48.771371670 (1173h59m24.124156778s) [seg_pos={0 0}, upload=1033149]: Done begin upload segment.
Oct 17 12:07:48.771389273 (1173h59m24.124174381s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771444157 (1173h59m24.124229254s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771675410 (1173h59m24.124460508s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771708201 (1173h59m24.124493299s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771925270 (1173h59m24.124710368s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771942893 (1173h59m24.12472799s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772110787 (1173h59m24.124895886s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772166652 (1173h59m24.12495176s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772290385 (1173h59m24.125075482s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772389611 (1173h59m24.125174719s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772479820 (1173h59m24.125264917s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772661510 (1173h59m24.125446608s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772670538 (1173h59m24.125455646s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772924384 (1173h59m24.125709492s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.773170456 (1173h59m24.125955564s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.773423941 (1173h59m24.126209049s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.858880232 (1173h59m24.21166532s) [upload=1033149]: Next returned nil segment
Oct 17 12:07:48.858889830 (1173h59m24.211674928s) [upload=1033149]: Waiting for error group managing segments...
Oct 17 12:07:48.867518371 (1173h59m24.220303469s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868096285 (1173h59m24.220881384s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868380870 (1173h59m24.221165978s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868460589 (1173h59m24.221245687s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868830242 (1173h59m24.221615341s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868848998 (1173h59m24.221634116s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.876704909 (1173h59m24.229490027s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.878550432 (1173h59m24.23133554s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.880671260 (1173h59m24.233456379s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.883113394 (1173h59m24.235898502s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.886463640 (1173h59m24.239248738s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.890006969 (1173h59m24.242792077s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.897452971 (1173h59m24.250238079s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.897473148 (1173h59m24.250258256s) [seg_pos={0 0}, upload=1033149]: Segment reached optimal threshold of 13 pieces.
Oct 17 12:07:48.897575080 (1173h59m24.250360188s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF
Oct 17 12:07:48.897763483 (1173h59m24.250548591s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection
Oct 17 12:07:48.897962827 (1173h59m24.250747955s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Oct 17 12:07:48.898010997 (1173h59m24.250796126s) [seg_pos={0 0}, upload=1033149]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 17 12:07:48.898104513 (1173h59m24.250889641s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 17 12:07:48.898110303 (1173h59m24.250895442s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 17 12:08:25.738501887 (1174h0m1.091287024s) [upload=1033149]: Done uploading segments...
Oct 17 12:08:25.738547021 (1174h0m1.09133216s) [upload=1033149]: Upload finished. err: metaclient: context deadline exceeded
Duration: 576.982584ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X..X.......................] duration:
259.400533ms
FAIL (2025-10-17 12:25:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:09:24.758354060 (1174h1m0.111139157s) [upload=1033173]: Starting upload Oct 17 12:09:24.758423911 (1174h1m0.111209008s) [upload=1033173]: Done starting upload Oct 17 12:09:24.758482571 (1174h1m0.11126767s) [upload=1033173]: Uploading segments... Oct 17 12:09:24.758513760 (1174h1m0.111298868s) [upload=1033173]: Got next segment. Inline: true Oct 17 12:09:24.758518650 (1174h1m0.111303747s) [upload=1033173]: Waiting for error group managing segments... Oct 17 12:09:24.758557622 (1174h1m0.11134272s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 17 12:09:24.758561931 (1174h1m0.111347028s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 17 12:09:24.758566238 (1174h1m0.111351337s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 17 12:10:24.741474923 (1174h2m0.094260061s) [upload=1033173]: Done uploading segments... Oct 17 12:10:24.741494339 (1174h2m0.094279467s) [upload=1033173]: Upload finished. err: metaclient: context deadline exceeded
Duration: 259.419509ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
275.624994ms
FAIL (2025-10-17 12:25:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:06:29.719541347 (1173h58m5.072326475s) [upload=1033130]: Starting upload Oct 17 12:06:29.719672092 (1173h58m5.072457231s) [upload=1033130]: Done starting upload Oct 17 12:06:29.719786067 (1173h58m5.072571196s) [upload=1033130]: Uploading segments... Oct 17 12:06:29.719859776 (1173h58m5.072644913s) [upload=1033130]: Got next segment. Inline: true Oct 17 12:06:29.719869343 (1173h58m5.072654482s) [upload=1033130]: Waiting for error group managing segments... Oct 17 12:06:29.720000680 (1173h58m5.072785818s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 17 12:06:29.720012883 (1173h58m5.072798021s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 17 12:06:29.720019315 (1173h58m5.072804453s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 17 12:06:59.703230017 (1173h58m35.056015135s) [upload=1033130]: Done uploading segments... Oct 17 12:06:59.703265354 (1173h58m35.056050462s) [upload=1033130]: Upload finished. err: metaclient: context deadline exceeded
Duration: 275.646545ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X........X..........................] duration:
2.004414558s
FAIL (2025-10-17 12:25:03 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.004434414s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X.......X.....................] duration:
277.490958ms
FAIL (2025-10-17 12:24:40 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 277.510303ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
606.022097ms
FAIL (2025-10-17 12:24:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 17 12:07:48.648216951 (1173h59m24.00100206s) [upload=1033149]: Starting upload
Oct 17 12:07:48.648267486 (1173h59m24.001052594s) [upload=1033149]: Done starting upload
Oct 17 12:07:48.648320887 (1173h59m24.001105995s) [upload=1033149]: Uploading segments...
Oct 17 12:07:48.648481989 (1173h59m24.001267086s) [upload=1033149]: Got next segment. Inline: false
Oct 17 12:07:48.648522164 (1173h59m24.001307272s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 17 12:07:48.648525881 (1173h59m24.001310979s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 17 12:07:48.771343347 (1173h59m24.124128455s) [seg_pos={0 0}, upload=1033149]: Begin upload segment...
Oct 17 12:07:48.771371670 (1173h59m24.124156778s) [seg_pos={0 0}, upload=1033149]: Done begin upload segment.
Oct 17 12:07:48.771389273 (1173h59m24.124174381s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771444157 (1173h59m24.124229254s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771675410 (1173h59m24.124460508s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771708201 (1173h59m24.124493299s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771925270 (1173h59m24.124710368s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771942893 (1173h59m24.12472799s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772110787 (1173h59m24.124895886s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772166652 (1173h59m24.12495176s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772290385 (1173h59m24.125075482s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772389611 (1173h59m24.125174719s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772479820 (1173h59m24.125264917s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772661510 (1173h59m24.125446608s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772670538 (1173h59m24.125455646s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772924384 (1173h59m24.125709492s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.773170456 (1173h59m24.125955564s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.773423941 (1173h59m24.126209049s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.858880232 (1173h59m24.21166532s) [upload=1033149]: Next returned nil segment
Oct 17 12:07:48.858889830 (1173h59m24.211674928s) [upload=1033149]: Waiting for error group managing segments...
Oct 17 12:07:48.867518371 (1173h59m24.220303469s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868096285 (1173h59m24.220881384s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868380870 (1173h59m24.221165978s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868460589 (1173h59m24.221245687s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868830242 (1173h59m24.221615341s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868848998 (1173h59m24.221634116s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.876704909 (1173h59m24.229490027s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.878550432 (1173h59m24.23133554s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.880671260 (1173h59m24.233456379s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.883113394 (1173h59m24.235898502s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.886463640 (1173h59m24.239248738s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.890006969 (1173h59m24.242792077s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.897452971 (1173h59m24.250238079s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.897473148 (1173h59m24.250258256s) [seg_pos={0 0}, upload=1033149]: Segment reached optimal threshold of 13 pieces.
Oct 17 12:07:48.897575080 (1173h59m24.250360188s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF
Oct 17 12:07:48.897763483 (1173h59m24.250548591s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection
Oct 17 12:07:48.897962827 (1173h59m24.250747955s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Oct 17 12:07:48.898010997 (1173h59m24.250796126s) [seg_pos={0 0}, upload=1033149]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 17 12:07:48.898104513 (1173h59m24.250889641s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 17 12:07:48.898110303 (1173h59m24.250895442s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 17 12:08:25.738501887 (1174h0m1.091287024s) [upload=1033149]: Done uploading segments...
Oct 17 12:08:25.738547021 (1174h0m1.09133216s) [upload=1033149]: Upload finished. err: metaclient: context deadline exceeded
Duration: 606.05602ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
592.017377ms
FAIL (2025-10-17 12:24:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:06:29.719541347 (1173h58m5.072326475s) [upload=1033130]: Starting upload Oct 17 12:06:29.719672092 (1173h58m5.072457231s) [upload=1033130]: Done starting upload Oct 17 12:06:29.719786067 (1173h58m5.072571196s) [upload=1033130]: Uploading segments... Oct 17 12:06:29.719859776 (1173h58m5.072644913s) [upload=1033130]: Got next segment. Inline: true Oct 17 12:06:29.719869343 (1173h58m5.072654482s) [upload=1033130]: Waiting for error group managing segments... Oct 17 12:06:29.720000680 (1173h58m5.072785818s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 17 12:06:29.720012883 (1173h58m5.072798021s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 17 12:06:29.720019315 (1173h58m5.072804453s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 17 12:06:59.703230017 (1173h58m35.056015135s) [upload=1033130]: Done uploading segments... Oct 17 12:06:59.703265354 (1173h58m35.056050462s) [upload=1033130]: Upload finished. err: metaclient: context deadline exceeded
Duration: 592.036824ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X..X......................] duration:
317.138825ms
FAIL (2025-10-17 12:24:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:09:24.758354060 (1174h1m0.111139157s) [upload=1033173]: Starting upload Oct 17 12:09:24.758423911 (1174h1m0.111209008s) [upload=1033173]: Done starting upload Oct 17 12:09:24.758482571 (1174h1m0.11126767s) [upload=1033173]: Uploading segments... Oct 17 12:09:24.758513760 (1174h1m0.111298868s) [upload=1033173]: Got next segment. Inline: true Oct 17 12:09:24.758518650 (1174h1m0.111303747s) [upload=1033173]: Waiting for error group managing segments... Oct 17 12:09:24.758557622 (1174h1m0.11134272s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 17 12:09:24.758561931 (1174h1m0.111347028s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 17 12:09:24.758566238 (1174h1m0.111351337s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 17 12:10:24.741474923 (1174h2m0.094260061s) [upload=1033173]: Done uploading segments... Oct 17 12:10:24.741494339 (1174h2m0.094279467s) [upload=1033173]: Upload finished. err: metaclient: context deadline exceeded
Duration: 317.162319ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X.......X....................] duration:
307.266608ms
FAIL (2025-10-17 12:24:01 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 307.290103ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X........X.........................] duration:
2.128412857s
FAIL (2025-10-17 12:23:56 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.128432724s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
686.115124ms
FAIL (2025-10-17 12:23:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 17 12:07:48.648216951 (1173h59m24.00100206s) [upload=1033149]: Starting upload
Oct 17 12:07:48.648267486 (1173h59m24.001052594s) [upload=1033149]: Done starting upload
Oct 17 12:07:48.648320887 (1173h59m24.001105995s) [upload=1033149]: Uploading segments...
Oct 17 12:07:48.648481989 (1173h59m24.001267086s) [upload=1033149]: Got next segment. Inline: false
Oct 17 12:07:48.648522164 (1173h59m24.001307272s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 17 12:07:48.648525881 (1173h59m24.001310979s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 17 12:07:48.771343347 (1173h59m24.124128455s) [seg_pos={0 0}, upload=1033149]: Begin upload segment...
Oct 17 12:07:48.771371670 (1173h59m24.124156778s) [seg_pos={0 0}, upload=1033149]: Done begin upload segment.
Oct 17 12:07:48.771389273 (1173h59m24.124174381s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771444157 (1173h59m24.124229254s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771675410 (1173h59m24.124460508s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771708201 (1173h59m24.124493299s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771925270 (1173h59m24.124710368s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771942893 (1173h59m24.12472799s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772110787 (1173h59m24.124895886s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772166652 (1173h59m24.12495176s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772290385 (1173h59m24.125075482s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772389611 (1173h59m24.125174719s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772479820 (1173h59m24.125264917s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772661510 (1173h59m24.125446608s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772670538 (1173h59m24.125455646s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772924384 (1173h59m24.125709492s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.773170456 (1173h59m24.125955564s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.773423941 (1173h59m24.126209049s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.858880232 (1173h59m24.21166532s) [upload=1033149]: Next returned nil segment
Oct 17 12:07:48.858889830 (1173h59m24.211674928s) [upload=1033149]: Waiting for error group managing segments...
Oct 17 12:07:48.867518371 (1173h59m24.220303469s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868096285 (1173h59m24.220881384s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868380870 (1173h59m24.221165978s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868460589 (1173h59m24.221245687s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868830242 (1173h59m24.221615341s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868848998 (1173h59m24.221634116s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.876704909 (1173h59m24.229490027s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.878550432 (1173h59m24.23133554s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.880671260 (1173h59m24.233456379s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.883113394 (1173h59m24.235898502s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.886463640 (1173h59m24.239248738s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.890006969 (1173h59m24.242792077s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.897452971 (1173h59m24.250238079s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.897473148 (1173h59m24.250258256s) [seg_pos={0 0}, upload=1033149]: Segment reached optimal threshold of 13 pieces.
Oct 17 12:07:48.897575080 (1173h59m24.250360188s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF
Oct 17 12:07:48.897763483 (1173h59m24.250548591s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection
Oct 17 12:07:48.897962827 (1173h59m24.250747955s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Oct 17 12:07:48.898010997 (1173h59m24.250796126s) [seg_pos={0 0}, upload=1033149]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 17 12:07:48.898104513 (1173h59m24.250889641s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 17 12:07:48.898110303 (1173h59m24.250895442s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 17 12:08:25.738501887 (1174h0m1.091287024s) [upload=1033149]: Done uploading segments...
Oct 17 12:08:25.738547021 (1174h0m1.09133216s) [upload=1033149]: Upload finished. err: metaclient: context deadline exceeded
Duration: 686.137927ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
419.633546ms
FAIL (2025-10-17 12:23:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:06:29.719541347 (1173h58m5.072326475s) [upload=1033130]: Starting upload Oct 17 12:06:29.719672092 (1173h58m5.072457231s) [upload=1033130]: Done starting upload Oct 17 12:06:29.719786067 (1173h58m5.072571196s) [upload=1033130]: Uploading segments... Oct 17 12:06:29.719859776 (1173h58m5.072644913s) [upload=1033130]: Got next segment. Inline: true Oct 17 12:06:29.719869343 (1173h58m5.072654482s) [upload=1033130]: Waiting for error group managing segments... Oct 17 12:06:29.720000680 (1173h58m5.072785818s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 17 12:06:29.720012883 (1173h58m5.072798021s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 17 12:06:29.720019315 (1173h58m5.072804453s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 17 12:06:59.703230017 (1173h58m35.056015135s) [upload=1033130]: Done uploading segments... Oct 17 12:06:59.703265354 (1173h58m35.056050462s) [upload=1033130]: Upload finished. err: metaclient: context deadline exceeded
Duration: 419.65152ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X........X........................] duration:
2.111505193s
FAIL (2025-10-17 12:23:28 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.111543273s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X..X.....................] duration:
211.199858ms
FAIL (2025-10-17 12:23:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:09:24.758354060 (1174h1m0.111139157s) [upload=1033173]: Starting upload Oct 17 12:09:24.758423911 (1174h1m0.111209008s) [upload=1033173]: Done starting upload Oct 17 12:09:24.758482571 (1174h1m0.11126767s) [upload=1033173]: Uploading segments... Oct 17 12:09:24.758513760 (1174h1m0.111298868s) [upload=1033173]: Got next segment. Inline: true Oct 17 12:09:24.758518650 (1174h1m0.111303747s) [upload=1033173]: Waiting for error group managing segments... Oct 17 12:09:24.758557622 (1174h1m0.11134272s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 17 12:09:24.758561931 (1174h1m0.111347028s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 17 12:09:24.758566238 (1174h1m0.111351337s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 17 12:10:24.741474923 (1174h2m0.094260061s) [upload=1033173]: Done uploading segments... Oct 17 12:10:24.741494339 (1174h2m0.094279467s) [upload=1033173]: Upload finished. err: metaclient: context deadline exceeded
Duration: 211.218974ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
579.695196ms
FAIL (2025-10-17 12:23:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 17 12:07:48.648216951 (1173h59m24.00100206s) [upload=1033149]: Starting upload
Oct 17 12:07:48.648267486 (1173h59m24.001052594s) [upload=1033149]: Done starting upload
Oct 17 12:07:48.648320887 (1173h59m24.001105995s) [upload=1033149]: Uploading segments...
Oct 17 12:07:48.648481989 (1173h59m24.001267086s) [upload=1033149]: Got next segment. Inline: false
Oct 17 12:07:48.648522164 (1173h59m24.001307272s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 17 12:07:48.648525881 (1173h59m24.001310979s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 17 12:07:48.771343347 (1173h59m24.124128455s) [seg_pos={0 0}, upload=1033149]: Begin upload segment...
Oct 17 12:07:48.771371670 (1173h59m24.124156778s) [seg_pos={0 0}, upload=1033149]: Done begin upload segment.
Oct 17 12:07:48.771389273 (1173h59m24.124174381s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771444157 (1173h59m24.124229254s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771675410 (1173h59m24.124460508s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771708201 (1173h59m24.124493299s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771925270 (1173h59m24.124710368s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771942893 (1173h59m24.12472799s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772110787 (1173h59m24.124895886s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772166652 (1173h59m24.12495176s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772290385 (1173h59m24.125075482s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772389611 (1173h59m24.125174719s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772479820 (1173h59m24.125264917s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772661510 (1173h59m24.125446608s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772670538 (1173h59m24.125455646s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772924384 (1173h59m24.125709492s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.773170456 (1173h59m24.125955564s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.773423941 (1173h59m24.126209049s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.858880232 (1173h59m24.21166532s) [upload=1033149]: Next returned nil segment
Oct 17 12:07:48.858889830 (1173h59m24.211674928s) [upload=1033149]: Waiting for error group managing segments...
Oct 17 12:07:48.867518371 (1173h59m24.220303469s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868096285 (1173h59m24.220881384s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868380870 (1173h59m24.221165978s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868460589 (1173h59m24.221245687s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868830242 (1173h59m24.221615341s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868848998 (1173h59m24.221634116s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.876704909 (1173h59m24.229490027s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.878550432 (1173h59m24.23133554s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.880671260 (1173h59m24.233456379s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.883113394 (1173h59m24.235898502s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.886463640 (1173h59m24.239248738s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.890006969 (1173h59m24.242792077s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.897452971 (1173h59m24.250238079s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.897473148 (1173h59m24.250258256s) [seg_pos={0 0}, upload=1033149]: Segment reached optimal threshold of 13 pieces.
Oct 17 12:07:48.897575080 (1173h59m24.250360188s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF
Oct 17 12:07:48.897763483 (1173h59m24.250548591s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection
Oct 17 12:07:48.897962827 (1173h59m24.250747955s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Oct 17 12:07:48.898010997 (1173h59m24.250796126s) [seg_pos={0 0}, upload=1033149]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 17 12:07:48.898104513 (1173h59m24.250889641s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 17 12:07:48.898110303 (1173h59m24.250895442s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 17 12:08:25.738501887 (1174h0m1.091287024s) [upload=1033149]: Done uploading segments...
Oct 17 12:08:25.738547021 (1174h0m1.09133216s) [upload=1033149]: Upload finished. err: metaclient: context deadline exceeded
Duration: 579.720524ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
290.571692ms
FAIL (2025-10-17 12:23:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:06:29.719541347 (1173h58m5.072326475s) [upload=1033130]: Starting upload Oct 17 12:06:29.719672092 (1173h58m5.072457231s) [upload=1033130]: Done starting upload Oct 17 12:06:29.719786067 (1173h58m5.072571196s) [upload=1033130]: Uploading segments... Oct 17 12:06:29.719859776 (1173h58m5.072644913s) [upload=1033130]: Got next segment. Inline: true Oct 17 12:06:29.719869343 (1173h58m5.072654482s) [upload=1033130]: Waiting for error group managing segments... Oct 17 12:06:29.720000680 (1173h58m5.072785818s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 17 12:06:29.720012883 (1173h58m5.072798021s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 17 12:06:29.720019315 (1173h58m5.072804453s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 17 12:06:59.703230017 (1173h58m35.056015135s) [upload=1033130]: Done uploading segments... Oct 17 12:06:59.703265354 (1173h58m35.056050462s) [upload=1033130]: Upload finished. err: metaclient: context deadline exceeded
Duration: 290.591479ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X.......X...................] duration:
524.854614ms
FAIL (2025-10-17 12:23:02 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 524.891012ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................X..X....................] duration:
400.229546ms
FAIL (2025-10-17 12:22:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:09:24.758354060 (1174h1m0.111139157s) [upload=1033173]: Starting upload Oct 17 12:09:24.758423911 (1174h1m0.111209008s) [upload=1033173]: Done starting upload Oct 17 12:09:24.758482571 (1174h1m0.11126767s) [upload=1033173]: Uploading segments... Oct 17 12:09:24.758513760 (1174h1m0.111298868s) [upload=1033173]: Got next segment. Inline: true Oct 17 12:09:24.758518650 (1174h1m0.111303747s) [upload=1033173]: Waiting for error group managing segments... Oct 17 12:09:24.758557622 (1174h1m0.11134272s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 17 12:09:24.758561931 (1174h1m0.111347028s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 17 12:09:24.758566238 (1174h1m0.111351337s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 17 12:10:24.741474923 (1174h2m0.094260061s) [upload=1033173]: Done uploading segments... Oct 17 12:10:24.741494339 (1174h2m0.094279467s) [upload=1033173]: Upload finished. err: metaclient: context deadline exceeded
Duration: 400.250726ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X.......X..................] duration:
214.078818ms
FAIL (2025-10-17 12:22:24 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 214.100229ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
357.369852ms
FAIL (2025-10-17 12:22:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:06:29.719541347 (1173h58m5.072326475s) [upload=1033130]: Starting upload Oct 17 12:06:29.719672092 (1173h58m5.072457231s) [upload=1033130]: Done starting upload Oct 17 12:06:29.719786067 (1173h58m5.072571196s) [upload=1033130]: Uploading segments... Oct 17 12:06:29.719859776 (1173h58m5.072644913s) [upload=1033130]: Got next segment. Inline: true Oct 17 12:06:29.719869343 (1173h58m5.072654482s) [upload=1033130]: Waiting for error group managing segments... Oct 17 12:06:29.720000680 (1173h58m5.072785818s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 17 12:06:29.720012883 (1173h58m5.072798021s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 17 12:06:29.720019315 (1173h58m5.072804453s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 17 12:06:59.703230017 (1173h58m35.056015135s) [upload=1033130]: Done uploading segments... Oct 17 12:06:59.703265354 (1173h58m35.056050462s) [upload=1033130]: Upload finished. err: metaclient: context deadline exceeded
Duration: 357.396262ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
690.050869ms
FAIL (2025-10-17 12:22:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 17 12:07:48.648216951 (1173h59m24.00100206s) [upload=1033149]: Starting upload
Oct 17 12:07:48.648267486 (1173h59m24.001052594s) [upload=1033149]: Done starting upload
Oct 17 12:07:48.648320887 (1173h59m24.001105995s) [upload=1033149]: Uploading segments...
Oct 17 12:07:48.648481989 (1173h59m24.001267086s) [upload=1033149]: Got next segment. Inline: false
Oct 17 12:07:48.648522164 (1173h59m24.001307272s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 17 12:07:48.648525881 (1173h59m24.001310979s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 17 12:07:48.771343347 (1173h59m24.124128455s) [seg_pos={0 0}, upload=1033149]: Begin upload segment...
Oct 17 12:07:48.771371670 (1173h59m24.124156778s) [seg_pos={0 0}, upload=1033149]: Done begin upload segment.
Oct 17 12:07:48.771389273 (1173h59m24.124174381s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771444157 (1173h59m24.124229254s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771675410 (1173h59m24.124460508s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771708201 (1173h59m24.124493299s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771925270 (1173h59m24.124710368s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771942893 (1173h59m24.12472799s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772110787 (1173h59m24.124895886s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772166652 (1173h59m24.12495176s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772290385 (1173h59m24.125075482s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772389611 (1173h59m24.125174719s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772479820 (1173h59m24.125264917s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772661510 (1173h59m24.125446608s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772670538 (1173h59m24.125455646s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772924384 (1173h59m24.125709492s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.773170456 (1173h59m24.125955564s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.773423941 (1173h59m24.126209049s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.858880232 (1173h59m24.21166532s) [upload=1033149]: Next returned nil segment
Oct 17 12:07:48.858889830 (1173h59m24.211674928s) [upload=1033149]: Waiting for error group managing segments...
Oct 17 12:07:48.867518371 (1173h59m24.220303469s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868096285 (1173h59m24.220881384s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868380870 (1173h59m24.221165978s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868460589 (1173h59m24.221245687s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868830242 (1173h59m24.221615341s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868848998 (1173h59m24.221634116s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.876704909 (1173h59m24.229490027s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.878550432 (1173h59m24.23133554s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.880671260 (1173h59m24.233456379s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.883113394 (1173h59m24.235898502s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.886463640 (1173h59m24.239248738s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.890006969 (1173h59m24.242792077s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.897452971 (1173h59m24.250238079s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.897473148 (1173h59m24.250258256s) [seg_pos={0 0}, upload=1033149]: Segment reached optimal threshold of 13 pieces.
Oct 17 12:07:48.897575080 (1173h59m24.250360188s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF
Oct 17 12:07:48.897763483 (1173h59m24.250548591s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection
Oct 17 12:07:48.897962827 (1173h59m24.250747955s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Oct 17 12:07:48.898010997 (1173h59m24.250796126s) [seg_pos={0 0}, upload=1033149]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 17 12:07:48.898104513 (1173h59m24.250889641s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 17 12:07:48.898110303 (1173h59m24.250895442s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 17 12:08:25.738501887 (1174h0m1.091287024s) [upload=1033149]: Done uploading segments...
Oct 17 12:08:25.738547021 (1174h0m1.09133216s) [upload=1033149]: Upload finished. err: metaclient: context deadline exceeded
Duration: 690.070757ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X..X...................] duration:
256.648618ms
FAIL (2025-10-17 12:22:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:09:24.758354060 (1174h1m0.111139157s) [upload=1033173]: Starting upload Oct 17 12:09:24.758423911 (1174h1m0.111209008s) [upload=1033173]: Done starting upload Oct 17 12:09:24.758482571 (1174h1m0.11126767s) [upload=1033173]: Uploading segments... Oct 17 12:09:24.758513760 (1174h1m0.111298868s) [upload=1033173]: Got next segment. Inline: true Oct 17 12:09:24.758518650 (1174h1m0.111303747s) [upload=1033173]: Waiting for error group managing segments... Oct 17 12:09:24.758557622 (1174h1m0.11134272s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 17 12:09:24.758561931 (1174h1m0.111347028s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 17 12:09:24.758566238 (1174h1m0.111351337s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 17 12:10:24.741474923 (1174h2m0.094260061s) [upload=1033173]: Done uploading segments... Oct 17 12:10:24.741494339 (1174h2m0.094279467s) [upload=1033173]: Upload finished. err: metaclient: context deadline exceeded
Duration: 256.667023ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X........X.......................] duration:
1.844212828s
FAIL (2025-10-17 12:22:15 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.844254446s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
275.170653ms
FAIL (2025-10-17 12:22:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:06:29.719541347 (1173h58m5.072326475s) [upload=1033130]: Starting upload Oct 17 12:06:29.719672092 (1173h58m5.072457231s) [upload=1033130]: Done starting upload Oct 17 12:06:29.719786067 (1173h58m5.072571196s) [upload=1033130]: Uploading segments... Oct 17 12:06:29.719859776 (1173h58m5.072644913s) [upload=1033130]: Got next segment. Inline: true Oct 17 12:06:29.719869343 (1173h58m5.072654482s) [upload=1033130]: Waiting for error group managing segments... Oct 17 12:06:29.720000680 (1173h58m5.072785818s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 17 12:06:29.720012883 (1173h58m5.072798021s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 17 12:06:29.720019315 (1173h58m5.072804453s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 17 12:06:59.703230017 (1173h58m35.056015135s) [upload=1033130]: Done uploading segments... Oct 17 12:06:59.703265354 (1173h58m35.056050462s) [upload=1033130]: Upload finished. err: metaclient: context deadline exceeded
Duration: 275.197623ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X.......X.................] duration:
225.559892ms
FAIL (2025-10-17 12:21:53 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 225.589567ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................X..X..................] duration:
292.032162ms
FAIL (2025-10-17 12:21:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:09:24.758354060 (1174h1m0.111139157s) [upload=1033173]: Starting upload Oct 17 12:09:24.758423911 (1174h1m0.111209008s) [upload=1033173]: Done starting upload Oct 17 12:09:24.758482571 (1174h1m0.11126767s) [upload=1033173]: Uploading segments... Oct 17 12:09:24.758513760 (1174h1m0.111298868s) [upload=1033173]: Got next segment. Inline: true Oct 17 12:09:24.758518650 (1174h1m0.111303747s) [upload=1033173]: Waiting for error group managing segments... Oct 17 12:09:24.758557622 (1174h1m0.11134272s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 17 12:09:24.758561931 (1174h1m0.111347028s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 17 12:09:24.758566238 (1174h1m0.111351337s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 17 12:10:24.741474923 (1174h2m0.094260061s) [upload=1033173]: Done uploading segments... Oct 17 12:10:24.741494339 (1174h2m0.094279467s) [upload=1033173]: Upload finished. err: metaclient: context deadline exceeded
Duration: 292.050286ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X........X......................] duration:
2.129857356s
FAIL (2025-10-17 12:21:39 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.129875221s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
399.725279ms
FAIL (2025-10-17 12:21:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:06:29.719541347 (1173h58m5.072326475s) [upload=1033130]: Starting upload Oct 17 12:06:29.719672092 (1173h58m5.072457231s) [upload=1033130]: Done starting upload Oct 17 12:06:29.719786067 (1173h58m5.072571196s) [upload=1033130]: Uploading segments... Oct 17 12:06:29.719859776 (1173h58m5.072644913s) [upload=1033130]: Got next segment. Inline: true Oct 17 12:06:29.719869343 (1173h58m5.072654482s) [upload=1033130]: Waiting for error group managing segments... Oct 17 12:06:29.720000680 (1173h58m5.072785818s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 17 12:06:29.720012883 (1173h58m5.072798021s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 17 12:06:29.720019315 (1173h58m5.072804453s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 17 12:06:59.703230017 (1173h58m35.056015135s) [upload=1033130]: Done uploading segments... Oct 17 12:06:59.703265354 (1173h58m35.056050462s) [upload=1033130]: Upload finished. err: metaclient: context deadline exceeded
Duration: 399.74671ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X..X.................] duration:
385.281522ms
FAIL (2025-10-17 12:21:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:09:24.758354060 (1174h1m0.111139157s) [upload=1033173]: Starting upload Oct 17 12:09:24.758423911 (1174h1m0.111209008s) [upload=1033173]: Done starting upload Oct 17 12:09:24.758482571 (1174h1m0.11126767s) [upload=1033173]: Uploading segments... Oct 17 12:09:24.758513760 (1174h1m0.111298868s) [upload=1033173]: Got next segment. Inline: true Oct 17 12:09:24.758518650 (1174h1m0.111303747s) [upload=1033173]: Waiting for error group managing segments... Oct 17 12:09:24.758557622 (1174h1m0.11134272s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 17 12:09:24.758561931 (1174h1m0.111347028s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 17 12:09:24.758566238 (1174h1m0.111351337s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 17 12:10:24.741474923 (1174h2m0.094260061s) [upload=1033173]: Done uploading segments... Oct 17 12:10:24.741494339 (1174h2m0.094279467s) [upload=1033173]: Upload finished. err: metaclient: context deadline exceeded
Duration: 385.300598ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
568.561905ms
FAIL (2025-10-17 12:21:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 17 12:07:48.648216951 (1173h59m24.00100206s) [upload=1033149]: Starting upload
Oct 17 12:07:48.648267486 (1173h59m24.001052594s) [upload=1033149]: Done starting upload
Oct 17 12:07:48.648320887 (1173h59m24.001105995s) [upload=1033149]: Uploading segments...
Oct 17 12:07:48.648481989 (1173h59m24.001267086s) [upload=1033149]: Got next segment. Inline: false
Oct 17 12:07:48.648522164 (1173h59m24.001307272s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 17 12:07:48.648525881 (1173h59m24.001310979s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 17 12:07:48.771343347 (1173h59m24.124128455s) [seg_pos={0 0}, upload=1033149]: Begin upload segment...
Oct 17 12:07:48.771371670 (1173h59m24.124156778s) [seg_pos={0 0}, upload=1033149]: Done begin upload segment.
Oct 17 12:07:48.771389273 (1173h59m24.124174381s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771444157 (1173h59m24.124229254s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771675410 (1173h59m24.124460508s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771708201 (1173h59m24.124493299s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771925270 (1173h59m24.124710368s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771942893 (1173h59m24.12472799s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772110787 (1173h59m24.124895886s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772166652 (1173h59m24.12495176s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772290385 (1173h59m24.125075482s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772389611 (1173h59m24.125174719s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772479820 (1173h59m24.125264917s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772661510 (1173h59m24.125446608s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772670538 (1173h59m24.125455646s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772924384 (1173h59m24.125709492s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.773170456 (1173h59m24.125955564s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.773423941 (1173h59m24.126209049s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.858880232 (1173h59m24.21166532s) [upload=1033149]: Next returned nil segment
Oct 17 12:07:48.858889830 (1173h59m24.211674928s) [upload=1033149]: Waiting for error group managing segments...
Oct 17 12:07:48.867518371 (1173h59m24.220303469s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868096285 (1173h59m24.220881384s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868380870 (1173h59m24.221165978s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868460589 (1173h59m24.221245687s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868830242 (1173h59m24.221615341s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868848998 (1173h59m24.221634116s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.876704909 (1173h59m24.229490027s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.878550432 (1173h59m24.23133554s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.880671260 (1173h59m24.233456379s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.883113394 (1173h59m24.235898502s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.886463640 (1173h59m24.239248738s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.890006969 (1173h59m24.242792077s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.897452971 (1173h59m24.250238079s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.897473148 (1173h59m24.250258256s) [seg_pos={0 0}, upload=1033149]: Segment reached optimal threshold of 13 pieces.
Oct 17 12:07:48.897575080 (1173h59m24.250360188s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF
Oct 17 12:07:48.897763483 (1173h59m24.250548591s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection
Oct 17 12:07:48.897962827 (1173h59m24.250747955s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Oct 17 12:07:48.898010997 (1173h59m24.250796126s) [seg_pos={0 0}, upload=1033149]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 17 12:07:48.898104513 (1173h59m24.250889641s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 17 12:07:48.898110303 (1173h59m24.250895442s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 17 12:08:25.738501887 (1174h0m1.091287024s) [upload=1033149]: Done uploading segments...
Oct 17 12:08:25.738547021 (1174h0m1.09133216s) [upload=1033149]: Upload finished. err: metaclient: context deadline exceeded
Duration: 568.580539ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X.......X................] duration:
207.898755ms
FAIL (2025-10-17 12:21:05 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 207.918903ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................................X..X................] duration:
422.509652ms
FAIL (2025-10-17 12:20:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:09:24.758354060 (1174h1m0.111139157s) [upload=1033173]: Starting upload Oct 17 12:09:24.758423911 (1174h1m0.111209008s) [upload=1033173]: Done starting upload Oct 17 12:09:24.758482571 (1174h1m0.11126767s) [upload=1033173]: Uploading segments... Oct 17 12:09:24.758513760 (1174h1m0.111298868s) [upload=1033173]: Got next segment. Inline: true Oct 17 12:09:24.758518650 (1174h1m0.111303747s) [upload=1033173]: Waiting for error group managing segments... Oct 17 12:09:24.758557622 (1174h1m0.11134272s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 17 12:09:24.758561931 (1174h1m0.111347028s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 17 12:09:24.758566238 (1174h1m0.111351337s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 17 12:10:24.741474923 (1174h2m0.094260061s) [upload=1033173]: Done uploading segments... Oct 17 12:10:24.741494339 (1174h2m0.094279467s) [upload=1033173]: Upload finished. err: metaclient: context deadline exceeded
Duration: 422.529811ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X........X.....................] duration:
2.086340932s
FAIL (2025-10-17 12:20:55 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.08636626s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
608.620272ms
FAIL (2025-10-17 12:20:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 17 12:07:48.648216951 (1173h59m24.00100206s) [upload=1033149]: Starting upload
Oct 17 12:07:48.648267486 (1173h59m24.001052594s) [upload=1033149]: Done starting upload
Oct 17 12:07:48.648320887 (1173h59m24.001105995s) [upload=1033149]: Uploading segments...
Oct 17 12:07:48.648481989 (1173h59m24.001267086s) [upload=1033149]: Got next segment. Inline: false
Oct 17 12:07:48.648522164 (1173h59m24.001307272s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 17 12:07:48.648525881 (1173h59m24.001310979s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 17 12:07:48.771343347 (1173h59m24.124128455s) [seg_pos={0 0}, upload=1033149]: Begin upload segment...
Oct 17 12:07:48.771371670 (1173h59m24.124156778s) [seg_pos={0 0}, upload=1033149]: Done begin upload segment.
Oct 17 12:07:48.771389273 (1173h59m24.124174381s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771444157 (1173h59m24.124229254s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771675410 (1173h59m24.124460508s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771708201 (1173h59m24.124493299s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771925270 (1173h59m24.124710368s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771942893 (1173h59m24.12472799s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772110787 (1173h59m24.124895886s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772166652 (1173h59m24.12495176s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772290385 (1173h59m24.125075482s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772389611 (1173h59m24.125174719s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772479820 (1173h59m24.125264917s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772661510 (1173h59m24.125446608s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772670538 (1173h59m24.125455646s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772924384 (1173h59m24.125709492s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.773170456 (1173h59m24.125955564s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.773423941 (1173h59m24.126209049s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.858880232 (1173h59m24.21166532s) [upload=1033149]: Next returned nil segment
Oct 17 12:07:48.858889830 (1173h59m24.211674928s) [upload=1033149]: Waiting for error group managing segments...
Oct 17 12:07:48.867518371 (1173h59m24.220303469s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868096285 (1173h59m24.220881384s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868380870 (1173h59m24.221165978s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868460589 (1173h59m24.221245687s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868830242 (1173h59m24.221615341s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868848998 (1173h59m24.221634116s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.876704909 (1173h59m24.229490027s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.878550432 (1173h59m24.23133554s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.880671260 (1173h59m24.233456379s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.883113394 (1173h59m24.235898502s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.886463640 (1173h59m24.239248738s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.890006969 (1173h59m24.242792077s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.897452971 (1173h59m24.250238079s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.897473148 (1173h59m24.250258256s) [seg_pos={0 0}, upload=1033149]: Segment reached optimal threshold of 13 pieces.
Oct 17 12:07:48.897575080 (1173h59m24.250360188s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF
Oct 17 12:07:48.897763483 (1173h59m24.250548591s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection
Oct 17 12:07:48.897962827 (1173h59m24.250747955s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Oct 17 12:07:48.898010997 (1173h59m24.250796126s) [seg_pos={0 0}, upload=1033149]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 17 12:07:48.898104513 (1173h59m24.250889641s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 17 12:07:48.898110303 (1173h59m24.250895442s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 17 12:08:25.738501887 (1174h0m1.091287024s) [upload=1033149]: Done uploading segments...
Oct 17 12:08:25.738547021 (1174h0m1.09133216s) [upload=1033149]: Upload finished. err: metaclient: context deadline exceeded
Duration: 608.647324ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
576.977507ms
FAIL (2025-10-17 12:20:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:06:29.719541347 (1173h58m5.072326475s) [upload=1033130]: Starting upload Oct 17 12:06:29.719672092 (1173h58m5.072457231s) [upload=1033130]: Done starting upload Oct 17 12:06:29.719786067 (1173h58m5.072571196s) [upload=1033130]: Uploading segments... Oct 17 12:06:29.719859776 (1173h58m5.072644913s) [upload=1033130]: Got next segment. Inline: true Oct 17 12:06:29.719869343 (1173h58m5.072654482s) [upload=1033130]: Waiting for error group managing segments... Oct 17 12:06:29.720000680 (1173h58m5.072785818s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 17 12:06:29.720012883 (1173h58m5.072798021s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 17 12:06:29.720019315 (1173h58m5.072804453s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 17 12:06:59.703230017 (1173h58m35.056015135s) [upload=1033130]: Done uploading segments... Oct 17 12:06:59.703265354 (1173h58m35.056050462s) [upload=1033130]: Upload finished. err: metaclient: context deadline exceeded
Duration: 577.001212ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X..X...............] duration:
342.618151ms
FAIL (2025-10-17 12:20:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:09:24.758354060 (1174h1m0.111139157s) [upload=1033173]: Starting upload Oct 17 12:09:24.758423911 (1174h1m0.111209008s) [upload=1033173]: Done starting upload Oct 17 12:09:24.758482571 (1174h1m0.11126767s) [upload=1033173]: Uploading segments... Oct 17 12:09:24.758513760 (1174h1m0.111298868s) [upload=1033173]: Got next segment. Inline: true Oct 17 12:09:24.758518650 (1174h1m0.111303747s) [upload=1033173]: Waiting for error group managing segments... Oct 17 12:09:24.758557622 (1174h1m0.11134272s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 17 12:09:24.758561931 (1174h1m0.111347028s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 17 12:09:24.758566238 (1174h1m0.111351337s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 17 12:10:24.741474923 (1174h2m0.094260061s) [upload=1033173]: Done uploading segments... Oct 17 12:10:24.741494339 (1174h2m0.094279467s) [upload=1033173]: Upload finished. err: metaclient: context deadline exceeded
Duration: 342.63914ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X........X....................] duration:
1.849300137s
FAIL (2025-10-17 12:20:33 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.849323331s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X........X...................] duration:
2.12241714s
FAIL (2025-10-17 12:20:15 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.122436606s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
546.552018ms
FAIL (2025-10-17 12:20:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:06:29.719541347 (1173h58m5.072326475s) [upload=1033130]: Starting upload Oct 17 12:06:29.719672092 (1173h58m5.072457231s) [upload=1033130]: Done starting upload Oct 17 12:06:29.719786067 (1173h58m5.072571196s) [upload=1033130]: Uploading segments... Oct 17 12:06:29.719859776 (1173h58m5.072644913s) [upload=1033130]: Got next segment. Inline: true Oct 17 12:06:29.719869343 (1173h58m5.072654482s) [upload=1033130]: Waiting for error group managing segments... Oct 17 12:06:29.720000680 (1173h58m5.072785818s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 17 12:06:29.720012883 (1173h58m5.072798021s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 17 12:06:29.720019315 (1173h58m5.072804453s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 17 12:06:59.703230017 (1173h58m35.056015135s) [upload=1033130]: Done uploading segments... Oct 17 12:06:59.703265354 (1173h58m35.056050462s) [upload=1033130]: Upload finished. err: metaclient: context deadline exceeded
Duration: 546.567526ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................X.......X...............] duration:
228.061556ms
FAIL (2025-10-17 12:20:06 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 228.079079ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
646.327897ms
FAIL (2025-10-17 12:19:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 17 12:07:48.648216951 (1173h59m24.00100206s) [upload=1033149]: Starting upload
Oct 17 12:07:48.648267486 (1173h59m24.001052594s) [upload=1033149]: Done starting upload
Oct 17 12:07:48.648320887 (1173h59m24.001105995s) [upload=1033149]: Uploading segments...
Oct 17 12:07:48.648481989 (1173h59m24.001267086s) [upload=1033149]: Got next segment. Inline: false
Oct 17 12:07:48.648522164 (1173h59m24.001307272s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 17 12:07:48.648525881 (1173h59m24.001310979s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 17 12:07:48.771343347 (1173h59m24.124128455s) [seg_pos={0 0}, upload=1033149]: Begin upload segment...
Oct 17 12:07:48.771371670 (1173h59m24.124156778s) [seg_pos={0 0}, upload=1033149]: Done begin upload segment.
Oct 17 12:07:48.771389273 (1173h59m24.124174381s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771444157 (1173h59m24.124229254s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771675410 (1173h59m24.124460508s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771708201 (1173h59m24.124493299s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771925270 (1173h59m24.124710368s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771942893 (1173h59m24.12472799s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772110787 (1173h59m24.124895886s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772166652 (1173h59m24.12495176s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772290385 (1173h59m24.125075482s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772389611 (1173h59m24.125174719s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772479820 (1173h59m24.125264917s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772661510 (1173h59m24.125446608s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772670538 (1173h59m24.125455646s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772924384 (1173h59m24.125709492s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.773170456 (1173h59m24.125955564s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.773423941 (1173h59m24.126209049s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.858880232 (1173h59m24.21166532s) [upload=1033149]: Next returned nil segment
Oct 17 12:07:48.858889830 (1173h59m24.211674928s) [upload=1033149]: Waiting for error group managing segments...
Oct 17 12:07:48.867518371 (1173h59m24.220303469s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868096285 (1173h59m24.220881384s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868380870 (1173h59m24.221165978s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868460589 (1173h59m24.221245687s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868830242 (1173h59m24.221615341s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868848998 (1173h59m24.221634116s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.876704909 (1173h59m24.229490027s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.878550432 (1173h59m24.23133554s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.880671260 (1173h59m24.233456379s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.883113394 (1173h59m24.235898502s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.886463640 (1173h59m24.239248738s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.890006969 (1173h59m24.242792077s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.897452971 (1173h59m24.250238079s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.897473148 (1173h59m24.250258256s) [seg_pos={0 0}, upload=1033149]: Segment reached optimal threshold of 13 pieces.
Oct 17 12:07:48.897575080 (1173h59m24.250360188s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF
Oct 17 12:07:48.897763483 (1173h59m24.250548591s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection
Oct 17 12:07:48.897962827 (1173h59m24.250747955s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Oct 17 12:07:48.898010997 (1173h59m24.250796126s) [seg_pos={0 0}, upload=1033149]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 17 12:07:48.898104513 (1173h59m24.250889641s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 17 12:07:48.898110303 (1173h59m24.250895442s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 17 12:08:25.738501887 (1174h0m1.091287024s) [upload=1033149]: Done uploading segments...
Oct 17 12:08:25.738547021 (1174h0m1.09133216s) [upload=1033149]: Upload finished. err: metaclient: context deadline exceeded
Duration: 646.35097ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X..X..............] duration:
273.32529ms
FAIL (2025-10-17 12:19:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:09:24.758354060 (1174h1m0.111139157s) [upload=1033173]: Starting upload Oct 17 12:09:24.758423911 (1174h1m0.111209008s) [upload=1033173]: Done starting upload Oct 17 12:09:24.758482571 (1174h1m0.11126767s) [upload=1033173]: Uploading segments... Oct 17 12:09:24.758513760 (1174h1m0.111298868s) [upload=1033173]: Got next segment. Inline: true Oct 17 12:09:24.758518650 (1174h1m0.111303747s) [upload=1033173]: Waiting for error group managing segments... Oct 17 12:09:24.758557622 (1174h1m0.11134272s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 17 12:09:24.758561931 (1174h1m0.111347028s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 17 12:09:24.758566238 (1174h1m0.111351337s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 17 12:10:24.741474923 (1174h2m0.094260061s) [upload=1033173]: Done uploading segments... Oct 17 12:10:24.741494339 (1174h2m0.094279467s) [upload=1033173]: Upload finished. err: metaclient: context deadline exceeded
Duration: 273.356678ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X.......X..............] duration:
335.585605ms
FAIL (2025-10-17 12:19:39 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 335.607827ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
566.536403ms
FAIL (2025-10-17 12:19:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 17 12:07:48.648216951 (1173h59m24.00100206s) [upload=1033149]: Starting upload
Oct 17 12:07:48.648267486 (1173h59m24.001052594s) [upload=1033149]: Done starting upload
Oct 17 12:07:48.648320887 (1173h59m24.001105995s) [upload=1033149]: Uploading segments...
Oct 17 12:07:48.648481989 (1173h59m24.001267086s) [upload=1033149]: Got next segment. Inline: false
Oct 17 12:07:48.648522164 (1173h59m24.001307272s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 17 12:07:48.648525881 (1173h59m24.001310979s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 17 12:07:48.771343347 (1173h59m24.124128455s) [seg_pos={0 0}, upload=1033149]: Begin upload segment...
Oct 17 12:07:48.771371670 (1173h59m24.124156778s) [seg_pos={0 0}, upload=1033149]: Done begin upload segment.
Oct 17 12:07:48.771389273 (1173h59m24.124174381s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771444157 (1173h59m24.124229254s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771675410 (1173h59m24.124460508s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771708201 (1173h59m24.124493299s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771925270 (1173h59m24.124710368s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.771942893 (1173h59m24.12472799s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772110787 (1173h59m24.124895886s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772166652 (1173h59m24.12495176s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772290385 (1173h59m24.125075482s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772389611 (1173h59m24.125174719s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772479820 (1173h59m24.125264917s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772661510 (1173h59m24.125446608s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772670538 (1173h59m24.125455646s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.772924384 (1173h59m24.125709492s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.773170456 (1173h59m24.125955564s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.773423941 (1173h59m24.126209049s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Uploading piece...
Oct 17 12:07:48.858880232 (1173h59m24.21166532s) [upload=1033149]: Next returned nil segment
Oct 17 12:07:48.858889830 (1173h59m24.211674928s) [upload=1033149]: Waiting for error group managing segments...
Oct 17 12:07:48.867518371 (1173h59m24.220303469s) [noise=true , address=145.79.227.13:4803 , piece_id=CBWMKCAAGFSYVZGOJV5ANTV3TTAAG52OK6OWRMUFNUA6MJPGTAOA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868096285 (1173h59m24.220881384s) [noise=true , address=145.79.227.5:4221 , piece_id=4WFVGLQ5JZKKZQ2BJMFRSR44SBU7SCHIKVGQPPS2KY5PQBFFW24Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868380870 (1173h59m24.221165978s) [noise=true , address=145.79.227.2:4113 , piece_id=GYI2LZ4C5GOWMSQEVHQRHNQX5QOJGQWN4PFEFLGP462DOJZELVPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868460589 (1173h59m24.221245687s) [noise=true , address=45.91.116.7:4011 , piece_id=IPRGFVJWW65XMXVVRCB7ZIDN3OZKUGU76TEM3BMSVOBVLLBW4LPA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868830242 (1173h59m24.221615341s) [noise=true , address=45.91.116.9:4263 , piece_id=D7KSOSB5KLM77A76JQA7JW3XWRVOWJJZCNLTBSRLS6MNFS2DRFHA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.868848998 (1173h59m24.221634116s) [noise=true , address=77.90.31.15:4697 , piece_id=KTG6MJMIC3N2BGVLKNL47RJPBVLDLWWO3SBTMPDPAZWL6TJTRNLQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.876704909 (1173h59m24.229490027s) [noise=true , address=45.91.116.6:4975 , piece_id=Q3FVPQFXGHVVVPLDUQSFU2F2X4H2C7S4K66L45T4KKFDF3G4G6EA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.878550432 (1173h59m24.23133554s) [noise=true , address=145.79.227.17:4969 , piece_id=BSUDLDSHRQLDAEV75RAUYMUH3SHA56HMGSBTORF2TANVZ5WDY3VA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.880671260 (1173h59m24.233456379s) [noise=true , address=145.79.227.4:4186 , piece_id=ZHGQ6GF6DDY6KPBPXG332OYN44ODX467QJOUCMWZXZSUJANPLYZA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.883113394 (1173h59m24.235898502s) [noise=true , address=145.79.227.15:4874 , piece_id=DRLWMHJIEZPJCC2TDPOZDS37N7IDQPRAKLORCVUPFASAPPYPBJQQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.886463640 (1173h59m24.239248738s) [noise=true , address=145.79.227.14:4837 , piece_id=J6CY7TBWFUIG42GOEB7OHC25C4ZGQLZB2JOMLGJGRX33CYWBJW5Q, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.890006969 (1173h59m24.242792077s) [noise=true , address=145.79.227.13:4802 , piece_id=YZVFU6M2MLBH6256U5ONWGEUAUZMR4QXVHAYK6GM3JELDXOALBGQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.897452971 (1173h59m24.250238079s) [noise=true , address=145.79.227.3:4151 , piece_id=Y7W6PTQTAHID54XSNSULLXMUUQI3BFA32XU3RIQNPDXMZPF7ELCA, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: <nil>
Oct 17 12:07:48.897473148 (1173h59m24.250258256s) [seg_pos={0 0}, upload=1033149]: Segment reached optimal threshold of 13 pieces.
Oct 17 12:07:48.897575080 (1173h59m24.250360188s) [noise=true , address=77.90.31.10:4519 , piece_id=PKOI3S7AFW2HHESIQTX5HRIZTPUJVVFCDGWSF5YHHIKAWF6DDA5A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX): protocol: expected piece hash; context canceled; EOF
Oct 17 12:07:48.897763483 (1173h59m24.250548591s) [noise=true , address=145.79.227.19:4079 , piece_id=QVARQICFE6LIICDFMDNHMRUZNAFKA2DIOYAQONXTNMZOY3QS43XQ, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29080->145.79.227.19:4079: use of closed network connection
Oct 17 12:07:48.897962827 (1173h59m24.250747955s) [noise=true , address=145.79.227.6:4258 , piece_id=BW3B27W2S6WOOXCJ7SDUJM4C4NLPJYZKKJRL3CHSZEJHZW37YL2A, seg_pos={0 0}, upload=1033149]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Oct 17 12:07:48.898010997 (1173h59m24.250796126s) [seg_pos={0 0}, upload=1033149]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 17 12:07:48.898104513 (1173h59m24.250889641s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 17 12:07:48.898110303 (1173h59m24.250895442s) [upload=1033149]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 17 12:08:25.738501887 (1174h0m1.091287024s) [upload=1033149]: Done uploading segments...
Oct 17 12:08:25.738547021 (1174h0m1.09133216s) [upload=1033149]: Upload finished. err: metaclient: context deadline exceeded
Duration: 566.563455ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
356.084232ms
FAIL (2025-10-17 12:19:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:06:29.719541347 (1173h58m5.072326475s) [upload=1033130]: Starting upload Oct 17 12:06:29.719672092 (1173h58m5.072457231s) [upload=1033130]: Done starting upload Oct 17 12:06:29.719786067 (1173h58m5.072571196s) [upload=1033130]: Uploading segments... Oct 17 12:06:29.719859776 (1173h58m5.072644913s) [upload=1033130]: Got next segment. Inline: true Oct 17 12:06:29.719869343 (1173h58m5.072654482s) [upload=1033130]: Waiting for error group managing segments... Oct 17 12:06:29.720000680 (1173h58m5.072785818s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 17 12:06:29.720012883 (1173h58m5.072798021s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 17 12:06:29.720019315 (1173h58m5.072804453s) [upload=1033130]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 17 12:06:59.703230017 (1173h58m35.056015135s) [upload=1033130]: Done uploading segments... Oct 17 12:06:59.703265354 (1173h58m35.056050462s) [upload=1033130]: Upload finished. err: metaclient: context deadline exceeded
Duration: 356.11545ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X..X.............] duration:
379.201107ms
FAIL (2025-10-17 12:19:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 17 12:09:24.758354060 (1174h1m0.111139157s) [upload=1033173]: Starting upload Oct 17 12:09:24.758423911 (1174h1m0.111209008s) [upload=1033173]: Done starting upload Oct 17 12:09:24.758482571 (1174h1m0.11126767s) [upload=1033173]: Uploading segments... Oct 17 12:09:24.758513760 (1174h1m0.111298868s) [upload=1033173]: Got next segment. Inline: true Oct 17 12:09:24.758518650 (1174h1m0.111303747s) [upload=1033173]: Waiting for error group managing segments... Oct 17 12:09:24.758557622 (1174h1m0.11134272s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 17 12:09:24.758561931 (1174h1m0.111347028s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 17 12:09:24.758566238 (1174h1m0.111351337s) [upload=1033173]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 17 12:10:24.741474923 (1174h2m0.094260061s) [upload=1033173]: Done uploading segments... Oct 17 12:10:24.741494339 (1174h2m0.094279467s) [upload=1033173]: Upload finished. err: metaclient: context deadline exceeded
Duration: 379.218569ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................X.......X.............] duration:
271.549318ms
FAIL (2025-10-17 12:19:15 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 271.569597ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................X........X..................] duration:
1.960025542s
FAIL (2025-10-17 12:19:08 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.960054776s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................X........X.................] duration:
1.744967415s
FAIL (2025-10-17 12:18:52 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 1.744987484s
core
uplink
us1
|