Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
406.642164ms
FAIL (2025-10-26 17:39:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 26 17:35:07.166165714 (1395h26m42.518950842s) [upload=1228121]: Starting upload
Oct 26 17:35:07.166268406 (1395h26m42.519053544s) [upload=1228121]: Done starting upload
Oct 26 17:35:07.166495883 (1395h26m42.519281011s) [upload=1228121]: Uploading segments...
Oct 26 17:35:07.166746414 (1395h26m42.519531542s) [upload=1228121]: Got next segment. Inline: false
Oct 26 17:35:07.166795456 (1395h26m42.519580584s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 26 17:35:07.166801187 (1395h26m42.519586314s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 26 17:35:07.188082010 (1395h26m42.540867108s) [seg_pos={0 0}, upload=1228121]: Begin upload segment...
Oct 26 17:35:07.188118017 (1395h26m42.540903125s) [seg_pos={0 0}, upload=1228121]: Done begin upload segment.
Oct 26 17:35:07.188139367 (1395h26m42.540924475s) [noise=true , address=77.90.31.11:4554 , piece_id=4KP5SFY4TBPJ7PIVLK6JBNKPICNZI3IIVQUF4OLUP5NQVSQKE6ZA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188187818 (1395h26m42.540972947s) [noise=true , address=145.79.227.6:4258 , piece_id=IUHFPMGJUROKRJNKWOQIFDGUQOMDCTE2SKWK5BZSCOOMGGICLGIQ, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188498822 (1395h26m42.54128393s) [noise=true , address=145.79.227.2:4113 , piece_id=3TNESZZYEM4HJA5QSVHJSP5RECPNH3KVO7HUSBF3A77QV5YHSN6A, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188707915 (1395h26m42.541493043s) [noise=true , address=145.79.227.21:4475 , piece_id=YRC4PWH5USPXFF7R5IEGZHXTJVYNS2PJO6LCRMIZYFI5KDDPC6FA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188732450 (1395h26m42.541517558s) [noise=true , address=145.79.227.6:4259 , piece_id=JLNLQPDHWR5M7EMYWWPG3TSZ3XWSOP5HRBZDH2KKCHXB2E6Y2QNA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188965037 (1395h26m42.541750145s) [noise=true , address=77.90.31.11:4555 , piece_id=VDLZT5KLMYKQN35H6YDQFWSBQKPIGTA2PB2P5XCEQETICQNVXCRA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189088609 (1395h26m42.541873737s) [noise=true , address=45.91.116.4:4940 , piece_id=KP3MFRUNK3PYP2KQJ2B5FAWZE5LVJNRUNQWZ6HIOXRYFPVF3VRPA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189221298 (1395h26m42.542006406s) [noise=true , address=145.79.227.7:4293 , piece_id=IV5Y5T6DNVLDH25AYG4S66BCDRYHA5YYSFHVDNHQ4AXD23CLAVRA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189458492 (1395h26m42.54224359s) [noise=true , address=145.79.227.8:4329 , piece_id=ZXLBEI2RGGESWL7STOFDQ67UZEFVSCTCI7MMAVNDMOYXRVH64XBA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189555204 (1395h26m42.542340332s) [noise=true , address=145.79.227.11:4730 , piece_id=QQMH363G5WT2FNHWQ2PURVIGYY6DMKYGCLFMRX74UKESV4TCGJ5A, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189713592 (1395h26m42.5424987s) [noise=true , address=77.90.31.16:4735 , piece_id=DY3I5Y72MOQAYNTQAYUBGMOSQCC4WJGHKJXT3657XG6N6RGKW4TQ, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189949564 (1395h26m42.542734672s) [noise=true , address=145.79.227.26:4655 , piece_id=7K42QWK7NC2TBCTQULFEEVWQ76QP5EXS3B5INEEWH7UXCG4GO3CQ, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190007012 (1395h26m42.54279214s) [noise=true , address=145.79.227.9:4365 , piece_id=R6MMEBNCXEXFUHTER52XELUCBE34MA7EYGHEIAJUSVNHA6O6522Q, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190219821 (1395h26m42.543004929s) [noise=true , address=145.79.227.18:4007 , piece_id=6PV5ZSSWA3NIFAGM4HMV5WTB3PE2MYLZH4VHSNR6OH3IKBAVBKKA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190444733 (1395h26m42.543229862s) [noise=true , address=145.79.227.13:4802 , piece_id=LZFX5TWOUZT6DWYMJZABYFGZBXMFF7AGIIKP25YO43YXOMN7FPAA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190947998 (1395h26m42.543733126s) [noise=true , address=145.79.227.4:4187 , piece_id=DF4BRUCC74SXLIDTDMDBOG5WO6PXJFTKQMGECBCC5L6TZ62KFHXA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.297040350 (1395h26m42.649825448s) [upload=1228121]: Next returned nil segment
Oct 26 17:35:07.297053745 (1395h26m42.649838853s) [upload=1228121]: Waiting for error group managing segments...
Oct 26 17:35:07.305931625 (1395h26m42.658716733s) [noise=true , address=145.79.227.11:4730 , piece_id=QQMH363G5WT2FNHWQ2PURVIGYY6DMKYGCLFMRX74UKESV4TCGJ5A, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.306566537 (1395h26m42.659351645s) [noise=true , address=145.79.227.6:4258 , piece_id=IUHFPMGJUROKRJNKWOQIFDGUQOMDCTE2SKWK5BZSCOOMGGICLGIQ, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.306883511 (1395h26m42.659668649s) [noise=true , address=145.79.227.26:4655 , piece_id=7K42QWK7NC2TBCTQULFEEVWQ76QP5EXS3B5INEEWH7UXCG4GO3CQ, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.306965455 (1395h26m42.659750563s) [noise=true , address=145.79.227.4:4187 , piece_id=DF4BRUCC74SXLIDTDMDBOG5WO6PXJFTKQMGECBCC5L6TZ62KFHXA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.307721434 (1395h26m42.660506561s) [noise=true , address=145.79.227.8:4329 , piece_id=ZXLBEI2RGGESWL7STOFDQ67UZEFVSCTCI7MMAVNDMOYXRVH64XBA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.308347728 (1395h26m42.661132836s) [noise=true , address=145.79.227.21:4475 , piece_id=YRC4PWH5USPXFF7R5IEGZHXTJVYNS2PJO6LCRMIZYFI5KDDPC6FA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.308701312 (1395h26m42.66148642s) [noise=true , address=145.79.227.9:4365 , piece_id=R6MMEBNCXEXFUHTER52XELUCBE34MA7EYGHEIAJUSVNHA6O6522Q, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.309023396 (1395h26m42.661808505s) [noise=true , address=145.79.227.7:4293 , piece_id=IV5Y5T6DNVLDH25AYG4S66BCDRYHA5YYSFHVDNHQ4AXD23CLAVRA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.309356411 (1395h26m42.662141519s) [noise=true , address=145.79.227.13:4802 , piece_id=LZFX5TWOUZT6DWYMJZABYFGZBXMFF7AGIIKP25YO43YXOMN7FPAA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.309707731 (1395h26m42.662492829s) [noise=true , address=77.90.31.16:4735 , piece_id=DY3I5Y72MOQAYNTQAYUBGMOSQCC4WJGHKJXT3657XG6N6RGKW4TQ, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.310024786 (1395h26m42.662809894s) [noise=true , address=77.90.31.11:4555 , piece_id=VDLZT5KLMYKQN35H6YDQFWSBQKPIGTA2PB2P5XCEQETICQNVXCRA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.310383207 (1395h26m42.663168315s) [noise=true , address=145.79.227.18:4007 , piece_id=6PV5ZSSWA3NIFAGM4HMV5WTB3PE2MYLZH4VHSNR6OH3IKBAVBKKA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.312827345 (1395h26m42.665612443s) [noise=true , address=45.91.116.4:4940 , piece_id=KP3MFRUNK3PYP2KQJ2B5FAWZE5LVJNRUNQWZ6HIOXRYFPVF3VRPA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.312835350 (1395h26m42.665620448s) [seg_pos={0 0}, upload=1228121]: Segment reached optimal threshold of 13 pieces.
Oct 26 17:35:07.312928664 (1395h26m42.665713773s) [noise=true , address=145.79.227.6:4259 , piece_id=JLNLQPDHWR5M7EMYWWPG3TSZ3XWSOP5HRBZDH2KKCHXB2E6Y2QNA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: expected piece hash; context canceled; EOF
Oct 26 17:35:07.313005950 (1395h26m42.665791058s) [noise=true , address=77.90.31.11:4554 , piece_id=4KP5SFY4TBPJ7PIVLK6JBNKPICNZI3IIVQUF4OLUP5NQVSQKE6ZA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Oct 26 17:35:07.313057477 (1395h26m42.665842585s) [noise=true , address=145.79.227.2:4113 , piece_id=3TNESZZYEM4HJA5QSVHJSP5RECPNH3KVO7HUSBF3A77QV5YHSN6A, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Oct 26 17:35:07.313066143 (1395h26m42.665851251s) [seg_pos={0 0}, upload=1228121]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 26 17:35:07.313118882 (1395h26m42.66590399s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 26 17:35:07.313122408 (1395h26m42.665907516s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 26 17:36:37.151476755 (1395h28m12.504261893s) [upload=1228121]: Done uploading segments...
Oct 26 17:36:37.151495209 (1395h28m12.504280348s) [upload=1228121]: Upload finished. err: metaclient: context deadline exceeded
Duration: 406.668874ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................................................XX.X...] duration:
206.882054ms
FAIL (2025-10-26 17:39:40 UTC)
operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 26 17:37:29.239943729 (1395h29m4.592728837s) [upload=1228155]: Starting upload Oct 26 17:37:29.239994865 (1395h29m4.592779963s) [upload=1228155]: Done starting upload Oct 26 17:37:29.240040110 (1395h29m4.592825208s) [upload=1228155]: Uploading segments... Oct 26 17:37:29.240064296 (1395h29m4.592849404s) [upload=1228155]: Got next segment. Inline: true Oct 26 17:37:29.240068153 (1395h29m4.592853261s) [upload=1228155]: Waiting for error group managing segments... Oct 26 17:37:29.240097869 (1395h29m4.592882977s) [upload=1228155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 26 17:37:29.240101245 (1395h29m4.592886353s) [upload=1228155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 26 17:37:29.240103509 (1395h29m4.592888617s) [upload=1228155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 26 17:37:29.287686619 (1395h29m4.640471717s) [upload=1228155]: Done uploading segments... Oct 26 17:37:29.287700044 (1395h29m4.640485142s) [upload=1228155]: Upload finished. err: <nil>
Duration: 206.903073ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................................................XX.X..] duration:
186.254659ms
FAIL (2025-10-26 17:39:20 UTC)
operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 26 17:37:29.239943729 (1395h29m4.592728837s) [upload=1228155]: Starting upload Oct 26 17:37:29.239994865 (1395h29m4.592779963s) [upload=1228155]: Done starting upload Oct 26 17:37:29.240040110 (1395h29m4.592825208s) [upload=1228155]: Uploading segments... Oct 26 17:37:29.240064296 (1395h29m4.592849404s) [upload=1228155]: Got next segment. Inline: true Oct 26 17:37:29.240068153 (1395h29m4.592853261s) [upload=1228155]: Waiting for error group managing segments... Oct 26 17:37:29.240097869 (1395h29m4.592882977s) [upload=1228155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 26 17:37:29.240101245 (1395h29m4.592886353s) [upload=1228155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 26 17:37:29.240103509 (1395h29m4.592888617s) [upload=1228155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 26 17:37:29.287686619 (1395h29m4.640471717s) [upload=1228155]: Done uploading segments... Oct 26 17:37:29.287700044 (1395h29m4.640485142s) [upload=1228155]: Upload finished. err: <nil>
Duration: 186.280977ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
322.605108ms
FAIL (2025-10-26 17:38:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 26 17:35:07.166165714 (1395h26m42.518950842s) [upload=1228121]: Starting upload
Oct 26 17:35:07.166268406 (1395h26m42.519053544s) [upload=1228121]: Done starting upload
Oct 26 17:35:07.166495883 (1395h26m42.519281011s) [upload=1228121]: Uploading segments...
Oct 26 17:35:07.166746414 (1395h26m42.519531542s) [upload=1228121]: Got next segment. Inline: false
Oct 26 17:35:07.166795456 (1395h26m42.519580584s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 26 17:35:07.166801187 (1395h26m42.519586314s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 26 17:35:07.188082010 (1395h26m42.540867108s) [seg_pos={0 0}, upload=1228121]: Begin upload segment...
Oct 26 17:35:07.188118017 (1395h26m42.540903125s) [seg_pos={0 0}, upload=1228121]: Done begin upload segment.
Oct 26 17:35:07.188139367 (1395h26m42.540924475s) [noise=true , address=77.90.31.11:4554 , piece_id=4KP5SFY4TBPJ7PIVLK6JBNKPICNZI3IIVQUF4OLUP5NQVSQKE6ZA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188187818 (1395h26m42.540972947s) [noise=true , address=145.79.227.6:4258 , piece_id=IUHFPMGJUROKRJNKWOQIFDGUQOMDCTE2SKWK5BZSCOOMGGICLGIQ, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188498822 (1395h26m42.54128393s) [noise=true , address=145.79.227.2:4113 , piece_id=3TNESZZYEM4HJA5QSVHJSP5RECPNH3KVO7HUSBF3A77QV5YHSN6A, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188707915 (1395h26m42.541493043s) [noise=true , address=145.79.227.21:4475 , piece_id=YRC4PWH5USPXFF7R5IEGZHXTJVYNS2PJO6LCRMIZYFI5KDDPC6FA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188732450 (1395h26m42.541517558s) [noise=true , address=145.79.227.6:4259 , piece_id=JLNLQPDHWR5M7EMYWWPG3TSZ3XWSOP5HRBZDH2KKCHXB2E6Y2QNA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188965037 (1395h26m42.541750145s) [noise=true , address=77.90.31.11:4555 , piece_id=VDLZT5KLMYKQN35H6YDQFWSBQKPIGTA2PB2P5XCEQETICQNVXCRA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189088609 (1395h26m42.541873737s) [noise=true , address=45.91.116.4:4940 , piece_id=KP3MFRUNK3PYP2KQJ2B5FAWZE5LVJNRUNQWZ6HIOXRYFPVF3VRPA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189221298 (1395h26m42.542006406s) [noise=true , address=145.79.227.7:4293 , piece_id=IV5Y5T6DNVLDH25AYG4S66BCDRYHA5YYSFHVDNHQ4AXD23CLAVRA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189458492 (1395h26m42.54224359s) [noise=true , address=145.79.227.8:4329 , piece_id=ZXLBEI2RGGESWL7STOFDQ67UZEFVSCTCI7MMAVNDMOYXRVH64XBA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189555204 (1395h26m42.542340332s) [noise=true , address=145.79.227.11:4730 , piece_id=QQMH363G5WT2FNHWQ2PURVIGYY6DMKYGCLFMRX74UKESV4TCGJ5A, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189713592 (1395h26m42.5424987s) [noise=true , address=77.90.31.16:4735 , piece_id=DY3I5Y72MOQAYNTQAYUBGMOSQCC4WJGHKJXT3657XG6N6RGKW4TQ, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189949564 (1395h26m42.542734672s) [noise=true , address=145.79.227.26:4655 , piece_id=7K42QWK7NC2TBCTQULFEEVWQ76QP5EXS3B5INEEWH7UXCG4GO3CQ, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190007012 (1395h26m42.54279214s) [noise=true , address=145.79.227.9:4365 , piece_id=R6MMEBNCXEXFUHTER52XELUCBE34MA7EYGHEIAJUSVNHA6O6522Q, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190219821 (1395h26m42.543004929s) [noise=true , address=145.79.227.18:4007 , piece_id=6PV5ZSSWA3NIFAGM4HMV5WTB3PE2MYLZH4VHSNR6OH3IKBAVBKKA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190444733 (1395h26m42.543229862s) [noise=true , address=145.79.227.13:4802 , piece_id=LZFX5TWOUZT6DWYMJZABYFGZBXMFF7AGIIKP25YO43YXOMN7FPAA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190947998 (1395h26m42.543733126s) [noise=true , address=145.79.227.4:4187 , piece_id=DF4BRUCC74SXLIDTDMDBOG5WO6PXJFTKQMGECBCC5L6TZ62KFHXA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.297040350 (1395h26m42.649825448s) [upload=1228121]: Next returned nil segment
Oct 26 17:35:07.297053745 (1395h26m42.649838853s) [upload=1228121]: Waiting for error group managing segments...
Oct 26 17:35:07.305931625 (1395h26m42.658716733s) [noise=true , address=145.79.227.11:4730 , piece_id=QQMH363G5WT2FNHWQ2PURVIGYY6DMKYGCLFMRX74UKESV4TCGJ5A, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.306566537 (1395h26m42.659351645s) [noise=true , address=145.79.227.6:4258 , piece_id=IUHFPMGJUROKRJNKWOQIFDGUQOMDCTE2SKWK5BZSCOOMGGICLGIQ, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.306883511 (1395h26m42.659668649s) [noise=true , address=145.79.227.26:4655 , piece_id=7K42QWK7NC2TBCTQULFEEVWQ76QP5EXS3B5INEEWH7UXCG4GO3CQ, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.306965455 (1395h26m42.659750563s) [noise=true , address=145.79.227.4:4187 , piece_id=DF4BRUCC74SXLIDTDMDBOG5WO6PXJFTKQMGECBCC5L6TZ62KFHXA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.307721434 (1395h26m42.660506561s) [noise=true , address=145.79.227.8:4329 , piece_id=ZXLBEI2RGGESWL7STOFDQ67UZEFVSCTCI7MMAVNDMOYXRVH64XBA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.308347728 (1395h26m42.661132836s) [noise=true , address=145.79.227.21:4475 , piece_id=YRC4PWH5USPXFF7R5IEGZHXTJVYNS2PJO6LCRMIZYFI5KDDPC6FA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.308701312 (1395h26m42.66148642s) [noise=true , address=145.79.227.9:4365 , piece_id=R6MMEBNCXEXFUHTER52XELUCBE34MA7EYGHEIAJUSVNHA6O6522Q, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.309023396 (1395h26m42.661808505s) [noise=true , address=145.79.227.7:4293 , piece_id=IV5Y5T6DNVLDH25AYG4S66BCDRYHA5YYSFHVDNHQ4AXD23CLAVRA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.309356411 (1395h26m42.662141519s) [noise=true , address=145.79.227.13:4802 , piece_id=LZFX5TWOUZT6DWYMJZABYFGZBXMFF7AGIIKP25YO43YXOMN7FPAA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.309707731 (1395h26m42.662492829s) [noise=true , address=77.90.31.16:4735 , piece_id=DY3I5Y72MOQAYNTQAYUBGMOSQCC4WJGHKJXT3657XG6N6RGKW4TQ, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.310024786 (1395h26m42.662809894s) [noise=true , address=77.90.31.11:4555 , piece_id=VDLZT5KLMYKQN35H6YDQFWSBQKPIGTA2PB2P5XCEQETICQNVXCRA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.310383207 (1395h26m42.663168315s) [noise=true , address=145.79.227.18:4007 , piece_id=6PV5ZSSWA3NIFAGM4HMV5WTB3PE2MYLZH4VHSNR6OH3IKBAVBKKA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.312827345 (1395h26m42.665612443s) [noise=true , address=45.91.116.4:4940 , piece_id=KP3MFRUNK3PYP2KQJ2B5FAWZE5LVJNRUNQWZ6HIOXRYFPVF3VRPA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.312835350 (1395h26m42.665620448s) [seg_pos={0 0}, upload=1228121]: Segment reached optimal threshold of 13 pieces.
Oct 26 17:35:07.312928664 (1395h26m42.665713773s) [noise=true , address=145.79.227.6:4259 , piece_id=JLNLQPDHWR5M7EMYWWPG3TSZ3XWSOP5HRBZDH2KKCHXB2E6Y2QNA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: expected piece hash; context canceled; EOF
Oct 26 17:35:07.313005950 (1395h26m42.665791058s) [noise=true , address=77.90.31.11:4554 , piece_id=4KP5SFY4TBPJ7PIVLK6JBNKPICNZI3IIVQUF4OLUP5NQVSQKE6ZA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Oct 26 17:35:07.313057477 (1395h26m42.665842585s) [noise=true , address=145.79.227.2:4113 , piece_id=3TNESZZYEM4HJA5QSVHJSP5RECPNH3KVO7HUSBF3A77QV5YHSN6A, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Oct 26 17:35:07.313066143 (1395h26m42.665851251s) [seg_pos={0 0}, upload=1228121]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 26 17:35:07.313118882 (1395h26m42.66590399s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 26 17:35:07.313122408 (1395h26m42.665907516s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 26 17:36:37.151476755 (1395h28m12.504261893s) [upload=1228121]: Done uploading segments...
Oct 26 17:36:37.151495209 (1395h28m12.504280348s) [upload=1228121]: Upload finished. err: metaclient: context deadline exceeded
Duration: 322.621479ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......................................................XX.X.] duration:
253.856911ms
FAIL (2025-10-26 17:38:40 UTC)
operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 26 17:37:29.239943729 (1395h29m4.592728837s) [upload=1228155]: Starting upload Oct 26 17:37:29.239994865 (1395h29m4.592779963s) [upload=1228155]: Done starting upload Oct 26 17:37:29.240040110 (1395h29m4.592825208s) [upload=1228155]: Uploading segments... Oct 26 17:37:29.240064296 (1395h29m4.592849404s) [upload=1228155]: Got next segment. Inline: true Oct 26 17:37:29.240068153 (1395h29m4.592853261s) [upload=1228155]: Waiting for error group managing segments... Oct 26 17:37:29.240097869 (1395h29m4.592882977s) [upload=1228155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 26 17:37:29.240101245 (1395h29m4.592886353s) [upload=1228155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 26 17:37:29.240103509 (1395h29m4.592888617s) [upload=1228155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 26 17:37:29.287686619 (1395h29m4.640471717s) [upload=1228155]: Done uploading segments... Oct 26 17:37:29.287700044 (1395h29m4.640485142s) [upload=1228155]: Upload finished. err: <nil>
Duration: 253.877911ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
356.744853ms
FAIL (2025-10-26 17:38:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 26 17:35:07.166165714 (1395h26m42.518950842s) [upload=1228121]: Starting upload
Oct 26 17:35:07.166268406 (1395h26m42.519053544s) [upload=1228121]: Done starting upload
Oct 26 17:35:07.166495883 (1395h26m42.519281011s) [upload=1228121]: Uploading segments...
Oct 26 17:35:07.166746414 (1395h26m42.519531542s) [upload=1228121]: Got next segment. Inline: false
Oct 26 17:35:07.166795456 (1395h26m42.519580584s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 26 17:35:07.166801187 (1395h26m42.519586314s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 26 17:35:07.188082010 (1395h26m42.540867108s) [seg_pos={0 0}, upload=1228121]: Begin upload segment...
Oct 26 17:35:07.188118017 (1395h26m42.540903125s) [seg_pos={0 0}, upload=1228121]: Done begin upload segment.
Oct 26 17:35:07.188139367 (1395h26m42.540924475s) [noise=true , address=77.90.31.11:4554 , piece_id=4KP5SFY4TBPJ7PIVLK6JBNKPICNZI3IIVQUF4OLUP5NQVSQKE6ZA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188187818 (1395h26m42.540972947s) [noise=true , address=145.79.227.6:4258 , piece_id=IUHFPMGJUROKRJNKWOQIFDGUQOMDCTE2SKWK5BZSCOOMGGICLGIQ, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188498822 (1395h26m42.54128393s) [noise=true , address=145.79.227.2:4113 , piece_id=3TNESZZYEM4HJA5QSVHJSP5RECPNH3KVO7HUSBF3A77QV5YHSN6A, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188707915 (1395h26m42.541493043s) [noise=true , address=145.79.227.21:4475 , piece_id=YRC4PWH5USPXFF7R5IEGZHXTJVYNS2PJO6LCRMIZYFI5KDDPC6FA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188732450 (1395h26m42.541517558s) [noise=true , address=145.79.227.6:4259 , piece_id=JLNLQPDHWR5M7EMYWWPG3TSZ3XWSOP5HRBZDH2KKCHXB2E6Y2QNA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188965037 (1395h26m42.541750145s) [noise=true , address=77.90.31.11:4555 , piece_id=VDLZT5KLMYKQN35H6YDQFWSBQKPIGTA2PB2P5XCEQETICQNVXCRA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189088609 (1395h26m42.541873737s) [noise=true , address=45.91.116.4:4940 , piece_id=KP3MFRUNK3PYP2KQJ2B5FAWZE5LVJNRUNQWZ6HIOXRYFPVF3VRPA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189221298 (1395h26m42.542006406s) [noise=true , address=145.79.227.7:4293 , piece_id=IV5Y5T6DNVLDH25AYG4S66BCDRYHA5YYSFHVDNHQ4AXD23CLAVRA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189458492 (1395h26m42.54224359s) [noise=true , address=145.79.227.8:4329 , piece_id=ZXLBEI2RGGESWL7STOFDQ67UZEFVSCTCI7MMAVNDMOYXRVH64XBA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189555204 (1395h26m42.542340332s) [noise=true , address=145.79.227.11:4730 , piece_id=QQMH363G5WT2FNHWQ2PURVIGYY6DMKYGCLFMRX74UKESV4TCGJ5A, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189713592 (1395h26m42.5424987s) [noise=true , address=77.90.31.16:4735 , piece_id=DY3I5Y72MOQAYNTQAYUBGMOSQCC4WJGHKJXT3657XG6N6RGKW4TQ, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189949564 (1395h26m42.542734672s) [noise=true , address=145.79.227.26:4655 , piece_id=7K42QWK7NC2TBCTQULFEEVWQ76QP5EXS3B5INEEWH7UXCG4GO3CQ, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190007012 (1395h26m42.54279214s) [noise=true , address=145.79.227.9:4365 , piece_id=R6MMEBNCXEXFUHTER52XELUCBE34MA7EYGHEIAJUSVNHA6O6522Q, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190219821 (1395h26m42.543004929s) [noise=true , address=145.79.227.18:4007 , piece_id=6PV5ZSSWA3NIFAGM4HMV5WTB3PE2MYLZH4VHSNR6OH3IKBAVBKKA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190444733 (1395h26m42.543229862s) [noise=true , address=145.79.227.13:4802 , piece_id=LZFX5TWOUZT6DWYMJZABYFGZBXMFF7AGIIKP25YO43YXOMN7FPAA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190947998 (1395h26m42.543733126s) [noise=true , address=145.79.227.4:4187 , piece_id=DF4BRUCC74SXLIDTDMDBOG5WO6PXJFTKQMGECBCC5L6TZ62KFHXA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.297040350 (1395h26m42.649825448s) [upload=1228121]: Next returned nil segment
Oct 26 17:35:07.297053745 (1395h26m42.649838853s) [upload=1228121]: Waiting for error group managing segments...
Oct 26 17:35:07.305931625 (1395h26m42.658716733s) [noise=true , address=145.79.227.11:4730 , piece_id=QQMH363G5WT2FNHWQ2PURVIGYY6DMKYGCLFMRX74UKESV4TCGJ5A, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.306566537 (1395h26m42.659351645s) [noise=true , address=145.79.227.6:4258 , piece_id=IUHFPMGJUROKRJNKWOQIFDGUQOMDCTE2SKWK5BZSCOOMGGICLGIQ, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.306883511 (1395h26m42.659668649s) [noise=true , address=145.79.227.26:4655 , piece_id=7K42QWK7NC2TBCTQULFEEVWQ76QP5EXS3B5INEEWH7UXCG4GO3CQ, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.306965455 (1395h26m42.659750563s) [noise=true , address=145.79.227.4:4187 , piece_id=DF4BRUCC74SXLIDTDMDBOG5WO6PXJFTKQMGECBCC5L6TZ62KFHXA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.307721434 (1395h26m42.660506561s) [noise=true , address=145.79.227.8:4329 , piece_id=ZXLBEI2RGGESWL7STOFDQ67UZEFVSCTCI7MMAVNDMOYXRVH64XBA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.308347728 (1395h26m42.661132836s) [noise=true , address=145.79.227.21:4475 , piece_id=YRC4PWH5USPXFF7R5IEGZHXTJVYNS2PJO6LCRMIZYFI5KDDPC6FA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.308701312 (1395h26m42.66148642s) [noise=true , address=145.79.227.9:4365 , piece_id=R6MMEBNCXEXFUHTER52XELUCBE34MA7EYGHEIAJUSVNHA6O6522Q, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.309023396 (1395h26m42.661808505s) [noise=true , address=145.79.227.7:4293 , piece_id=IV5Y5T6DNVLDH25AYG4S66BCDRYHA5YYSFHVDNHQ4AXD23CLAVRA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.309356411 (1395h26m42.662141519s) [noise=true , address=145.79.227.13:4802 , piece_id=LZFX5TWOUZT6DWYMJZABYFGZBXMFF7AGIIKP25YO43YXOMN7FPAA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.309707731 (1395h26m42.662492829s) [noise=true , address=77.90.31.16:4735 , piece_id=DY3I5Y72MOQAYNTQAYUBGMOSQCC4WJGHKJXT3657XG6N6RGKW4TQ, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.310024786 (1395h26m42.662809894s) [noise=true , address=77.90.31.11:4555 , piece_id=VDLZT5KLMYKQN35H6YDQFWSBQKPIGTA2PB2P5XCEQETICQNVXCRA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.310383207 (1395h26m42.663168315s) [noise=true , address=145.79.227.18:4007 , piece_id=6PV5ZSSWA3NIFAGM4HMV5WTB3PE2MYLZH4VHSNR6OH3IKBAVBKKA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.312827345 (1395h26m42.665612443s) [noise=true , address=45.91.116.4:4940 , piece_id=KP3MFRUNK3PYP2KQJ2B5FAWZE5LVJNRUNQWZ6HIOXRYFPVF3VRPA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.312835350 (1395h26m42.665620448s) [seg_pos={0 0}, upload=1228121]: Segment reached optimal threshold of 13 pieces.
Oct 26 17:35:07.312928664 (1395h26m42.665713773s) [noise=true , address=145.79.227.6:4259 , piece_id=JLNLQPDHWR5M7EMYWWPG3TSZ3XWSOP5HRBZDH2KKCHXB2E6Y2QNA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: expected piece hash; context canceled; EOF
Oct 26 17:35:07.313005950 (1395h26m42.665791058s) [noise=true , address=77.90.31.11:4554 , piece_id=4KP5SFY4TBPJ7PIVLK6JBNKPICNZI3IIVQUF4OLUP5NQVSQKE6ZA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Oct 26 17:35:07.313057477 (1395h26m42.665842585s) [noise=true , address=145.79.227.2:4113 , piece_id=3TNESZZYEM4HJA5QSVHJSP5RECPNH3KVO7HUSBF3A77QV5YHSN6A, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Oct 26 17:35:07.313066143 (1395h26m42.665851251s) [seg_pos={0 0}, upload=1228121]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 26 17:35:07.313118882 (1395h26m42.66590399s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 26 17:35:07.313122408 (1395h26m42.665907516s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 26 17:36:37.151476755 (1395h28m12.504261893s) [upload=1228121]: Done uploading segments...
Oct 26 17:36:37.151495209 (1395h28m12.504280348s) [upload=1228121]: Upload finished. err: metaclient: context deadline exceeded
Duration: 356.771131ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
3 out of 60 is failed (threshold=3) [........................................................XX.X] duration:
30.000726654s
FAIL (2025-10-26 17:37:59 UTC)
operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Oct 26 17:37:29.239943729 (1395h29m4.592728837s) [upload=1228155]: Starting upload Oct 26 17:37:29.239994865 (1395h29m4.592779963s) [upload=1228155]: Done starting upload Oct 26 17:37:29.240040110 (1395h29m4.592825208s) [upload=1228155]: Uploading segments... Oct 26 17:37:29.240064296 (1395h29m4.592849404s) [upload=1228155]: Got next segment. Inline: true Oct 26 17:37:29.240068153 (1395h29m4.592853261s) [upload=1228155]: Waiting for error group managing segments... Oct 26 17:37:29.240097869 (1395h29m4.592882977s) [upload=1228155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 26 17:37:29.240101245 (1395h29m4.592886353s) [upload=1228155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 26 17:37:29.240103509 (1395h29m4.592888617s) [upload=1228155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 26 17:37:29.287686619 (1395h29m4.640471717s) [upload=1228155]: Done uploading segments... Oct 26 17:37:29.287700044 (1395h29m4.640485142s) [upload=1228155]: Upload finished. err: <nil>
Duration: 30.000746231s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
364.645046ms
FAIL (2025-10-26 17:37:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 26 17:35:07.166165714 (1395h26m42.518950842s) [upload=1228121]: Starting upload
Oct 26 17:35:07.166268406 (1395h26m42.519053544s) [upload=1228121]: Done starting upload
Oct 26 17:35:07.166495883 (1395h26m42.519281011s) [upload=1228121]: Uploading segments...
Oct 26 17:35:07.166746414 (1395h26m42.519531542s) [upload=1228121]: Got next segment. Inline: false
Oct 26 17:35:07.166795456 (1395h26m42.519580584s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 26 17:35:07.166801187 (1395h26m42.519586314s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 26 17:35:07.188082010 (1395h26m42.540867108s) [seg_pos={0 0}, upload=1228121]: Begin upload segment...
Oct 26 17:35:07.188118017 (1395h26m42.540903125s) [seg_pos={0 0}, upload=1228121]: Done begin upload segment.
Oct 26 17:35:07.188139367 (1395h26m42.540924475s) [noise=true , address=77.90.31.11:4554 , piece_id=4KP5SFY4TBPJ7PIVLK6JBNKPICNZI3IIVQUF4OLUP5NQVSQKE6ZA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188187818 (1395h26m42.540972947s) [noise=true , address=145.79.227.6:4258 , piece_id=IUHFPMGJUROKRJNKWOQIFDGUQOMDCTE2SKWK5BZSCOOMGGICLGIQ, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188498822 (1395h26m42.54128393s) [noise=true , address=145.79.227.2:4113 , piece_id=3TNESZZYEM4HJA5QSVHJSP5RECPNH3KVO7HUSBF3A77QV5YHSN6A, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188707915 (1395h26m42.541493043s) [noise=true , address=145.79.227.21:4475 , piece_id=YRC4PWH5USPXFF7R5IEGZHXTJVYNS2PJO6LCRMIZYFI5KDDPC6FA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188732450 (1395h26m42.541517558s) [noise=true , address=145.79.227.6:4259 , piece_id=JLNLQPDHWR5M7EMYWWPG3TSZ3XWSOP5HRBZDH2KKCHXB2E6Y2QNA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188965037 (1395h26m42.541750145s) [noise=true , address=77.90.31.11:4555 , piece_id=VDLZT5KLMYKQN35H6YDQFWSBQKPIGTA2PB2P5XCEQETICQNVXCRA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189088609 (1395h26m42.541873737s) [noise=true , address=45.91.116.4:4940 , piece_id=KP3MFRUNK3PYP2KQJ2B5FAWZE5LVJNRUNQWZ6HIOXRYFPVF3VRPA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189221298 (1395h26m42.542006406s) [noise=true , address=145.79.227.7:4293 , piece_id=IV5Y5T6DNVLDH25AYG4S66BCDRYHA5YYSFHVDNHQ4AXD23CLAVRA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189458492 (1395h26m42.54224359s) [noise=true , address=145.79.227.8:4329 , piece_id=ZXLBEI2RGGESWL7STOFDQ67UZEFVSCTCI7MMAVNDMOYXRVH64XBA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189555204 (1395h26m42.542340332s) [noise=true , address=145.79.227.11:4730 , piece_id=QQMH363G5WT2FNHWQ2PURVIGYY6DMKYGCLFMRX74UKESV4TCGJ5A, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189713592 (1395h26m42.5424987s) [noise=true , address=77.90.31.16:4735 , piece_id=DY3I5Y72MOQAYNTQAYUBGMOSQCC4WJGHKJXT3657XG6N6RGKW4TQ, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189949564 (1395h26m42.542734672s) [noise=true , address=145.79.227.26:4655 , piece_id=7K42QWK7NC2TBCTQULFEEVWQ76QP5EXS3B5INEEWH7UXCG4GO3CQ, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190007012 (1395h26m42.54279214s) [noise=true , address=145.79.227.9:4365 , piece_id=R6MMEBNCXEXFUHTER52XELUCBE34MA7EYGHEIAJUSVNHA6O6522Q, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190219821 (1395h26m42.543004929s) [noise=true , address=145.79.227.18:4007 , piece_id=6PV5ZSSWA3NIFAGM4HMV5WTB3PE2MYLZH4VHSNR6OH3IKBAVBKKA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190444733 (1395h26m42.543229862s) [noise=true , address=145.79.227.13:4802 , piece_id=LZFX5TWOUZT6DWYMJZABYFGZBXMFF7AGIIKP25YO43YXOMN7FPAA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190947998 (1395h26m42.543733126s) [noise=true , address=145.79.227.4:4187 , piece_id=DF4BRUCC74SXLIDTDMDBOG5WO6PXJFTKQMGECBCC5L6TZ62KFHXA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.297040350 (1395h26m42.649825448s) [upload=1228121]: Next returned nil segment
Oct 26 17:35:07.297053745 (1395h26m42.649838853s) [upload=1228121]: Waiting for error group managing segments...
Oct 26 17:35:07.305931625 (1395h26m42.658716733s) [noise=true , address=145.79.227.11:4730 , piece_id=QQMH363G5WT2FNHWQ2PURVIGYY6DMKYGCLFMRX74UKESV4TCGJ5A, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.306566537 (1395h26m42.659351645s) [noise=true , address=145.79.227.6:4258 , piece_id=IUHFPMGJUROKRJNKWOQIFDGUQOMDCTE2SKWK5BZSCOOMGGICLGIQ, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.306883511 (1395h26m42.659668649s) [noise=true , address=145.79.227.26:4655 , piece_id=7K42QWK7NC2TBCTQULFEEVWQ76QP5EXS3B5INEEWH7UXCG4GO3CQ, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.306965455 (1395h26m42.659750563s) [noise=true , address=145.79.227.4:4187 , piece_id=DF4BRUCC74SXLIDTDMDBOG5WO6PXJFTKQMGECBCC5L6TZ62KFHXA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.307721434 (1395h26m42.660506561s) [noise=true , address=145.79.227.8:4329 , piece_id=ZXLBEI2RGGESWL7STOFDQ67UZEFVSCTCI7MMAVNDMOYXRVH64XBA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.308347728 (1395h26m42.661132836s) [noise=true , address=145.79.227.21:4475 , piece_id=YRC4PWH5USPXFF7R5IEGZHXTJVYNS2PJO6LCRMIZYFI5KDDPC6FA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.308701312 (1395h26m42.66148642s) [noise=true , address=145.79.227.9:4365 , piece_id=R6MMEBNCXEXFUHTER52XELUCBE34MA7EYGHEIAJUSVNHA6O6522Q, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.309023396 (1395h26m42.661808505s) [noise=true , address=145.79.227.7:4293 , piece_id=IV5Y5T6DNVLDH25AYG4S66BCDRYHA5YYSFHVDNHQ4AXD23CLAVRA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.309356411 (1395h26m42.662141519s) [noise=true , address=145.79.227.13:4802 , piece_id=LZFX5TWOUZT6DWYMJZABYFGZBXMFF7AGIIKP25YO43YXOMN7FPAA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.309707731 (1395h26m42.662492829s) [noise=true , address=77.90.31.16:4735 , piece_id=DY3I5Y72MOQAYNTQAYUBGMOSQCC4WJGHKJXT3657XG6N6RGKW4TQ, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.310024786 (1395h26m42.662809894s) [noise=true , address=77.90.31.11:4555 , piece_id=VDLZT5KLMYKQN35H6YDQFWSBQKPIGTA2PB2P5XCEQETICQNVXCRA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.310383207 (1395h26m42.663168315s) [noise=true , address=145.79.227.18:4007 , piece_id=6PV5ZSSWA3NIFAGM4HMV5WTB3PE2MYLZH4VHSNR6OH3IKBAVBKKA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.312827345 (1395h26m42.665612443s) [noise=true , address=45.91.116.4:4940 , piece_id=KP3MFRUNK3PYP2KQJ2B5FAWZE5LVJNRUNQWZ6HIOXRYFPVF3VRPA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.312835350 (1395h26m42.665620448s) [seg_pos={0 0}, upload=1228121]: Segment reached optimal threshold of 13 pieces.
Oct 26 17:35:07.312928664 (1395h26m42.665713773s) [noise=true , address=145.79.227.6:4259 , piece_id=JLNLQPDHWR5M7EMYWWPG3TSZ3XWSOP5HRBZDH2KKCHXB2E6Y2QNA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: expected piece hash; context canceled; EOF
Oct 26 17:35:07.313005950 (1395h26m42.665791058s) [noise=true , address=77.90.31.11:4554 , piece_id=4KP5SFY4TBPJ7PIVLK6JBNKPICNZI3IIVQUF4OLUP5NQVSQKE6ZA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Oct 26 17:35:07.313057477 (1395h26m42.665842585s) [noise=true , address=145.79.227.2:4113 , piece_id=3TNESZZYEM4HJA5QSVHJSP5RECPNH3KVO7HUSBF3A77QV5YHSN6A, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Oct 26 17:35:07.313066143 (1395h26m42.665851251s) [seg_pos={0 0}, upload=1228121]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 26 17:35:07.313118882 (1395h26m42.66590399s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 26 17:35:07.313122408 (1395h26m42.665907516s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 26 17:36:37.151476755 (1395h28m12.504261893s) [upload=1228121]: Done uploading segments...
Oct 26 17:36:37.151495209 (1395h28m12.504280348s) [upload=1228121]: Upload finished. err: metaclient: context deadline exceeded
Duration: 364.664965ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
370.128404ms
FAIL (2025-10-26 17:37:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 26 17:35:07.166165714 (1395h26m42.518950842s) [upload=1228121]: Starting upload
Oct 26 17:35:07.166268406 (1395h26m42.519053544s) [upload=1228121]: Done starting upload
Oct 26 17:35:07.166495883 (1395h26m42.519281011s) [upload=1228121]: Uploading segments...
Oct 26 17:35:07.166746414 (1395h26m42.519531542s) [upload=1228121]: Got next segment. Inline: false
Oct 26 17:35:07.166795456 (1395h26m42.519580584s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 26 17:35:07.166801187 (1395h26m42.519586314s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 26 17:35:07.188082010 (1395h26m42.540867108s) [seg_pos={0 0}, upload=1228121]: Begin upload segment...
Oct 26 17:35:07.188118017 (1395h26m42.540903125s) [seg_pos={0 0}, upload=1228121]: Done begin upload segment.
Oct 26 17:35:07.188139367 (1395h26m42.540924475s) [noise=true , address=77.90.31.11:4554 , piece_id=4KP5SFY4TBPJ7PIVLK6JBNKPICNZI3IIVQUF4OLUP5NQVSQKE6ZA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188187818 (1395h26m42.540972947s) [noise=true , address=145.79.227.6:4258 , piece_id=IUHFPMGJUROKRJNKWOQIFDGUQOMDCTE2SKWK5BZSCOOMGGICLGIQ, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188498822 (1395h26m42.54128393s) [noise=true , address=145.79.227.2:4113 , piece_id=3TNESZZYEM4HJA5QSVHJSP5RECPNH3KVO7HUSBF3A77QV5YHSN6A, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188707915 (1395h26m42.541493043s) [noise=true , address=145.79.227.21:4475 , piece_id=YRC4PWH5USPXFF7R5IEGZHXTJVYNS2PJO6LCRMIZYFI5KDDPC6FA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188732450 (1395h26m42.541517558s) [noise=true , address=145.79.227.6:4259 , piece_id=JLNLQPDHWR5M7EMYWWPG3TSZ3XWSOP5HRBZDH2KKCHXB2E6Y2QNA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188965037 (1395h26m42.541750145s) [noise=true , address=77.90.31.11:4555 , piece_id=VDLZT5KLMYKQN35H6YDQFWSBQKPIGTA2PB2P5XCEQETICQNVXCRA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189088609 (1395h26m42.541873737s) [noise=true , address=45.91.116.4:4940 , piece_id=KP3MFRUNK3PYP2KQJ2B5FAWZE5LVJNRUNQWZ6HIOXRYFPVF3VRPA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189221298 (1395h26m42.542006406s) [noise=true , address=145.79.227.7:4293 , piece_id=IV5Y5T6DNVLDH25AYG4S66BCDRYHA5YYSFHVDNHQ4AXD23CLAVRA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189458492 (1395h26m42.54224359s) [noise=true , address=145.79.227.8:4329 , piece_id=ZXLBEI2RGGESWL7STOFDQ67UZEFVSCTCI7MMAVNDMOYXRVH64XBA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189555204 (1395h26m42.542340332s) [noise=true , address=145.79.227.11:4730 , piece_id=QQMH363G5WT2FNHWQ2PURVIGYY6DMKYGCLFMRX74UKESV4TCGJ5A, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189713592 (1395h26m42.5424987s) [noise=true , address=77.90.31.16:4735 , piece_id=DY3I5Y72MOQAYNTQAYUBGMOSQCC4WJGHKJXT3657XG6N6RGKW4TQ, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189949564 (1395h26m42.542734672s) [noise=true , address=145.79.227.26:4655 , piece_id=7K42QWK7NC2TBCTQULFEEVWQ76QP5EXS3B5INEEWH7UXCG4GO3CQ, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190007012 (1395h26m42.54279214s) [noise=true , address=145.79.227.9:4365 , piece_id=R6MMEBNCXEXFUHTER52XELUCBE34MA7EYGHEIAJUSVNHA6O6522Q, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190219821 (1395h26m42.543004929s) [noise=true , address=145.79.227.18:4007 , piece_id=6PV5ZSSWA3NIFAGM4HMV5WTB3PE2MYLZH4VHSNR6OH3IKBAVBKKA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190444733 (1395h26m42.543229862s) [noise=true , address=145.79.227.13:4802 , piece_id=LZFX5TWOUZT6DWYMJZABYFGZBXMFF7AGIIKP25YO43YXOMN7FPAA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190947998 (1395h26m42.543733126s) [noise=true , address=145.79.227.4:4187 , piece_id=DF4BRUCC74SXLIDTDMDBOG5WO6PXJFTKQMGECBCC5L6TZ62KFHXA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.297040350 (1395h26m42.649825448s) [upload=1228121]: Next returned nil segment
Oct 26 17:35:07.297053745 (1395h26m42.649838853s) [upload=1228121]: Waiting for error group managing segments...
Oct 26 17:35:07.305931625 (1395h26m42.658716733s) [noise=true , address=145.79.227.11:4730 , piece_id=QQMH363G5WT2FNHWQ2PURVIGYY6DMKYGCLFMRX74UKESV4TCGJ5A, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.306566537 (1395h26m42.659351645s) [noise=true , address=145.79.227.6:4258 , piece_id=IUHFPMGJUROKRJNKWOQIFDGUQOMDCTE2SKWK5BZSCOOMGGICLGIQ, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.306883511 (1395h26m42.659668649s) [noise=true , address=145.79.227.26:4655 , piece_id=7K42QWK7NC2TBCTQULFEEVWQ76QP5EXS3B5INEEWH7UXCG4GO3CQ, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.306965455 (1395h26m42.659750563s) [noise=true , address=145.79.227.4:4187 , piece_id=DF4BRUCC74SXLIDTDMDBOG5WO6PXJFTKQMGECBCC5L6TZ62KFHXA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.307721434 (1395h26m42.660506561s) [noise=true , address=145.79.227.8:4329 , piece_id=ZXLBEI2RGGESWL7STOFDQ67UZEFVSCTCI7MMAVNDMOYXRVH64XBA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.308347728 (1395h26m42.661132836s) [noise=true , address=145.79.227.21:4475 , piece_id=YRC4PWH5USPXFF7R5IEGZHXTJVYNS2PJO6LCRMIZYFI5KDDPC6FA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.308701312 (1395h26m42.66148642s) [noise=true , address=145.79.227.9:4365 , piece_id=R6MMEBNCXEXFUHTER52XELUCBE34MA7EYGHEIAJUSVNHA6O6522Q, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.309023396 (1395h26m42.661808505s) [noise=true , address=145.79.227.7:4293 , piece_id=IV5Y5T6DNVLDH25AYG4S66BCDRYHA5YYSFHVDNHQ4AXD23CLAVRA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.309356411 (1395h26m42.662141519s) [noise=true , address=145.79.227.13:4802 , piece_id=LZFX5TWOUZT6DWYMJZABYFGZBXMFF7AGIIKP25YO43YXOMN7FPAA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.309707731 (1395h26m42.662492829s) [noise=true , address=77.90.31.16:4735 , piece_id=DY3I5Y72MOQAYNTQAYUBGMOSQCC4WJGHKJXT3657XG6N6RGKW4TQ, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.310024786 (1395h26m42.662809894s) [noise=true , address=77.90.31.11:4555 , piece_id=VDLZT5KLMYKQN35H6YDQFWSBQKPIGTA2PB2P5XCEQETICQNVXCRA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.310383207 (1395h26m42.663168315s) [noise=true , address=145.79.227.18:4007 , piece_id=6PV5ZSSWA3NIFAGM4HMV5WTB3PE2MYLZH4VHSNR6OH3IKBAVBKKA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.312827345 (1395h26m42.665612443s) [noise=true , address=45.91.116.4:4940 , piece_id=KP3MFRUNK3PYP2KQJ2B5FAWZE5LVJNRUNQWZ6HIOXRYFPVF3VRPA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.312835350 (1395h26m42.665620448s) [seg_pos={0 0}, upload=1228121]: Segment reached optimal threshold of 13 pieces.
Oct 26 17:35:07.312928664 (1395h26m42.665713773s) [noise=true , address=145.79.227.6:4259 , piece_id=JLNLQPDHWR5M7EMYWWPG3TSZ3XWSOP5HRBZDH2KKCHXB2E6Y2QNA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: expected piece hash; context canceled; EOF
Oct 26 17:35:07.313005950 (1395h26m42.665791058s) [noise=true , address=77.90.31.11:4554 , piece_id=4KP5SFY4TBPJ7PIVLK6JBNKPICNZI3IIVQUF4OLUP5NQVSQKE6ZA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Oct 26 17:35:07.313057477 (1395h26m42.665842585s) [noise=true , address=145.79.227.2:4113 , piece_id=3TNESZZYEM4HJA5QSVHJSP5RECPNH3KVO7HUSBF3A77QV5YHSN6A, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Oct 26 17:35:07.313066143 (1395h26m42.665851251s) [seg_pos={0 0}, upload=1228121]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 26 17:35:07.313118882 (1395h26m42.66590399s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 26 17:35:07.313122408 (1395h26m42.665907516s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 26 17:36:37.151476755 (1395h28m12.504261893s) [upload=1228121]: Done uploading segments...
Oct 26 17:36:37.151495209 (1395h28m12.504280348s) [upload=1228121]: Upload finished. err: metaclient: context deadline exceeded
Duration: 370.152659ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................................................XX.] duration:
169.11232ms
FAIL (2025-10-26 17:37:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 26 17:36:26.057636263 (1395h28m1.410421411s) [upload=1228136]: Starting upload Oct 26 17:36:26.057711163 (1395h28m1.410496271s) [upload=1228136]: Done starting upload Oct 26 17:36:26.057763832 (1395h28m1.41054894s) [upload=1228136]: Uploading segments... Oct 26 17:36:26.057816761 (1395h28m1.410601858s) [upload=1228136]: Got next segment. Inline: true Oct 26 17:36:26.057821990 (1395h28m1.410607099s) [upload=1228136]: Waiting for error group managing segments... Oct 26 17:36:26.057864140 (1395h28m1.410649248s) [upload=1228136]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 26 17:36:26.057869409 (1395h28m1.410654517s) [upload=1228136]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 26 17:36:26.057873357 (1395h28m1.410658465s) [upload=1228136]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 26 17:36:56.044762005 (1395h28m31.397547113s) [upload=1228136]: Done uploading segments... Oct 26 17:36:56.044777734 (1395h28m31.397562832s) [upload=1228136]: Upload finished. err: metaclient: context deadline exceeded
Duration: 169.129924ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
30.000387268s
FAIL (2025-10-26 17:36:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 26 17:36:26.057636263 (1395h28m1.410421411s) [upload=1228136]: Starting upload Oct 26 17:36:26.057711163 (1395h28m1.410496271s) [upload=1228136]: Done starting upload Oct 26 17:36:26.057763832 (1395h28m1.41054894s) [upload=1228136]: Uploading segments... Oct 26 17:36:26.057816761 (1395h28m1.410601858s) [upload=1228136]: Got next segment. Inline: true Oct 26 17:36:26.057821990 (1395h28m1.410607099s) [upload=1228136]: Waiting for error group managing segments... Oct 26 17:36:26.057864140 (1395h28m1.410649248s) [upload=1228136]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 26 17:36:26.057869409 (1395h28m1.410654517s) [upload=1228136]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 26 17:36:26.057873357 (1395h28m1.410658465s) [upload=1228136]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 26 17:36:56.044762005 (1395h28m31.397547113s) [upload=1228136]: Done uploading segments... Oct 26 17:36:56.044777734 (1395h28m31.397562832s) [upload=1228136]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.000403308s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
396.935701ms
FAIL (2025-10-26 17:36:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Oct 26 17:35:07.166165714 (1395h26m42.518950842s) [upload=1228121]: Starting upload
Oct 26 17:35:07.166268406 (1395h26m42.519053544s) [upload=1228121]: Done starting upload
Oct 26 17:35:07.166495883 (1395h26m42.519281011s) [upload=1228121]: Uploading segments...
Oct 26 17:35:07.166746414 (1395h26m42.519531542s) [upload=1228121]: Got next segment. Inline: false
Oct 26 17:35:07.166795456 (1395h26m42.519580584s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Oct 26 17:35:07.166801187 (1395h26m42.519586314s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Oct 26 17:35:07.188082010 (1395h26m42.540867108s) [seg_pos={0 0}, upload=1228121]: Begin upload segment...
Oct 26 17:35:07.188118017 (1395h26m42.540903125s) [seg_pos={0 0}, upload=1228121]: Done begin upload segment.
Oct 26 17:35:07.188139367 (1395h26m42.540924475s) [noise=true , address=77.90.31.11:4554 , piece_id=4KP5SFY4TBPJ7PIVLK6JBNKPICNZI3IIVQUF4OLUP5NQVSQKE6ZA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188187818 (1395h26m42.540972947s) [noise=true , address=145.79.227.6:4258 , piece_id=IUHFPMGJUROKRJNKWOQIFDGUQOMDCTE2SKWK5BZSCOOMGGICLGIQ, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188498822 (1395h26m42.54128393s) [noise=true , address=145.79.227.2:4113 , piece_id=3TNESZZYEM4HJA5QSVHJSP5RECPNH3KVO7HUSBF3A77QV5YHSN6A, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188707915 (1395h26m42.541493043s) [noise=true , address=145.79.227.21:4475 , piece_id=YRC4PWH5USPXFF7R5IEGZHXTJVYNS2PJO6LCRMIZYFI5KDDPC6FA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188732450 (1395h26m42.541517558s) [noise=true , address=145.79.227.6:4259 , piece_id=JLNLQPDHWR5M7EMYWWPG3TSZ3XWSOP5HRBZDH2KKCHXB2E6Y2QNA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.188965037 (1395h26m42.541750145s) [noise=true , address=77.90.31.11:4555 , piece_id=VDLZT5KLMYKQN35H6YDQFWSBQKPIGTA2PB2P5XCEQETICQNVXCRA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189088609 (1395h26m42.541873737s) [noise=true , address=45.91.116.4:4940 , piece_id=KP3MFRUNK3PYP2KQJ2B5FAWZE5LVJNRUNQWZ6HIOXRYFPVF3VRPA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189221298 (1395h26m42.542006406s) [noise=true , address=145.79.227.7:4293 , piece_id=IV5Y5T6DNVLDH25AYG4S66BCDRYHA5YYSFHVDNHQ4AXD23CLAVRA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189458492 (1395h26m42.54224359s) [noise=true , address=145.79.227.8:4329 , piece_id=ZXLBEI2RGGESWL7STOFDQ67UZEFVSCTCI7MMAVNDMOYXRVH64XBA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189555204 (1395h26m42.542340332s) [noise=true , address=145.79.227.11:4730 , piece_id=QQMH363G5WT2FNHWQ2PURVIGYY6DMKYGCLFMRX74UKESV4TCGJ5A, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189713592 (1395h26m42.5424987s) [noise=true , address=77.90.31.16:4735 , piece_id=DY3I5Y72MOQAYNTQAYUBGMOSQCC4WJGHKJXT3657XG6N6RGKW4TQ, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.189949564 (1395h26m42.542734672s) [noise=true , address=145.79.227.26:4655 , piece_id=7K42QWK7NC2TBCTQULFEEVWQ76QP5EXS3B5INEEWH7UXCG4GO3CQ, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190007012 (1395h26m42.54279214s) [noise=true , address=145.79.227.9:4365 , piece_id=R6MMEBNCXEXFUHTER52XELUCBE34MA7EYGHEIAJUSVNHA6O6522Q, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190219821 (1395h26m42.543004929s) [noise=true , address=145.79.227.18:4007 , piece_id=6PV5ZSSWA3NIFAGM4HMV5WTB3PE2MYLZH4VHSNR6OH3IKBAVBKKA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190444733 (1395h26m42.543229862s) [noise=true , address=145.79.227.13:4802 , piece_id=LZFX5TWOUZT6DWYMJZABYFGZBXMFF7AGIIKP25YO43YXOMN7FPAA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.190947998 (1395h26m42.543733126s) [noise=true , address=145.79.227.4:4187 , piece_id=DF4BRUCC74SXLIDTDMDBOG5WO6PXJFTKQMGECBCC5L6TZ62KFHXA, seg_pos={0 0}, upload=1228121]: Uploading piece...
Oct 26 17:35:07.297040350 (1395h26m42.649825448s) [upload=1228121]: Next returned nil segment
Oct 26 17:35:07.297053745 (1395h26m42.649838853s) [upload=1228121]: Waiting for error group managing segments...
Oct 26 17:35:07.305931625 (1395h26m42.658716733s) [noise=true , address=145.79.227.11:4730 , piece_id=QQMH363G5WT2FNHWQ2PURVIGYY6DMKYGCLFMRX74UKESV4TCGJ5A, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.306566537 (1395h26m42.659351645s) [noise=true , address=145.79.227.6:4258 , piece_id=IUHFPMGJUROKRJNKWOQIFDGUQOMDCTE2SKWK5BZSCOOMGGICLGIQ, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.306883511 (1395h26m42.659668649s) [noise=true , address=145.79.227.26:4655 , piece_id=7K42QWK7NC2TBCTQULFEEVWQ76QP5EXS3B5INEEWH7UXCG4GO3CQ, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.306965455 (1395h26m42.659750563s) [noise=true , address=145.79.227.4:4187 , piece_id=DF4BRUCC74SXLIDTDMDBOG5WO6PXJFTKQMGECBCC5L6TZ62KFHXA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.307721434 (1395h26m42.660506561s) [noise=true , address=145.79.227.8:4329 , piece_id=ZXLBEI2RGGESWL7STOFDQ67UZEFVSCTCI7MMAVNDMOYXRVH64XBA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.308347728 (1395h26m42.661132836s) [noise=true , address=145.79.227.21:4475 , piece_id=YRC4PWH5USPXFF7R5IEGZHXTJVYNS2PJO6LCRMIZYFI5KDDPC6FA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.308701312 (1395h26m42.66148642s) [noise=true , address=145.79.227.9:4365 , piece_id=R6MMEBNCXEXFUHTER52XELUCBE34MA7EYGHEIAJUSVNHA6O6522Q, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.309023396 (1395h26m42.661808505s) [noise=true , address=145.79.227.7:4293 , piece_id=IV5Y5T6DNVLDH25AYG4S66BCDRYHA5YYSFHVDNHQ4AXD23CLAVRA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.309356411 (1395h26m42.662141519s) [noise=true , address=145.79.227.13:4802 , piece_id=LZFX5TWOUZT6DWYMJZABYFGZBXMFF7AGIIKP25YO43YXOMN7FPAA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.309707731 (1395h26m42.662492829s) [noise=true , address=77.90.31.16:4735 , piece_id=DY3I5Y72MOQAYNTQAYUBGMOSQCC4WJGHKJXT3657XG6N6RGKW4TQ, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.310024786 (1395h26m42.662809894s) [noise=true , address=77.90.31.11:4555 , piece_id=VDLZT5KLMYKQN35H6YDQFWSBQKPIGTA2PB2P5XCEQETICQNVXCRA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.310383207 (1395h26m42.663168315s) [noise=true , address=145.79.227.18:4007 , piece_id=6PV5ZSSWA3NIFAGM4HMV5WTB3PE2MYLZH4VHSNR6OH3IKBAVBKKA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.312827345 (1395h26m42.665612443s) [noise=true , address=45.91.116.4:4940 , piece_id=KP3MFRUNK3PYP2KQJ2B5FAWZE5LVJNRUNQWZ6HIOXRYFPVF3VRPA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: <nil>
Oct 26 17:35:07.312835350 (1395h26m42.665620448s) [seg_pos={0 0}, upload=1228121]: Segment reached optimal threshold of 13 pieces.
Oct 26 17:35:07.312928664 (1395h26m42.665713773s) [noise=true , address=145.79.227.6:4259 , piece_id=JLNLQPDHWR5M7EMYWWPG3TSZ3XWSOP5HRBZDH2KKCHXB2E6Y2QNA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y): protocol: expected piece hash; context canceled; EOF
Oct 26 17:35:07.313005950 (1395h26m42.665791058s) [noise=true , address=77.90.31.11:4554 , piece_id=4KP5SFY4TBPJ7PIVLK6JBNKPICNZI3IIVQUF4OLUP5NQVSQKE6ZA, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Oct 26 17:35:07.313057477 (1395h26m42.665842585s) [noise=true , address=145.79.227.2:4113 , piece_id=3TNESZZYEM4HJA5QSVHJSP5RECPNH3KVO7HUSBF3A77QV5YHSN6A, seg_pos={0 0}, upload=1228121]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Oct 26 17:35:07.313066143 (1395h26m42.665851251s) [seg_pos={0 0}, upload=1228121]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Oct 26 17:35:07.313118882 (1395h26m42.66590399s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Oct 26 17:35:07.313122408 (1395h26m42.665907516s) [upload=1228121]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Oct 26 17:36:37.151476755 (1395h28m12.504261893s) [upload=1228121]: Done uploading segments...
Oct 26 17:36:37.151495209 (1395h28m12.504280348s) [upload=1228121]: Upload finished. err: metaclient: context deadline exceeded
Duration: 396.957793ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001307352s
FAIL (2025-10-26 17:36:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 26 17:35:48.661966647 (1395h27m24.014751775s) [upload=1228130]: Starting upload Oct 26 17:35:48.662047428 (1395h27m24.014832557s) [upload=1228130]: Done starting upload Oct 26 17:35:48.662123611 (1395h27m24.01490875s) [upload=1228130]: Uploading segments... Oct 26 17:35:48.662164057 (1395h27m24.014949195s) [upload=1228130]: Got next segment. Inline: true Oct 26 17:35:48.662169438 (1395h27m24.014954575s) [upload=1228130]: Waiting for error group managing segments... Oct 26 17:35:48.662233007 (1395h27m24.015018134s) [upload=1228130]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 26 17:35:48.662238657 (1395h27m24.015023785s) [upload=1228130]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 26 17:35:48.662242344 (1395h27m24.015027483s) [upload=1228130]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 26 17:36:18.648048346 (1395h27m54.000833445s) [upload=1228130]: Done uploading segments... Oct 26 17:36:18.648066500 (1395h27m54.000851599s) [upload=1228130]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.001328632s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
4.871241697s
FAIL (2025-10-26 17:07:51 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 4.871264119s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
4.89511037s
FAIL (2025-10-26 17:07:27 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 4.895135246s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
5.331149796s
FAIL (2025-10-26 17:06:15 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.331179582s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
5.31148742s
FAIL (2025-10-26 17:06:00 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.311508248s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
5.148369931s
FAIL (2025-10-26 17:04:46 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.148434873s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
5.065929585s
FAIL (2025-10-26 17:04:20 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.065952268s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
5.212473331s
FAIL (2025-10-26 17:03:26 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.212488539s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
5.300884383s
FAIL (2025-10-26 17:02:57 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.300905252s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
5.269097219s
FAIL (2025-10-26 17:02:37 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.269122356s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
4.846247047s
FAIL (2025-10-26 17:01:43 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 4.84626551s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
5.118256082s
FAIL (2025-10-26 17:01:25 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.118277992s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
5.09875165s
FAIL (2025-10-26 17:00:26 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.098773551s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
5.027320654s
FAIL (2025-10-26 16:59:58 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.027346722s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
5.072366088s
FAIL (2025-10-26 16:59:11 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.072387979s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
5.109588864s
FAIL (2025-10-26 16:58:46 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.109606809s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
4.898729185s
FAIL (2025-10-26 16:57:51 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 4.898745105s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
5.329478889s
FAIL (2025-10-26 16:57:05 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.329505531s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
5.063419078s
FAIL (2025-10-26 16:56:25 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.063445148s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
5.329816322s
FAIL (2025-10-26 16:55:22 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.329835579s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
5.115927099s
FAIL (2025-10-26 16:54:44 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.115949782s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
5.196082094s
FAIL (2025-10-26 16:53:58 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.196101301s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
5.090062069s
FAIL (2025-10-26 16:52:53 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.090088829s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
5.151564072s
FAIL (2025-10-26 16:52:10 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.15158431s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
5.194709411s
FAIL (2025-10-26 16:51:22 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.194732373s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
5.076757448s
FAIL (2025-10-26 16:50:20 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.076787234s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
5.088837445s
FAIL (2025-10-26 16:49:41 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.088859307s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
5.334273036s
FAIL (2025-10-26 16:49:16 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.334297451s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
5.138350074s
FAIL (2025-10-26 16:48:07 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.138372496s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
5.307140706s
FAIL (2025-10-26 16:47:04 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.307166274s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
5.004310368s
FAIL (2025-10-26 16:46:31 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.004337598s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
5.204300764s
FAIL (2025-10-26 16:45:31 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.204322374s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
4.873329208s
FAIL (2025-10-26 16:44:45 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 4.873352281s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
5.261445113s
FAIL (2025-10-26 16:44:28 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.261468786s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
5.086084118s
FAIL (2025-10-26 16:43:43 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.086107903s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
5.236137101s
FAIL (2025-10-26 16:43:01 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.236181233s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
5.253187587s
FAIL (2025-10-26 16:42:17 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.253211922s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
5.031217255s
FAIL (2025-10-26 16:41:26 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.031252021s
core
uplink
ap1
|