Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [...........X.XXXXXX..X......................................] duration: 398.828105ms FAIL (2025-09-22 02:43:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 398.850808ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 25 out of 60 is failed (threshold=3) [............XXX....XXX.XXXXX..X.XX.XX.XX......XX..X....XX.XX] duration: 30.016602007s FAIL (2025-09-22 02:43:20 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Sep 22 02:42:50.521772583 (564h34m25.87455771s) [upload=496851]: Starting upload Sep 22 02:42:50.521844217 (564h34m25.874629355s) [upload=496851]: Done starting upload Sep 22 02:42:50.521983700 (564h34m25.874768837s) [upload=496851]: Uploading segments... Sep 22 02:42:50.522296246 (564h34m25.875081383s) [upload=496851]: Got next segment. Inline: false Sep 22 02:42:50.522344176 (564h34m25.875129303s) [upload=496851]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:42:50.522350197 (564h34m25.875135324s) [upload=496851]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:42:50.545915148 (564h34m25.898700286s) [seg_pos={0 0}, upload=496851]: Begin upload segment... Sep 22 02:42:50.545959401 (564h34m25.898744529s) [seg_pos={0 0}, upload=496851]: Done begin upload segment. Sep 22 02:42:50.545995498 (564h34m25.898780597s) [noise=true , address=145.79.227.16:4909 , piece_id=PXYRUVAOLSDPPXK2XNCJAGDBKLQBC6XO33EA7FJXO3LYELN3BFFA, seg_pos={0 0}, upload=496851]: Uploading piece... Sep 22 02:42:50.546009024 (564h34m25.898794152s) [noise=true , address=45.91.116.4:4938 , piece_id=JJMGGBUSJBSQCAQJFWSVHG2DBPSS6A5WVMJI2IKKGSJOAQQ6L5LQ, seg_pos={0 0}, upload=496851]: Uploading piece... Sep 22 02:42:50.546351287 (564h34m25.899136395s) [noise=true , address=145.79.227.7:4294 , piece_id=BIXI6LPZU3YKPPOWXVQEOXHZO3MODCWWGWC2ZN66PAXMI5YXRN3A, seg_pos={0 0}, upload=496851]: Uploading piece... Sep 22 02:42:50.546502751 (564h34m25.899287879s) [noise=true , address=45.91.116.14:4190 , piece_id=FDVKYATAT2PDQ5OQMEQGNEWFJJVZZYPRLOBG7XVONONCLFCUT7SQ, seg_pos={0 0}, upload=496851]: Uploading piece... Sep 22 02:42:50.546599933 (564h34m25.899385042s) [noise=true , address=77.90.31.12:4592 , piece_id=TSZ7V4W4GTBBHQULDV4XLJOJHQW7LRYXLGFGYTHJIE4OGVBPYLGA, seg_pos={0 0}, upload=496851]: Uploading piece... Sep 22 02:42:50.546817021 (564h34m25.899602129s) [noise=true , address=77.90.31.21:4877 , piece_id=4SPQLT2TCPYXTVXV2DIZCU6UFSFPMBTWULKJRLZLLQJWJFREQZWQ, seg_pos={0 0}, upload=496851]: Uploading piece... Sep 22 02:42:50.546874418 (564h34m25.899659546s) [noise=true , address=45.91.116.10:4081 , piece_id=AKJVUNQSURBLCWOZRHMHOFQDUHAQ4FXWQB2VRESBB4XUYE3UND4A, seg_pos={0 0}, upload=496851]: Uploading piece... Sep 22 02:42:50.547301039 (564h34m25.900086167s) [noise=true , address=145.79.227.16:4910 , piece_id=TXCHGXFSLEFIUDLZAJBOIN7G6FCPFZHEPK3NGHTGFDEYYLI4SAIQ, seg_pos={0 0}, upload=496851]: Uploading piece... Sep 22 02:42:50.547821846 (564h34m25.900606974s) [noise=true , address=45.91.116.6:4975 , piece_id=J52XOLKSC3KJJZREZ4BSJEFYJF7VGWZJM3SGNGMCSHGLFMNOZYWQ, seg_pos={0 0}, upload=496851]: Uploading piece... Sep 22 02:42:50.548349787 (564h34m25.901134915s) [noise=true , address=45.91.116.5:4298 , piece_id=BAP62UGV3NYNYJYA2KKEFCR2E6RJCWKFZQDO5B2RVA6ENMOJL43A, seg_pos={0 0}, upload=496851]: Uploading piece... Sep 22 02:42:50.548727095 (564h34m25.901512222s) [noise=true , address=45.91.116.8:4045 , piece_id=V73DD6MEECD3KOOLRVW5JSKHUXDJH2UW3UAFV5SCMB6TCGG4AXLA, seg_pos={0 0}, upload=496851]: Uploading piece... Sep 22 02:42:50.549104955 (564h34m25.901890092s) [noise=true , address=145.79.227.4:4186 , piece_id=ZJPRUCCVSUM7CP47C6R6Q7WHAF6OU4OYACZKHO3ICQLH73JLDO6A, seg_pos={0 0}, upload=496851]: Uploading piece... Sep 22 02:42:50.549456403 (564h34m25.902241542s) [noise=true , address=77.90.31.19:4841 , piece_id=M6DXNZ56RDUWRFVL5HYBPC3CB3UZJOP24BRLZJ54FKL7MDNCL24Q, seg_pos={0 0}, upload=496851]: Uploading piece... Sep 22 02:42:50.549825386 (564h34m25.902610514s) [noise=true , address=45.91.116.8:4048 , piece_id=ZOGZE6TXAGGF3WICGJVQYHFPQX3DODMW3OAZEPJSD5DV6BSR77DA, seg_pos={0 0}, upload=496851]: Uploading piece... Sep 22 02:42:50.550166927 (564h34m25.902952055s) [noise=true , address=45.91.116.7:4011 , piece_id=5ADOF2TSGEBQYW2HHRXVERFBZBHFNUDRZVUBAPAV62QVMNGHEQUQ, seg_pos={0 0}, upload=496851]: Uploading piece... Sep 22 02:42:50.550597084 (564h34m25.903382212s) [noise=true , address=145.79.227.5:4222 , piece_id=WMFNDKDUNYHNXGE5J3PX5LIMOCUMHKKTIWAAACNHUX2L5VEF7VFA, seg_pos={0 0}, upload=496851]: Uploading piece... Sep 22 02:42:50.618401124 (564h34m25.971186232s) [upload=496851]: Next returned nil segment Sep 22 02:42:50.618412886 (564h34m25.971197984s) [upload=496851]: Waiting for error group managing segments... Sep 22 02:42:50.626733901 (564h34m25.979518999s) [noise=true , address=45.91.116.14:4190 , piece_id=FDVKYATAT2PDQ5OQMEQGNEWFJJVZZYPRLOBG7XVONONCLFCUT7SQ, seg_pos={0 0}, upload=496851]: Done uploading piece. err: <nil> Sep 22 02:42:50.628225489 (564h34m25.981010588s) [noise=true , address=77.90.31.12:4592 , piece_id=TSZ7V4W4GTBBHQULDV4XLJOJHQW7LRYXLGFGYTHJIE4OGVBPYLGA, seg_pos={0 0}, upload=496851]: Done uploading piece. err: <nil> Sep 22 02:42:50.628284640 (564h34m25.981069748s) [noise=true , address=45.91.116.8:4045 , piece_id=V73DD6MEECD3KOOLRVW5JSKHUXDJH2UW3UAFV5SCMB6TCGG4AXLA, seg_pos={0 0}, upload=496851]: Done uploading piece. err: <nil> Sep 22 02:42:50.628870069 (564h34m25.981655167s) [noise=true , address=45.91.116.8:4048 , piece_id=ZOGZE6TXAGGF3WICGJVQYHFPQX3DODMW3OAZEPJSD5DV6BSR77DA, seg_pos={0 0}, upload=496851]: Done uploading piece. err: <nil> Sep 22 02:42:50.629817618 (564h34m25.982602715s) [noise=true , address=45.91.116.5:4298 , piece_id=BAP62UGV3NYNYJYA2KKEFCR2E6RJCWKFZQDO5B2RVA6ENMOJL43A, seg_pos={0 0}, upload=496851]: Done uploading piece. err: <nil> Sep 22 02:42:50.630712165 (564h34m25.983497263s) [noise=true , address=77.90.31.21:4877 , piece_id=4SPQLT2TCPYXTVXV2DIZCU6UFSFPMBTWULKJRLZLLQJWJFREQZWQ, seg_pos={0 0}, upload=496851]: Done uploading piece. err: <nil> Sep 22 02:42:50.636401722 (564h34m25.98918682s) [noise=true , address=45.91.116.10:4081 , piece_id=AKJVUNQSURBLCWOZRHMHOFQDUHAQ4FXWQB2VRESBB4XUYE3UND4A, seg_pos={0 0}, upload=496851]: Done uploading piece. err: <nil> Sep 22 02:42:50.637267287 (564h34m25.990052385s) [noise=true , address=77.90.31.19:4841 , piece_id=M6DXNZ56RDUWRFVL5HYBPC3CB3UZJOP24BRLZJ54FKL7MDNCL24Q, seg_pos={0 0}, upload=496851]: Done uploading piece. err: <nil> Sep 22 02:42:50.637753379 (564h34m25.990538487s) [noise=true , address=45.91.116.7:4011 , piece_id=5ADOF2TSGEBQYW2HHRXVERFBZBHFNUDRZVUBAPAV62QVMNGHEQUQ, seg_pos={0 0}, upload=496851]: Done uploading piece. err: <nil> Sep 22 02:42:50.639989695 (564h34m25.992774793s) [noise=true , address=45.91.116.6:4975 , piece_id=J52XOLKSC3KJJZREZ4BSJEFYJF7VGWZJM3SGNGMCSHGLFMNOZYWQ, seg_pos={0 0}, upload=496851]: Done uploading piece. err: <nil> Sep 22 02:42:50.646750113 (564h34m25.999535221s) [noise=true , address=45.91.116.4:4938 , piece_id=JJMGGBUSJBSQCAQJFWSVHG2DBPSS6A5WVMJI2IKKGSJOAQQ6L5LQ, seg_pos={0 0}, upload=496851]: Done uploading piece. err: <nil> Sep 22 02:43:20.505368563 (564h34m55.858153671s) [noise=true , address=145.79.227.7:4294 , piece_id=BIXI6LPZU3YKPPOWXVQEOXHZO3MODCWWGWC2ZN66PAXMI5YXRN3A, seg_pos={0 0}, upload=496851]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: context deadline exceeded; context deadline exceeded Sep 22 02:43:20.505389101 (564h34m55.8581742s) [noise=true , address=145.79.227.4:4186 , piece_id=ZJPRUCCVSUM7CP47C6R6Q7WHAF6OU4OYACZKHO3ICQLH73JLDO6A, seg_pos={0 0}, upload=496851]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:43:20.505483208 (564h34m55.858268316s) [noise=true , address=145.79.227.16:4910 , piece_id=TXCHGXFSLEFIUDLZAJBOIN7G6FCPFZHEPK3NGHTGFDEYYLI4SAIQ, seg_pos={0 0}, upload=496851]: Done uploading piece. err: ecclient: upload failed (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn, address:145.79.227.16:4910): protocol: rpc: dial tcp 145.79.227.16:4910: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:43:20.505519466 (564h34m55.858304564s) [noise=true , address=145.79.227.16:4909 , piece_id=PXYRUVAOLSDPPXK2XNCJAGDBKLQBC6XO33EA7FJXO3LYELN3BFFA, seg_pos={0 0}, upload=496851]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: context deadline exceeded; context deadline exceeded Sep 22 02:43:20.505532340 (564h34m55.858317438s) [noise=true , address=145.79.227.5:4222 , piece_id=WMFNDKDUNYHNXGE5J3PX5LIMOCUMHKKTIWAAACNHUX2L5VEF7VFA, seg_pos={0 0}, upload=496851]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:43:20.505546577 (564h34m55.858331675s) [seg_pos={0 0}, upload=496851]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Sep 22 02:43:20.520293892 (564h34m55.873079s) [upload=496851]: Done uploading segments... Sep 22 02:43:20.520305814 (564h34m55.873090922s) [upload=496851]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 30.016622206s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [..............X.X.........X.......X...X.....X.XX..XX..X.....] duration: 375.508148ms FAIL (2025-09-22 02:42:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 375.525973ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [...............X.X.........X.......X...X.....X.XX..XX..X....] duration: 716.968432ms FAIL (2025-09-22 02:42:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 716.990524ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [.............XXX....XXX.XXXXX..X.XX.XX.XX......XX..X....XX.X] duration: 30.019848228s FAIL (2025-09-22 02:42:23 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 22 02:41:53.991774421 (564h33m29.344559529s) [upload=496838]: Starting upload Sep 22 02:41:53.991834704 (564h33m29.344619802s) [upload=496838]: Done starting upload Sep 22 02:41:53.991951443 (564h33m29.344736541s) [upload=496838]: Uploading segments... Sep 22 02:41:53.992125359 (564h33m29.344910467s) [upload=496838]: Got next segment. Inline: false Sep 22 02:41:53.992438347 (564h33m29.345223446s) [upload=496838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:41:53.992443267 (564h33m29.345228364s) [upload=496838]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:41:54.037095689 (564h33m29.389880797s) [seg_pos={0 0}, upload=496838]: Begin upload segment... Sep 22 02:41:54.037136536 (564h33m29.389921644s) [seg_pos={0 0}, upload=496838]: Done begin upload segment. Sep 22 02:41:54.037170249 (564h33m29.389955357s) [noise=true , address=145.79.227.17:4972 , piece_id=FUGQ5GP5N3UDSSDKPQY4YUKTVFP6APLHPV6DZTFYRMFXVWDQ4YZQ, seg_pos={0 0}, upload=496838]: Uploading piece... Sep 22 02:41:54.037175790 (564h33m29.389960888s) [noise=true , address=45.91.116.11:4119 , piece_id=D6SNXSIFUM4GCSATOX72JOF4FG2X4DR2M27XLKKL4ENBII56UUBA, seg_pos={0 0}, upload=496838]: Uploading piece... Sep 22 02:41:54.037250099 (564h33m29.390035197s) [noise=true , address=77.90.31.11:4553 , piece_id=U2J52AOCJGMZ4MQ7IZTCG7IKXCXXLCVIC26K2IIDA3EBWFOD23LQ, seg_pos={0 0}, upload=496838]: Uploading piece... Sep 22 02:41:54.037510759 (564h33m29.390295867s) [noise=true , address=45.91.116.10:4083 , piece_id=SSEDXIMBGZ5NN2DGBDMNWO6NILC2GXONSUSTUMOAJXWX6MBXUIWQ, seg_pos={0 0}, upload=496838]: Uploading piece... Sep 22 02:41:54.037560412 (564h33m29.39034551s) [noise=true , address=45.91.116.13:4155 , piece_id=NLBRXYOUCR5HA23UI7ETUMAQI6TYSMVDKTX2JITLZXMVYEZDMPYQ, seg_pos={0 0}, upload=496838]: Uploading piece... Sep 22 02:41:54.037757481 (564h33m29.39054259s) [noise=true , address=45.91.116.14:4191 , piece_id=MTWNYWSBBLTFRQFAZTEXHMTDBNJ24W5SSXNV6BHOJZTXLCDXFPVQ, seg_pos={0 0}, upload=496838]: Uploading piece... Sep 22 02:41:54.037835528 (564h33m29.390620626s) [noise=true , address=77.90.31.19:4843 , piece_id=AD62FVFAI2E3HKCUCVB6R6PE5JVOYCF75PRVGOOJ7QNC7U4STAUQ, seg_pos={0 0}, upload=496838]: Uploading piece... Sep 22 02:41:54.038022508 (564h33m29.390807616s) [noise=true , address=145.79.227.3:4149 , piece_id=VWGCOPGN575IDCYMWECRCELC6COYDZCQCY2V7DHWRAMJ43LOJBVQ, seg_pos={0 0}, upload=496838]: Uploading piece... Sep 22 02:41:54.038113068 (564h33m29.390898167s) [noise=true , address=45.91.116.4:4939 , piece_id=EUS2IOYSQP4BXEUEZC2SKJSYAA2NBMGDRGHPNMEEEJ3EE2WDLEKQ, seg_pos={0 0}, upload=496838]: Uploading piece... Sep 22 02:41:54.038264142 (564h33m29.39104924s) [noise=true , address=77.90.31.21:4879 , piece_id=CTLXK6M4ENDTLGM5F345LVKOJ7MKIILQQTYBAHX5ANA2ACGWAS2Q, seg_pos={0 0}, upload=496838]: Uploading piece... Sep 22 02:41:54.038390780 (564h33m29.391175879s) [noise=true , address=77.90.31.14:4662 , piece_id=3AW5OIUIYX32POQWLWLPK24FRTFHHSMSABRQ2KLOOCMFJSEOVVWA, seg_pos={0 0}, upload=496838]: Uploading piece... Sep 22 02:41:54.038523670 (564h33m29.391308778s) [noise=true , address=145.79.227.15:4875 , piece_id=5NVBQUOY4YBKBAAI6Z3VHYWOVZWC72OVGVN447N5EIVK34VLBJXA, seg_pos={0 0}, upload=496838]: Uploading piece... Sep 22 02:41:54.038751637 (564h33m29.391536735s) [noise=true , address=145.79.227.5:4223 , piece_id=ZJTFPJWKAZBUEE6WS3A62MEX5WWEIL4KFFUT2ALGCPF3BZPG6ZJA, seg_pos={0 0}, upload=496838]: Uploading piece... Sep 22 02:41:54.040798418 (564h33m29.393583516s) [noise=true , address=77.90.31.10:4520 , piece_id=M7RGINTKY2LKHY2DSLIPFBFXNR6XPQZK3ZZBBC33AYQURTEQ6ZKA, seg_pos={0 0}, upload=496838]: Uploading piece... Sep 22 02:41:54.040848411 (564h33m29.39363351s) [noise=true , address=45.91.116.12:4227 , piece_id=AEJGZZU3IBRMDVWVW5WNAKQKGCBCW4HSGLWU2MYBF56L2ABFY3WA, seg_pos={0 0}, upload=496838]: Uploading piece... Sep 22 02:41:54.041135781 (564h33m29.39392088s) [noise=true , address=77.90.31.16:4735 , piece_id=2ZZOJ2W2RJIRWJHMWHR4BKN2KZGC4WAR6YY55LOVABLVXQ6DCBKA, seg_pos={0 0}, upload=496838]: Uploading piece... Sep 22 02:41:54.120507528 (564h33m29.473292616s) [upload=496838]: Next returned nil segment Sep 22 02:41:54.120519170 (564h33m29.473304268s) [upload=496838]: Waiting for error group managing segments... Sep 22 02:41:54.129026384 (564h33m29.481811492s) [noise=true , address=45.91.116.10:4083 , piece_id=SSEDXIMBGZ5NN2DGBDMNWO6NILC2GXONSUSTUMOAJXWX6MBXUIWQ, seg_pos={0 0}, upload=496838]: Done uploading piece. err: <nil> Sep 22 02:41:54.129499752 (564h33m29.48228485s) [noise=true , address=45.91.116.13:4155 , piece_id=NLBRXYOUCR5HA23UI7ETUMAQI6TYSMVDKTX2JITLZXMVYEZDMPYQ, seg_pos={0 0}, upload=496838]: Done uploading piece. err: <nil> Sep 22 02:41:54.129612623 (564h33m29.482397712s) [noise=true , address=45.91.116.11:4119 , piece_id=D6SNXSIFUM4GCSATOX72JOF4FG2X4DR2M27XLKKL4ENBII56UUBA, seg_pos={0 0}, upload=496838]: Done uploading piece. err: <nil> Sep 22 02:41:54.130073900 (564h33m29.482858998s) [noise=true , address=45.91.116.4:4939 , piece_id=EUS2IOYSQP4BXEUEZC2SKJSYAA2NBMGDRGHPNMEEEJ3EE2WDLEKQ, seg_pos={0 0}, upload=496838]: Done uploading piece. err: <nil> Sep 22 02:41:54.130599707 (564h33m29.483384805s) [noise=true , address=45.91.116.12:4227 , piece_id=AEJGZZU3IBRMDVWVW5WNAKQKGCBCW4HSGLWU2MYBF56L2ABFY3WA, seg_pos={0 0}, upload=496838]: Done uploading piece. err: <nil> Sep 22 02:41:54.130813187 (564h33m29.483598295s) [noise=true , address=45.91.116.14:4191 , piece_id=MTWNYWSBBLTFRQFAZTEXHMTDBNJ24W5SSXNV6BHOJZTXLCDXFPVQ, seg_pos={0 0}, upload=496838]: Done uploading piece. err: <nil> Sep 22 02:41:54.130855076 (564h33m29.483640174s) [noise=true , address=77.90.31.19:4843 , piece_id=AD62FVFAI2E3HKCUCVB6R6PE5JVOYCF75PRVGOOJ7QNC7U4STAUQ, seg_pos={0 0}, upload=496838]: Done uploading piece. err: <nil> Sep 22 02:41:54.131627836 (564h33m29.484412934s) [noise=true , address=77.90.31.10:4520 , piece_id=M7RGINTKY2LKHY2DSLIPFBFXNR6XPQZK3ZZBBC33AYQURTEQ6ZKA, seg_pos={0 0}, upload=496838]: Done uploading piece. err: <nil> Sep 22 02:41:54.131726682 (564h33m29.48451179s) [noise=true , address=77.90.31.14:4662 , piece_id=3AW5OIUIYX32POQWLWLPK24FRTFHHSMSABRQ2KLOOCMFJSEOVVWA, seg_pos={0 0}, upload=496838]: Done uploading piece. err: <nil> Sep 22 02:41:54.131892362 (564h33m29.48467745s) [noise=true , address=77.90.31.16:4735 , piece_id=2ZZOJ2W2RJIRWJHMWHR4BKN2KZGC4WAR6YY55LOVABLVXQ6DCBKA, seg_pos={0 0}, upload=496838]: Done uploading piece. err: <nil> Sep 22 02:41:54.132166036 (564h33m29.484951134s) [noise=true , address=77.90.31.11:4553 , piece_id=U2J52AOCJGMZ4MQ7IZTCG7IKXCXXLCVIC26K2IIDA3EBWFOD23LQ, seg_pos={0 0}, upload=496838]: Done uploading piece. err: <nil> Sep 22 02:41:54.132843878 (564h33m29.485628976s) [noise=true , address=77.90.31.21:4879 , piece_id=CTLXK6M4ENDTLGM5F345LVKOJ7MKIILQQTYBAHX5ANA2ACGWAS2Q, seg_pos={0 0}, upload=496838]: Done uploading piece. err: <nil> Sep 22 02:42:23.974003073 (564h33m59.326788201s) [noise=true , address=145.79.227.3:4149 , piece_id=VWGCOPGN575IDCYMWECRCELC6COYDZCQCY2V7DHWRAMJ43LOJBVQ, seg_pos={0 0}, upload=496838]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: context deadline exceeded; context deadline exceeded Sep 22 02:42:23.974066753 (564h33m59.32685188s) [noise=true , address=145.79.227.5:4223 , piece_id=ZJTFPJWKAZBUEE6WS3A62MEX5WWEIL4KFFUT2ALGCPF3BZPG6ZJA, seg_pos={0 0}, upload=496838]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: context deadline exceeded; context deadline exceeded Sep 22 02:42:23.974142055 (564h33m59.326927183s) [noise=true , address=145.79.227.17:4972 , piece_id=FUGQ5GP5N3UDSSDKPQY4YUKTVFP6APLHPV6DZTFYRMFXVWDQ4YZQ, seg_pos={0 0}, upload=496838]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: context deadline exceeded; context deadline exceeded Sep 22 02:42:23.974159057 (564h33m59.326944185s) [noise=true , address=145.79.227.15:4875 , piece_id=5NVBQUOY4YBKBAAI6Z3VHYWOVZWC72OVGVN447N5EIVK34VLBJXA, seg_pos={0 0}, upload=496838]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: context deadline exceeded; context deadline exceeded Sep 22 02:42:23.974187400 (564h33m59.326972528s) [seg_pos={0 0}, upload=496838]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 22 02:42:23.991998544 (564h33m59.344783672s) [upload=496838]: Done uploading segments... Sep 22 02:42:23.992016056 (564h33m59.344801185s) [upload=496838]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.019866864s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [............X.XXXXXX..X.....................................] duration: 436.491147ms FAIL (2025-09-22 02:42:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 436.51995ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [................X.X.........X.......X...X.....X.XX..XX..X...] duration: 378.58277ms FAIL (2025-09-22 02:41:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 378.595142ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [.............X.XXXXXX..X....................................] duration: 751.199849ms FAIL (2025-09-22 02:41:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 751.218375ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.................X.X.........X.......X...X.....X.XX..XX..X..] duration: 582.380178ms FAIL (2025-09-22 02:41:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 582.412138ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 23 out of 60 is failed (threshold=3) [..............XXX....XXX.XXXXX..X.XX.XX.XX......XX..X....XX.] duration: 480.7733ms FAIL (2025-09-22 02:41:13 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 22 02:40:37.129089117 (564h32m12.481874246s) [upload=496820]: Starting upload Sep 22 02:40:37.129171342 (564h32m12.481956469s) [upload=496820]: Done starting upload Sep 22 02:40:37.129276980 (564h32m12.482062107s) [upload=496820]: Uploading segments... Sep 22 02:40:37.129561403 (564h32m12.482346531s) [upload=496820]: Got next segment. Inline: false Sep 22 02:40:37.129687381 (564h32m12.482472518s) [upload=496820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:40:37.129694243 (564h32m12.482479371s) [upload=496820]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:40:37.150358982 (564h32m12.50314412s) [seg_pos={0 0}, upload=496820]: Begin upload segment... Sep 22 02:40:37.150414637 (564h32m12.503199764s) [seg_pos={0 0}, upload=496820]: Done begin upload segment. Sep 22 02:40:37.150445735 (564h32m12.503230873s) [noise=true , address=45.91.116.12:4225 , piece_id=36I7UQQMZGSV6XARWXI7JSVNLQQNAJDE62NNP5XHH2KOP7GDSJFQ, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.150520705 (564h32m12.503305834s) [noise=true , address=45.91.116.7:4010 , piece_id=WTZPNDWTDSTQPZN37C5OSLIZTZBLCR2C5VHHRCLOCP7RR2JRWDNA, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.150934582 (564h32m12.503719709s) [noise=true , address=77.90.31.15:4697 , piece_id=AXH3ROZCPLGNSN6RCXP4S4R4JJD4Z2FBNMYLQKYLTXFISHY76MSA, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.151112767 (564h32m12.503897895s) [noise=true , address=45.91.116.8:4045 , piece_id=EZJPC5QX7OPMGQLM3TUZ2W3ROO2PG5ZEB7FXD2LN7USN4LPQN6FQ, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.151326978 (564h32m12.504112107s) [noise=true , address=77.90.31.11:4554 , piece_id=CPCQQNSZKXTX34NXJXA2YRQD43BRF5XKGWUOUP5L7GCXLX7R4NUA, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.151582888 (564h32m12.504368027s) [noise=true , address=45.91.116.10:4082 , piece_id=UXRTVMURKPXT73J6JFPVIYKOID224XDTHK5WL5J5YL6ZJUIWSTYA, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.151811798 (564h32m12.504596926s) [noise=true , address=45.91.116.14:4191 , piece_id=HXR3OYX4IVGQKLZAX7KVOIOACR4CQN62Z7VQTLQHNEZSMTCQXHPQ, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.152027674 (564h32m12.504812801s) [noise=true , address=45.91.116.4:4939 , piece_id=C3DCJZI2TCIBROTPJRYJV7WGZ6TZT2VECO6S6UKTHOKGCXSJGXFA, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.152273585 (564h32m12.505058713s) [noise=true , address=145.79.227.19:4079 , piece_id=4NI6NLZLC3LYZ2VD5ZJIMH2VBAI46OKRZHBZURCYXJHPQ2ODMB4A, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.152440438 (564h32m12.505225566s) [noise=true , address=77.90.31.10:4518 , piece_id=UPOL2IRJVFL7BIUIANRBDPNAO55MAHNKK5CBXIEXDWAJXRAZ7ASA, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.152722436 (564h32m12.505507565s) [noise=true , address=145.79.227.16:4912 , piece_id=FQ7TLRFVJTUAZXLETQ2RXEKBLTADJ7RJNJWSTH5AT7GQX44WAD3Q, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.152871727 (564h32m12.505656855s) [noise=true , address=77.90.31.19:4841 , piece_id=5LUHNUGOX3WRSHESMIUM6AGHDP5VKSNDQYG6YPDQ3RRRWAVKLUUQ, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.153129040 (564h32m12.505914169s) [noise=true , address=145.79.227.13:4803 , piece_id=CLF5PE7WPJNJQO6MIPKIXDBFLOGNE6NDX5ECTSJZU3ZDKGBLORCQ, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.153249616 (564h32m12.506034745s) [noise=true , address=45.91.116.9:4261 , piece_id=EBMFDH35MFK6KOZAUSYFO532BYFXMJSF3GYP3HMMIAX6EZUFWM6Q, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.153598942 (564h32m12.50638408s) [noise=true , address=145.79.227.11:4731 , piece_id=O65AX5PCOF4YXZQ6IUPFRKGXZYX2B5LZESGRXUKX76QLPRCCUWAA, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.154030722 (564h32m12.506815851s) [noise=true , address=45.91.116.13:4155 , piece_id=FTSC2JCY2BMCCJGVH2PS6TMUJVLMJ372DTOYZVFMRC65SDOOFBJA, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.259235488 (564h32m12.612020586s) [upload=496820]: Next returned nil segment Sep 22 02:40:37.259246759 (564h32m12.612031867s) [upload=496820]: Waiting for error group managing segments... Sep 22 02:40:37.266941639 (564h32m12.619726747s) [noise=true , address=45.91.116.8:4045 , piece_id=EZJPC5QX7OPMGQLM3TUZ2W3ROO2PG5ZEB7FXD2LN7USN4LPQN6FQ, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:37.268257658 (564h32m12.621042766s) [noise=true , address=45.91.116.14:4191 , piece_id=HXR3OYX4IVGQKLZAX7KVOIOACR4CQN62Z7VQTLQHNEZSMTCQXHPQ, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:37.268321598 (564h32m12.621106736s) [noise=true , address=45.91.116.12:4225 , piece_id=36I7UQQMZGSV6XARWXI7JSVNLQQNAJDE62NNP5XHH2KOP7GDSJFQ, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:37.268611272 (564h32m12.62139638s) [noise=true , address=45.91.116.9:4261 , piece_id=EBMFDH35MFK6KOZAUSYFO532BYFXMJSF3GYP3HMMIAX6EZUFWM6Q, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:37.269214454 (564h32m12.621999562s) [noise=true , address=45.91.116.13:4155 , piece_id=FTSC2JCY2BMCCJGVH2PS6TMUJVLMJ372DTOYZVFMRC65SDOOFBJA, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:37.269314812 (564h32m12.62209995s) [noise=true , address=77.90.31.11:4554 , piece_id=CPCQQNSZKXTX34NXJXA2YRQD43BRF5XKGWUOUP5L7GCXLX7R4NUA, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:37.269624183 (564h32m12.622409291s) [noise=true , address=77.90.31.15:4697 , piece_id=AXH3ROZCPLGNSN6RCXP4S4R4JJD4Z2FBNMYLQKYLTXFISHY76MSA, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:37.270057486 (564h32m12.622842584s) [noise=true , address=45.91.116.4:4939 , piece_id=C3DCJZI2TCIBROTPJRYJV7WGZ6TZT2VECO6S6UKTHOKGCXSJGXFA, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:37.270089516 (564h32m12.622874644s) [noise=true , address=77.90.31.19:4841 , piece_id=5LUHNUGOX3WRSHESMIUM6AGHDP5VKSNDQYG6YPDQ3RRRWAVKLUUQ, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:37.270389269 (564h32m12.623174377s) [noise=true , address=45.91.116.7:4010 , piece_id=WTZPNDWTDSTQPZN37C5OSLIZTZBLCR2C5VHHRCLOCP7RR2JRWDNA, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:37.270861214 (564h32m12.623646342s) [noise=true , address=77.90.31.10:4518 , piece_id=UPOL2IRJVFL7BIUIANRBDPNAO55MAHNKK5CBXIEXDWAJXRAZ7ASA, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:37.283573901 (564h32m12.636359029s) [noise=true , address=45.91.116.10:4082 , piece_id=UXRTVMURKPXT73J6JFPVIYKOID224XDTHK5WL5J5YL6ZJUIWSTYA, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:38.907091971 (564h32m14.259877079s) [noise=true , address=145.79.227.11:4731 , piece_id=O65AX5PCOF4YXZQ6IUPFRKGXZYX2B5LZESGRXUKX76QLPRCCUWAA, seg_pos={0 0}, upload=496820]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:145.79.227.11:4731): protocol: rpc: dial tcp 145.79.227.11:4731: connect: no route to host; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op Sep 22 02:41:07.113374221 (564h32m42.46615932s) [noise=true , address=145.79.227.16:4912 , piece_id=FQ7TLRFVJTUAZXLETQ2RXEKBLTADJ7RJNJWSTH5AT7GQX44WAD3Q, seg_pos={0 0}, upload=496820]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: context deadline exceeded; context deadline exceeded Sep 22 02:41:07.113384771 (564h32m42.466169879s) [noise=true , address=145.79.227.19:4079 , piece_id=4NI6NLZLC3LYZ2VD5ZJIMH2VBAI46OKRZHBZURCYXJHPQ2ODMB4A, seg_pos={0 0}, upload=496820]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: context deadline exceeded; context deadline exceeded Sep 22 02:41:07.113424306 (564h32m42.466209414s) [noise=true , address=145.79.227.13:4803 , piece_id=CLF5PE7WPJNJQO6MIPKIXDBFLOGNE6NDX5ECTSJZU3ZDKGBLORCQ, seg_pos={0 0}, upload=496820]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: context deadline exceeded; context deadline exceeded Sep 22 02:41:07.113441217 (564h32m42.466226325s) [seg_pos={0 0}, upload=496820]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 22 02:41:07.126089022 (564h32m42.47887412s) [upload=496820]: Done uploading segments... Sep 22 02:41:07.126108368 (564h32m42.478893466s) [upload=496820]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 480.808957ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 23 out of 60 is failed (threshold=3) [...............XXX....XXX.XXXXX..X.XX.XX.XX......XX..X....XX] duration: 30.013685387s FAIL (2025-09-22 02:41:07 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 22 02:40:37.129089117 (564h32m12.481874246s) [upload=496820]: Starting upload Sep 22 02:40:37.129171342 (564h32m12.481956469s) [upload=496820]: Done starting upload Sep 22 02:40:37.129276980 (564h32m12.482062107s) [upload=496820]: Uploading segments... Sep 22 02:40:37.129561403 (564h32m12.482346531s) [upload=496820]: Got next segment. Inline: false Sep 22 02:40:37.129687381 (564h32m12.482472518s) [upload=496820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:40:37.129694243 (564h32m12.482479371s) [upload=496820]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:40:37.150358982 (564h32m12.50314412s) [seg_pos={0 0}, upload=496820]: Begin upload segment... Sep 22 02:40:37.150414637 (564h32m12.503199764s) [seg_pos={0 0}, upload=496820]: Done begin upload segment. Sep 22 02:40:37.150445735 (564h32m12.503230873s) [noise=true , address=45.91.116.12:4225 , piece_id=36I7UQQMZGSV6XARWXI7JSVNLQQNAJDE62NNP5XHH2KOP7GDSJFQ, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.150520705 (564h32m12.503305834s) [noise=true , address=45.91.116.7:4010 , piece_id=WTZPNDWTDSTQPZN37C5OSLIZTZBLCR2C5VHHRCLOCP7RR2JRWDNA, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.150934582 (564h32m12.503719709s) [noise=true , address=77.90.31.15:4697 , piece_id=AXH3ROZCPLGNSN6RCXP4S4R4JJD4Z2FBNMYLQKYLTXFISHY76MSA, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.151112767 (564h32m12.503897895s) [noise=true , address=45.91.116.8:4045 , piece_id=EZJPC5QX7OPMGQLM3TUZ2W3ROO2PG5ZEB7FXD2LN7USN4LPQN6FQ, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.151326978 (564h32m12.504112107s) [noise=true , address=77.90.31.11:4554 , piece_id=CPCQQNSZKXTX34NXJXA2YRQD43BRF5XKGWUOUP5L7GCXLX7R4NUA, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.151582888 (564h32m12.504368027s) [noise=true , address=45.91.116.10:4082 , piece_id=UXRTVMURKPXT73J6JFPVIYKOID224XDTHK5WL5J5YL6ZJUIWSTYA, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.151811798 (564h32m12.504596926s) [noise=true , address=45.91.116.14:4191 , piece_id=HXR3OYX4IVGQKLZAX7KVOIOACR4CQN62Z7VQTLQHNEZSMTCQXHPQ, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.152027674 (564h32m12.504812801s) [noise=true , address=45.91.116.4:4939 , piece_id=C3DCJZI2TCIBROTPJRYJV7WGZ6TZT2VECO6S6UKTHOKGCXSJGXFA, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.152273585 (564h32m12.505058713s) [noise=true , address=145.79.227.19:4079 , piece_id=4NI6NLZLC3LYZ2VD5ZJIMH2VBAI46OKRZHBZURCYXJHPQ2ODMB4A, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.152440438 (564h32m12.505225566s) [noise=true , address=77.90.31.10:4518 , piece_id=UPOL2IRJVFL7BIUIANRBDPNAO55MAHNKK5CBXIEXDWAJXRAZ7ASA, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.152722436 (564h32m12.505507565s) [noise=true , address=145.79.227.16:4912 , piece_id=FQ7TLRFVJTUAZXLETQ2RXEKBLTADJ7RJNJWSTH5AT7GQX44WAD3Q, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.152871727 (564h32m12.505656855s) [noise=true , address=77.90.31.19:4841 , piece_id=5LUHNUGOX3WRSHESMIUM6AGHDP5VKSNDQYG6YPDQ3RRRWAVKLUUQ, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.153129040 (564h32m12.505914169s) [noise=true , address=145.79.227.13:4803 , piece_id=CLF5PE7WPJNJQO6MIPKIXDBFLOGNE6NDX5ECTSJZU3ZDKGBLORCQ, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.153249616 (564h32m12.506034745s) [noise=true , address=45.91.116.9:4261 , piece_id=EBMFDH35MFK6KOZAUSYFO532BYFXMJSF3GYP3HMMIAX6EZUFWM6Q, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.153598942 (564h32m12.50638408s) [noise=true , address=145.79.227.11:4731 , piece_id=O65AX5PCOF4YXZQ6IUPFRKGXZYX2B5LZESGRXUKX76QLPRCCUWAA, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.154030722 (564h32m12.506815851s) [noise=true , address=45.91.116.13:4155 , piece_id=FTSC2JCY2BMCCJGVH2PS6TMUJVLMJ372DTOYZVFMRC65SDOOFBJA, seg_pos={0 0}, upload=496820]: Uploading piece... Sep 22 02:40:37.259235488 (564h32m12.612020586s) [upload=496820]: Next returned nil segment Sep 22 02:40:37.259246759 (564h32m12.612031867s) [upload=496820]: Waiting for error group managing segments... Sep 22 02:40:37.266941639 (564h32m12.619726747s) [noise=true , address=45.91.116.8:4045 , piece_id=EZJPC5QX7OPMGQLM3TUZ2W3ROO2PG5ZEB7FXD2LN7USN4LPQN6FQ, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:37.268257658 (564h32m12.621042766s) [noise=true , address=45.91.116.14:4191 , piece_id=HXR3OYX4IVGQKLZAX7KVOIOACR4CQN62Z7VQTLQHNEZSMTCQXHPQ, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:37.268321598 (564h32m12.621106736s) [noise=true , address=45.91.116.12:4225 , piece_id=36I7UQQMZGSV6XARWXI7JSVNLQQNAJDE62NNP5XHH2KOP7GDSJFQ, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:37.268611272 (564h32m12.62139638s) [noise=true , address=45.91.116.9:4261 , piece_id=EBMFDH35MFK6KOZAUSYFO532BYFXMJSF3GYP3HMMIAX6EZUFWM6Q, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:37.269214454 (564h32m12.621999562s) [noise=true , address=45.91.116.13:4155 , piece_id=FTSC2JCY2BMCCJGVH2PS6TMUJVLMJ372DTOYZVFMRC65SDOOFBJA, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:37.269314812 (564h32m12.62209995s) [noise=true , address=77.90.31.11:4554 , piece_id=CPCQQNSZKXTX34NXJXA2YRQD43BRF5XKGWUOUP5L7GCXLX7R4NUA, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:37.269624183 (564h32m12.622409291s) [noise=true , address=77.90.31.15:4697 , piece_id=AXH3ROZCPLGNSN6RCXP4S4R4JJD4Z2FBNMYLQKYLTXFISHY76MSA, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:37.270057486 (564h32m12.622842584s) [noise=true , address=45.91.116.4:4939 , piece_id=C3DCJZI2TCIBROTPJRYJV7WGZ6TZT2VECO6S6UKTHOKGCXSJGXFA, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:37.270089516 (564h32m12.622874644s) [noise=true , address=77.90.31.19:4841 , piece_id=5LUHNUGOX3WRSHESMIUM6AGHDP5VKSNDQYG6YPDQ3RRRWAVKLUUQ, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:37.270389269 (564h32m12.623174377s) [noise=true , address=45.91.116.7:4010 , piece_id=WTZPNDWTDSTQPZN37C5OSLIZTZBLCR2C5VHHRCLOCP7RR2JRWDNA, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:37.270861214 (564h32m12.623646342s) [noise=true , address=77.90.31.10:4518 , piece_id=UPOL2IRJVFL7BIUIANRBDPNAO55MAHNKK5CBXIEXDWAJXRAZ7ASA, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:37.283573901 (564h32m12.636359029s) [noise=true , address=45.91.116.10:4082 , piece_id=UXRTVMURKPXT73J6JFPVIYKOID224XDTHK5WL5J5YL6ZJUIWSTYA, seg_pos={0 0}, upload=496820]: Done uploading piece. err: <nil> Sep 22 02:40:38.907091971 (564h32m14.259877079s) [noise=true , address=145.79.227.11:4731 , piece_id=O65AX5PCOF4YXZQ6IUPFRKGXZYX2B5LZESGRXUKX76QLPRCCUWAA, seg_pos={0 0}, upload=496820]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:145.79.227.11:4731): protocol: rpc: dial tcp 145.79.227.11:4731: connect: no route to host; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op Sep 22 02:41:07.113374221 (564h32m42.46615932s) [noise=true , address=145.79.227.16:4912 , piece_id=FQ7TLRFVJTUAZXLETQ2RXEKBLTADJ7RJNJWSTH5AT7GQX44WAD3Q, seg_pos={0 0}, upload=496820]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: context deadline exceeded; context deadline exceeded Sep 22 02:41:07.113384771 (564h32m42.466169879s) [noise=true , address=145.79.227.19:4079 , piece_id=4NI6NLZLC3LYZ2VD5ZJIMH2VBAI46OKRZHBZURCYXJHPQ2ODMB4A, seg_pos={0 0}, upload=496820]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: context deadline exceeded; context deadline exceeded Sep 22 02:41:07.113424306 (564h32m42.466209414s) [noise=true , address=145.79.227.13:4803 , piece_id=CLF5PE7WPJNJQO6MIPKIXDBFLOGNE6NDX5ECTSJZU3ZDKGBLORCQ, seg_pos={0 0}, upload=496820]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: context deadline exceeded; context deadline exceeded Sep 22 02:41:07.113441217 (564h32m42.466226325s) [seg_pos={0 0}, upload=496820]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 22 02:41:07.126089022 (564h32m42.47887412s) [upload=496820]: Done uploading segments... Sep 22 02:41:07.126108368 (564h32m42.478893466s) [upload=496820]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.013705284s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [..............X.XXXXXX..X...................................] duration: 772.496115ms FAIL (2025-09-22 02:40:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 772.522245ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [..................X.X.........X.......X...X.....X.XX..XX..X.] duration: 533.956979ms FAIL (2025-09-22 02:40:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 533.997376ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [...............X.XXXXXX..X..................................] duration: 424.58692ms FAIL (2025-09-22 02:40:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 424.606846ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [...................X.X.........X.......X...X.....X.XX..XX..X] duration: 30.000447462s FAIL (2025-09-22 02:40:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.00046828s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 22 out of 60 is failed (threshold=3) [................XXX....XXX.XXXXX..X.XX.XX.XX......XX..X....X] duration: 30.020118526s FAIL (2025-09-22 02:39:54 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 22 02:39:24.474749947 (564h30m59.827535055s) [upload=496805]: Starting upload Sep 22 02:39:24.474803608 (564h30m59.827588716s) [upload=496805]: Done starting upload Sep 22 02:39:24.474896342 (564h30m59.82768144s) [upload=496805]: Uploading segments... Sep 22 02:39:24.475015856 (564h30m59.827800964s) [upload=496805]: Got next segment. Inline: false Sep 22 02:39:24.475044639 (564h30m59.827829738s) [upload=496805]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:39:24.475048166 (564h30m59.827833264s) [upload=496805]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:39:24.646408037 (564h30m59.999193165s) [seg_pos={0 0}, upload=496805]: Begin upload segment... Sep 22 02:39:24.646451819 (564h30m59.999236957s) [seg_pos={0 0}, upload=496805]: Done begin upload segment. Sep 22 02:39:24.646490913 (564h30m59.99927604s) [noise=true , address=45.91.116.7:4009 , piece_id=EESOALVSJSLDYZI3A2HVPTN323RXDFYV43Y26U2JWCHUAKYVY75Q, seg_pos={0 0}, upload=496805]: Uploading piece... Sep 22 02:39:24.646522311 (564h30m59.99930744s) [noise=true , address=45.91.116.13:4154 , piece_id=E3HWUDEIPPEYBARDM2RYAM2AXGBC637FEK46FJE64VSKFZMDPPNA, seg_pos={0 0}, upload=496805]: Uploading piece... Sep 22 02:39:24.647001441 (564h30m59.999786599s) [noise=true , address=45.91.116.10:4083 , piece_id=ZKFWUUVY6TF7VEQOBZN5MCV7X7TJWFAGVGMVZJ2HQ3JF43DAHCSQ, seg_pos={0 0}, upload=496805]: Uploading piece... Sep 22 02:39:24.647497191 (564h31m0.000282329s) [noise=true , address=77.90.31.18:4805 , piece_id=4LN53I6VWTAPEGWX4XBW2DVIYUIASMTBQ7M2S6XH22O54WZ5UTXQ, seg_pos={0 0}, upload=496805]: Uploading piece... Sep 22 02:39:24.647956112 (564h31m0.000741241s) [noise=true , address=77.90.31.16:4734 , piece_id=BTZKNB2UODM2KL3EX6RRI2KROR5O6CPV7OCOATREEPML43XBVKUA, seg_pos={0 0}, upload=496805]: Uploading piece... Sep 22 02:39:24.648314865 (564h31m0.001099994s) [noise=true , address=145.79.227.11:4729 , piece_id=RUGMWIB5RJ535TD7F5VN3EJYW52WNJARVAQ5FJZ4YYWLFTVVT74Q, seg_pos={0 0}, upload=496805]: Uploading piece... Sep 22 02:39:24.648695710 (564h31m0.001480839s) [noise=true , address=45.91.116.14:4190 , piece_id=RGY4KISF7APSKOGMY5IV6XPCVTJJBBLFJLFOTEI5CVLA5TYFVRVQ, seg_pos={0 0}, upload=496805]: Uploading piece... Sep 22 02:39:24.649080993 (564h31m0.001866121s) [noise=true , address=77.90.31.18:4807 , piece_id=6KSPUTU2CQR5Z7ZKR6QQH6XBP4WOHGYNHH2C7VWQH2EJKAUFSVIQ, seg_pos={0 0}, upload=496805]: Uploading piece... Sep 22 02:39:24.649637037 (564h31m0.002422175s) [noise=true , address=145.79.227.17:4969 , piece_id=FMDSURRZUDP3GKE7XOLUA7JOLM7OMSX2JK44DB3SYPGXQMSGX33A, seg_pos={0 0}, upload=496805]: Uploading piece... Sep 22 02:39:24.650205383 (564h31m0.002990551s) [noise=true , address=145.79.227.6:4258 , piece_id=OZO2NYTMLWR5UY77367IZT2BSZKBYPOMVMUINUUDTYQEMCJY6MAA, seg_pos={0 0}, upload=496805]: Uploading piece... Sep 22 02:39:24.650791473 (564h31m0.003576612s) [noise=true , address=77.90.31.13:4628 , piece_id=JYNTLJGPEA7POUETDBCHK63INWRO7IS7OSQYHA6FXX7HBJ3QZQ7Q, seg_pos={0 0}, upload=496805]: Uploading piece... Sep 22 02:39:24.651348870 (564h31m0.004133997s) [noise=true , address=45.91.116.8:4047 , piece_id=QOYULAMF4J2DGXY4CZDKUBETBIRSHJMC2ECUI3KNOJXUOE4K5AMA, seg_pos={0 0}, upload=496805]: Uploading piece... Sep 22 02:39:24.652058300 (564h31m0.004843428s) [noise=true , address=45.91.116.5:4299 , piece_id=TUZDIVQOCGL6QC7BBW4ZS6IHIF5LBUPVOPJYB37ACJWHGJ7MMTDQ, seg_pos={0 0}, upload=496805]: Uploading piece... Sep 22 02:39:24.652673855 (564h31m0.005458984s) [noise=true , address=45.91.116.13:4153 , piece_id=AMCMBSGFROPRISQ2W6JWLXZRUD5WJ2FI7IHN7PIEXC7H3R72WIWQ, seg_pos={0 0}, upload=496805]: Uploading piece... Sep 22 02:39:24.653541634 (564h31m0.006326763s) [noise=true , address=77.90.31.14:4662 , piece_id=GOG37RJZFBLPXFYIMULNIOOAXUTXMGLAU35ZNXTZ4YJVK4LZRLAA, seg_pos={0 0}, upload=496805]: Uploading piece... Sep 22 02:39:24.655667484 (564h31m0.008452611s) [noise=true , address=145.79.227.13:4803 , piece_id=XLPQ7RCSTJ7NQIJLJ3XBRE63TANNCGXIPNI56MS2G2LPFK5XVIDQ, seg_pos={0 0}, upload=496805]: Uploading piece... Sep 22 02:39:24.781195647 (564h31m0.133980774s) [upload=496805]: Next returned nil segment Sep 22 02:39:24.781211616 (564h31m0.133996755s) [upload=496805]: Waiting for error group managing segments... Sep 22 02:39:24.789052801 (564h31m0.141837928s) [noise=true , address=45.91.116.7:4009 , piece_id=EESOALVSJSLDYZI3A2HVPTN323RXDFYV43Y26U2JWCHUAKYVY75Q, seg_pos={0 0}, upload=496805]: Done uploading piece. err: <nil> Sep 22 02:39:24.789347114 (564h31m0.142132241s) [noise=true , address=45.91.116.14:4190 , piece_id=RGY4KISF7APSKOGMY5IV6XPCVTJJBBLFJLFOTEI5CVLA5TYFVRVQ, seg_pos={0 0}, upload=496805]: Done uploading piece. err: <nil> Sep 22 02:39:24.790165039 (564h31m0.142950167s) [noise=true , address=45.91.116.10:4083 , piece_id=ZKFWUUVY6TF7VEQOBZN5MCV7X7TJWFAGVGMVZJ2HQ3JF43DAHCSQ, seg_pos={0 0}, upload=496805]: Done uploading piece. err: <nil> Sep 22 02:39:24.791854157 (564h31m0.144639296s) [noise=true , address=45.91.116.8:4047 , piece_id=QOYULAMF4J2DGXY4CZDKUBETBIRSHJMC2ECUI3KNOJXUOE4K5AMA, seg_pos={0 0}, upload=496805]: Done uploading piece. err: <nil> Sep 22 02:39:24.792000302 (564h31m0.144785431s) [noise=true , address=77.90.31.18:4807 , piece_id=6KSPUTU2CQR5Z7ZKR6QQH6XBP4WOHGYNHH2C7VWQH2EJKAUFSVIQ, seg_pos={0 0}, upload=496805]: Done uploading piece. err: <nil> Sep 22 02:39:24.792777730 (564h31m0.145562869s) [noise=true , address=45.91.116.5:4299 , piece_id=TUZDIVQOCGL6QC7BBW4ZS6IHIF5LBUPVOPJYB37ACJWHGJ7MMTDQ, seg_pos={0 0}, upload=496805]: Done uploading piece. err: <nil> Sep 22 02:39:24.793024184 (564h31m0.145809312s) [noise=true , address=45.91.116.13:4153 , piece_id=AMCMBSGFROPRISQ2W6JWLXZRUD5WJ2FI7IHN7PIEXC7H3R72WIWQ, seg_pos={0 0}, upload=496805]: Done uploading piece. err: <nil> Sep 22 02:39:24.793560610 (564h31m0.146345748s) [noise=true , address=45.91.116.13:4154 , piece_id=E3HWUDEIPPEYBARDM2RYAM2AXGBC637FEK46FJE64VSKFZMDPPNA, seg_pos={0 0}, upload=496805]: Done uploading piece. err: <nil> Sep 22 02:39:24.793860603 (564h31m0.146645732s) [noise=true , address=77.90.31.16:4734 , piece_id=BTZKNB2UODM2KL3EX6RRI2KROR5O6CPV7OCOATREEPML43XBVKUA, seg_pos={0 0}, upload=496805]: Done uploading piece. err: <nil> Sep 22 02:39:24.794150838 (564h31m0.146935966s) [noise=true , address=77.90.31.13:4628 , piece_id=JYNTLJGPEA7POUETDBCHK63INWRO7IS7OSQYHA6FXX7HBJ3QZQ7Q, seg_pos={0 0}, upload=496805]: Done uploading piece. err: <nil> Sep 22 02:39:24.794714545 (564h31m0.147499673s) [noise=true , address=77.90.31.18:4805 , piece_id=4LN53I6VWTAPEGWX4XBW2DVIYUIASMTBQ7M2S6XH22O54WZ5UTXQ, seg_pos={0 0}, upload=496805]: Done uploading piece. err: <nil> Sep 22 02:39:24.794872282 (564h31m0.14765741s) [noise=true , address=77.90.31.14:4662 , piece_id=GOG37RJZFBLPXFYIMULNIOOAXUTXMGLAU35ZNXTZ4YJVK4LZRLAA, seg_pos={0 0}, upload=496805]: Done uploading piece. err: <nil> Sep 22 02:39:54.449215571 (564h31m29.80200069s) [noise=true , address=145.79.227.17:4969 , piece_id=FMDSURRZUDP3GKE7XOLUA7JOLM7OMSX2JK44DB3SYPGXQMSGX33A, seg_pos={0 0}, upload=496805]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:39:54.449302975 (564h31m29.802088094s) [noise=true , address=145.79.227.11:4729 , piece_id=RUGMWIB5RJ535TD7F5VN3EJYW52WNJARVAQ5FJZ4YYWLFTVVT74Q, seg_pos={0 0}, upload=496805]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: rpc: dial tcp 145.79.227.11:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:39:54.449374540 (564h31m29.802159657s) [noise=true , address=145.79.227.6:4258 , piece_id=OZO2NYTMLWR5UY77367IZT2BSZKBYPOMVMUINUUDTYQEMCJY6MAA, seg_pos={0 0}, upload=496805]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: rpc: dial tcp 145.79.227.6:4258: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:39:54.449404556 (564h31m29.802189674s) [noise=true , address=145.79.227.13:4803 , piece_id=XLPQ7RCSTJ7NQIJLJ3XBRE63TANNCGXIPNI56MS2G2LPFK5XVIDQ, seg_pos={0 0}, upload=496805]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: rpc: dial tcp 145.79.227.13:4803: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:39:54.449449240 (564h31m29.802234378s) [seg_pos={0 0}, upload=496805]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 22 02:39:54.467337248 (564h31m29.820122356s) [upload=496805]: Done uploading segments... Sep 22 02:39:54.467355412 (564h31m29.82014052s) [upload=496805]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.0201364s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [................X.XXXXXX..X.................................] duration: 414.999797ms FAIL (2025-09-22 02:39:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 415.023622ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [....................X.X.........X.......X...X.....X.XX..XX..] duration: 546.027412ms FAIL (2025-09-22 02:38:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 546.043011ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [.................X.XXXXXX..X................................] duration: 382.847835ms FAIL (2025-09-22 02:38:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 382.878782ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 21 out of 60 is failed (threshold=3) [.................XXX....XXX.XXXXX..X.XX.XX.XX......XX..X....] duration: 398.18781ms FAIL (2025-09-22 02:38:55 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 22 02:35:48.588539876 (564h27m23.941325003s) [upload=496753]: Starting upload Sep 22 02:35:48.588637940 (564h27m23.941423068s) [upload=496753]: Done starting upload Sep 22 02:35:48.588752174 (564h27m23.941537282s) [upload=496753]: Uploading segments... Sep 22 02:35:48.588998997 (564h27m23.941784126s) [upload=496753]: Got next segment. Inline: false Sep 22 02:35:48.589052377 (564h27m23.941837506s) [upload=496753]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:35:48.589058178 (564h27m23.941843307s) [upload=496753]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:35:48.642639848 (564h27m23.995424987s) [seg_pos={0 0}, upload=496753]: Begin upload segment... Sep 22 02:35:48.642698349 (564h27m23.995483457s) [seg_pos={0 0}, upload=496753]: Done begin upload segment. Sep 22 02:35:48.642730810 (564h27m23.995515918s) [noise=true , address=45.91.116.14:4190 , piece_id=OG4SFNR4HAYSMJEJMYSVK46KRTM5OK7BWFQ6I6EWJA7CQHWJSDYA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.642772568 (564h27m23.995557696s) [noise=true , address=45.91.116.7:4009 , piece_id=43CWAMSOEHJ3MBS7CAXRRHT3A2D46N3UPDABBAXJPJKHYHV5FJSA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643050940 (564h27m23.995836039s) [noise=true , address=45.91.116.6:4973 , piece_id=C5C2BYWHKVQZG3RON4BG4HIUZPLKKBQKU7IN3INBO6BTXEKVHFBQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643309786 (564h27m23.996094914s) [noise=true , address=77.90.31.21:4879 , piece_id=EC22OY45XUID5AUXWHOGNXNDLB4XDLCV6HPV3UBJPPBHUQ3SSLRA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643346544 (564h27m23.996131653s) [noise=true , address=45.91.116.8:4045 , piece_id=MELAY6ZTJZLVPUWH42WZMK2DXHFHLH3TMXRWSC62PJRQKYQPV5UA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643622123 (564h27m23.996407231s) [noise=true , address=77.90.31.14:4662 , piece_id=6JLZCWORTH2PLC2DLIOA2AKMVO3FGJEAECT6AKHGWSTIE3T2WKTQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643761844 (564h27m23.996546973s) [noise=true , address=45.91.116.12:4226 , piece_id=ITSGCGY2Q54SCHFCKWFAOSB7IQ7PT65QSO7DYJ73L75IBN6F4KUA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643898721 (564h27m23.99668383s) [noise=true , address=77.90.31.15:4699 , piece_id=5NUZ5TWZ37TWIFWMZLU4IQIJM2T664LMTZ64G5SF34FNKJIAEY7Q, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644225534 (564h27m23.997010633s) [noise=true , address=145.79.227.17:4971 , piece_id=EXSSAK2YPMX2SNAJ63WGATSYOQSN4UBLWR6HNQT3SBNQKVC3FIEQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644262934 (564h27m23.997048063s) [noise=true , address=45.91.116.5:4297 , piece_id=4MGEUB24HBOREU3JK6AMDM5YVVNRZLSB4JQNVDO6OZTM34OL6RPQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644493046 (564h27m23.997278154s) [noise=true , address=145.79.227.16:4912 , piece_id=Q4LJLSZVZO2QFKZSX5H6PQRMJ4L45OUFIFPTYPXXXIASUJN5KWLA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644710705 (564h27m23.997495833s) [noise=true , address=45.91.116.11:4117 , piece_id=W76RLPI4YS3BRNGQ62PWMIAYE7XXWNELQ7I2GHYP7OHPM7UZTHFQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644748677 (564h27m23.997533775s) [noise=true , address=145.79.227.18:4006 , piece_id=6R6WM3ZKK3QJT432GX4K6JBBNCJP62OW6W2F4WUDPWZH4FZUPUIA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.645117088 (564h27m23.997902215s) [noise=true , address=45.91.116.9:4261 , piece_id=BUJRP5MAQWBUN4574SPGFUJPBL47PTY44EAXZQTJSU3HLRJ3RFJA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.645524543 (564h27m23.998309671s) [noise=true , address=145.79.227.15:4875 , piece_id=VCBGPMFWCYW7HJFLTOHN23N7WE7GJMWOG3EUE4SBI5EAKWFYERSA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.665103293 (564h27m24.017888422s) [noise=true , address=77.90.31.12:4590 , piece_id=HV6UKYLS2DO3D7KAWCZX5QJQM7VKAWOCELLLD7HJMTCBYCMWSCVQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.745677056 (564h27m24.098462164s) [upload=496753]: Next returned nil segment Sep 22 02:35:48.745690191 (564h27m24.098475289s) [upload=496753]: Waiting for error group managing segments... Sep 22 02:35:48.754349571 (564h27m24.107134679s) [noise=true , address=45.91.116.11:4117 , piece_id=W76RLPI4YS3BRNGQ62PWMIAYE7XXWNELQ7I2GHYP7OHPM7UZTHFQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.754626942 (564h27m24.10741207s) [noise=true , address=45.91.116.6:4973 , piece_id=C5C2BYWHKVQZG3RON4BG4HIUZPLKKBQKU7IN3INBO6BTXEKVHFBQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.754852776 (564h27m24.107637874s) [noise=true , address=45.91.116.9:4261 , piece_id=BUJRP5MAQWBUN4574SPGFUJPBL47PTY44EAXZQTJSU3HLRJ3RFJA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.755436311 (564h27m24.108221409s) [noise=true , address=45.91.116.5:4297 , piece_id=4MGEUB24HBOREU3JK6AMDM5YVVNRZLSB4JQNVDO6OZTM34OL6RPQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.755528805 (564h27m24.108313943s) [noise=true , address=45.91.116.8:4045 , piece_id=MELAY6ZTJZLVPUWH42WZMK2DXHFHLH3TMXRWSC62PJRQKYQPV5UA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.756359873 (564h27m24.109144982s) [noise=true , address=45.91.116.7:4009 , piece_id=43CWAMSOEHJ3MBS7CAXRRHT3A2D46N3UPDABBAXJPJKHYHV5FJSA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.756609232 (564h27m24.10939436s) [noise=true , address=45.91.116.14:4190 , piece_id=OG4SFNR4HAYSMJEJMYSVK46KRTM5OK7BWFQ6I6EWJA7CQHWJSDYA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.757064656 (564h27m24.109849754s) [noise=true , address=45.91.116.12:4226 , piece_id=ITSGCGY2Q54SCHFCKWFAOSB7IQ7PT65QSO7DYJ73L75IBN6F4KUA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.757744983 (564h27m24.110530111s) [noise=true , address=77.90.31.14:4662 , piece_id=6JLZCWORTH2PLC2DLIOA2AKMVO3FGJEAECT6AKHGWSTIE3T2WKTQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.758194145 (564h27m24.110979243s) [noise=true , address=77.90.31.15:4699 , piece_id=5NUZ5TWZ37TWIFWMZLU4IQIJM2T664LMTZ64G5SF34FNKJIAEY7Q, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.758960844 (564h27m24.111745972s) [noise=true , address=77.90.31.12:4590 , piece_id=HV6UKYLS2DO3D7KAWCZX5QJQM7VKAWOCELLLD7HJMTCBYCMWSCVQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.761254019 (564h27m24.114039127s) [noise=true , address=77.90.31.21:4879 , piece_id=EC22OY45XUID5AUXWHOGNXNDLB4XDLCV6HPV3UBJPPBHUQ3SSLRA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:36:18.575441938 (564h27m53.928227046s) [noise=true , address=145.79.227.16:4912 , piece_id=Q4LJLSZVZO2QFKZSX5H6PQRMJ4L45OUFIFPTYPXXXIASUJN5KWLA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: rpc: dial tcp 145.79.227.16:4912: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:36:18.575519313 (564h27m53.928304421s) [noise=true , address=145.79.227.17:4971 , piece_id=EXSSAK2YPMX2SNAJ63WGATSYOQSN4UBLWR6HNQT3SBNQKVC3FIEQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: rpc: dial tcp 145.79.227.17:4971: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:36:18.575577842 (564h27m53.92836295s) [noise=true , address=145.79.227.15:4875 , piece_id=VCBGPMFWCYW7HJFLTOHN23N7WE7GJMWOG3EUE4SBI5EAKWFYERSA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: rpc: dial tcp 145.79.227.15:4875: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:36:18.575599934 (564h27m53.928385043s) [noise=true , address=145.79.227.18:4006 , piece_id=6R6WM3ZKK3QJT432GX4K6JBBNCJP62OW6W2F4WUDPWZH4FZUPUIA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: rpc: dial tcp 145.79.227.18:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:36:18.575627306 (564h27m53.928412403s) [seg_pos={0 0}, upload=496753]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 22 02:36:18.593734595 (564h27m53.946519693s) [upload=496753]: Done uploading segments... Sep 22 02:36:18.593751657 (564h27m53.946536755s) [upload=496753]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 398.212205ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [..................X.XXXXXX..X...............................] duration: 445.531582ms FAIL (2025-09-22 02:38:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 445.550687ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 21 out of 60 is failed (threshold=3) [..................XXX....XXX.XXXXX..X.XX.XX.XX......XX..X...] duration: 626.027445ms FAIL (2025-09-22 02:38:29 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 22 02:35:48.588539876 (564h27m23.941325003s) [upload=496753]: Starting upload Sep 22 02:35:48.588637940 (564h27m23.941423068s) [upload=496753]: Done starting upload Sep 22 02:35:48.588752174 (564h27m23.941537282s) [upload=496753]: Uploading segments... Sep 22 02:35:48.588998997 (564h27m23.941784126s) [upload=496753]: Got next segment. Inline: false Sep 22 02:35:48.589052377 (564h27m23.941837506s) [upload=496753]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:35:48.589058178 (564h27m23.941843307s) [upload=496753]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:35:48.642639848 (564h27m23.995424987s) [seg_pos={0 0}, upload=496753]: Begin upload segment... Sep 22 02:35:48.642698349 (564h27m23.995483457s) [seg_pos={0 0}, upload=496753]: Done begin upload segment. Sep 22 02:35:48.642730810 (564h27m23.995515918s) [noise=true , address=45.91.116.14:4190 , piece_id=OG4SFNR4HAYSMJEJMYSVK46KRTM5OK7BWFQ6I6EWJA7CQHWJSDYA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.642772568 (564h27m23.995557696s) [noise=true , address=45.91.116.7:4009 , piece_id=43CWAMSOEHJ3MBS7CAXRRHT3A2D46N3UPDABBAXJPJKHYHV5FJSA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643050940 (564h27m23.995836039s) [noise=true , address=45.91.116.6:4973 , piece_id=C5C2BYWHKVQZG3RON4BG4HIUZPLKKBQKU7IN3INBO6BTXEKVHFBQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643309786 (564h27m23.996094914s) [noise=true , address=77.90.31.21:4879 , piece_id=EC22OY45XUID5AUXWHOGNXNDLB4XDLCV6HPV3UBJPPBHUQ3SSLRA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643346544 (564h27m23.996131653s) [noise=true , address=45.91.116.8:4045 , piece_id=MELAY6ZTJZLVPUWH42WZMK2DXHFHLH3TMXRWSC62PJRQKYQPV5UA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643622123 (564h27m23.996407231s) [noise=true , address=77.90.31.14:4662 , piece_id=6JLZCWORTH2PLC2DLIOA2AKMVO3FGJEAECT6AKHGWSTIE3T2WKTQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643761844 (564h27m23.996546973s) [noise=true , address=45.91.116.12:4226 , piece_id=ITSGCGY2Q54SCHFCKWFAOSB7IQ7PT65QSO7DYJ73L75IBN6F4KUA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643898721 (564h27m23.99668383s) [noise=true , address=77.90.31.15:4699 , piece_id=5NUZ5TWZ37TWIFWMZLU4IQIJM2T664LMTZ64G5SF34FNKJIAEY7Q, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644225534 (564h27m23.997010633s) [noise=true , address=145.79.227.17:4971 , piece_id=EXSSAK2YPMX2SNAJ63WGATSYOQSN4UBLWR6HNQT3SBNQKVC3FIEQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644262934 (564h27m23.997048063s) [noise=true , address=45.91.116.5:4297 , piece_id=4MGEUB24HBOREU3JK6AMDM5YVVNRZLSB4JQNVDO6OZTM34OL6RPQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644493046 (564h27m23.997278154s) [noise=true , address=145.79.227.16:4912 , piece_id=Q4LJLSZVZO2QFKZSX5H6PQRMJ4L45OUFIFPTYPXXXIASUJN5KWLA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644710705 (564h27m23.997495833s) [noise=true , address=45.91.116.11:4117 , piece_id=W76RLPI4YS3BRNGQ62PWMIAYE7XXWNELQ7I2GHYP7OHPM7UZTHFQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644748677 (564h27m23.997533775s) [noise=true , address=145.79.227.18:4006 , piece_id=6R6WM3ZKK3QJT432GX4K6JBBNCJP62OW6W2F4WUDPWZH4FZUPUIA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.645117088 (564h27m23.997902215s) [noise=true , address=45.91.116.9:4261 , piece_id=BUJRP5MAQWBUN4574SPGFUJPBL47PTY44EAXZQTJSU3HLRJ3RFJA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.645524543 (564h27m23.998309671s) [noise=true , address=145.79.227.15:4875 , piece_id=VCBGPMFWCYW7HJFLTOHN23N7WE7GJMWOG3EUE4SBI5EAKWFYERSA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.665103293 (564h27m24.017888422s) [noise=true , address=77.90.31.12:4590 , piece_id=HV6UKYLS2DO3D7KAWCZX5QJQM7VKAWOCELLLD7HJMTCBYCMWSCVQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.745677056 (564h27m24.098462164s) [upload=496753]: Next returned nil segment Sep 22 02:35:48.745690191 (564h27m24.098475289s) [upload=496753]: Waiting for error group managing segments... Sep 22 02:35:48.754349571 (564h27m24.107134679s) [noise=true , address=45.91.116.11:4117 , piece_id=W76RLPI4YS3BRNGQ62PWMIAYE7XXWNELQ7I2GHYP7OHPM7UZTHFQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.754626942 (564h27m24.10741207s) [noise=true , address=45.91.116.6:4973 , piece_id=C5C2BYWHKVQZG3RON4BG4HIUZPLKKBQKU7IN3INBO6BTXEKVHFBQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.754852776 (564h27m24.107637874s) [noise=true , address=45.91.116.9:4261 , piece_id=BUJRP5MAQWBUN4574SPGFUJPBL47PTY44EAXZQTJSU3HLRJ3RFJA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.755436311 (564h27m24.108221409s) [noise=true , address=45.91.116.5:4297 , piece_id=4MGEUB24HBOREU3JK6AMDM5YVVNRZLSB4JQNVDO6OZTM34OL6RPQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.755528805 (564h27m24.108313943s) [noise=true , address=45.91.116.8:4045 , piece_id=MELAY6ZTJZLVPUWH42WZMK2DXHFHLH3TMXRWSC62PJRQKYQPV5UA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.756359873 (564h27m24.109144982s) [noise=true , address=45.91.116.7:4009 , piece_id=43CWAMSOEHJ3MBS7CAXRRHT3A2D46N3UPDABBAXJPJKHYHV5FJSA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.756609232 (564h27m24.10939436s) [noise=true , address=45.91.116.14:4190 , piece_id=OG4SFNR4HAYSMJEJMYSVK46KRTM5OK7BWFQ6I6EWJA7CQHWJSDYA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.757064656 (564h27m24.109849754s) [noise=true , address=45.91.116.12:4226 , piece_id=ITSGCGY2Q54SCHFCKWFAOSB7IQ7PT65QSO7DYJ73L75IBN6F4KUA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.757744983 (564h27m24.110530111s) [noise=true , address=77.90.31.14:4662 , piece_id=6JLZCWORTH2PLC2DLIOA2AKMVO3FGJEAECT6AKHGWSTIE3T2WKTQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.758194145 (564h27m24.110979243s) [noise=true , address=77.90.31.15:4699 , piece_id=5NUZ5TWZ37TWIFWMZLU4IQIJM2T664LMTZ64G5SF34FNKJIAEY7Q, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.758960844 (564h27m24.111745972s) [noise=true , address=77.90.31.12:4590 , piece_id=HV6UKYLS2DO3D7KAWCZX5QJQM7VKAWOCELLLD7HJMTCBYCMWSCVQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.761254019 (564h27m24.114039127s) [noise=true , address=77.90.31.21:4879 , piece_id=EC22OY45XUID5AUXWHOGNXNDLB4XDLCV6HPV3UBJPPBHUQ3SSLRA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:36:18.575441938 (564h27m53.928227046s) [noise=true , address=145.79.227.16:4912 , piece_id=Q4LJLSZVZO2QFKZSX5H6PQRMJ4L45OUFIFPTYPXXXIASUJN5KWLA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: rpc: dial tcp 145.79.227.16:4912: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:36:18.575519313 (564h27m53.928304421s) [noise=true , address=145.79.227.17:4971 , piece_id=EXSSAK2YPMX2SNAJ63WGATSYOQSN4UBLWR6HNQT3SBNQKVC3FIEQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: rpc: dial tcp 145.79.227.17:4971: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:36:18.575577842 (564h27m53.92836295s) [noise=true , address=145.79.227.15:4875 , piece_id=VCBGPMFWCYW7HJFLTOHN23N7WE7GJMWOG3EUE4SBI5EAKWFYERSA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: rpc: dial tcp 145.79.227.15:4875: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:36:18.575599934 (564h27m53.928385043s) [noise=true , address=145.79.227.18:4006 , piece_id=6R6WM3ZKK3QJT432GX4K6JBBNCJP62OW6W2F4WUDPWZH4FZUPUIA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: rpc: dial tcp 145.79.227.18:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:36:18.575627306 (564h27m53.928412403s) [seg_pos={0 0}, upload=496753]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 22 02:36:18.593734595 (564h27m53.946519693s) [upload=496753]: Done uploading segments... Sep 22 02:36:18.593751657 (564h27m53.946536755s) [upload=496753]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 626.051479ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [.....................X.X.........X.......X...X.....X.XX..XX.] duration: 529.098ms FAIL (2025-09-22 02:38:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 529.116834ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [......................X.X.........X.......X...X.....X.XX..XX] duration: 30.00099481s FAIL (2025-09-22 02:37:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001011252s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [...................X.XXXXXX..X..............................] duration: 504.41964ms FAIL (2025-09-22 02:37:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 504.460917ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 21 out of 60 is failed (threshold=3) [...................XXX....XXX.XXXXX..X.XX.XX.XX......XX..X..] duration: 440.93693ms FAIL (2025-09-22 02:37:18 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 22 02:35:48.588539876 (564h27m23.941325003s) [upload=496753]: Starting upload Sep 22 02:35:48.588637940 (564h27m23.941423068s) [upload=496753]: Done starting upload Sep 22 02:35:48.588752174 (564h27m23.941537282s) [upload=496753]: Uploading segments... Sep 22 02:35:48.588998997 (564h27m23.941784126s) [upload=496753]: Got next segment. Inline: false Sep 22 02:35:48.589052377 (564h27m23.941837506s) [upload=496753]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:35:48.589058178 (564h27m23.941843307s) [upload=496753]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:35:48.642639848 (564h27m23.995424987s) [seg_pos={0 0}, upload=496753]: Begin upload segment... Sep 22 02:35:48.642698349 (564h27m23.995483457s) [seg_pos={0 0}, upload=496753]: Done begin upload segment. Sep 22 02:35:48.642730810 (564h27m23.995515918s) [noise=true , address=45.91.116.14:4190 , piece_id=OG4SFNR4HAYSMJEJMYSVK46KRTM5OK7BWFQ6I6EWJA7CQHWJSDYA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.642772568 (564h27m23.995557696s) [noise=true , address=45.91.116.7:4009 , piece_id=43CWAMSOEHJ3MBS7CAXRRHT3A2D46N3UPDABBAXJPJKHYHV5FJSA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643050940 (564h27m23.995836039s) [noise=true , address=45.91.116.6:4973 , piece_id=C5C2BYWHKVQZG3RON4BG4HIUZPLKKBQKU7IN3INBO6BTXEKVHFBQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643309786 (564h27m23.996094914s) [noise=true , address=77.90.31.21:4879 , piece_id=EC22OY45XUID5AUXWHOGNXNDLB4XDLCV6HPV3UBJPPBHUQ3SSLRA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643346544 (564h27m23.996131653s) [noise=true , address=45.91.116.8:4045 , piece_id=MELAY6ZTJZLVPUWH42WZMK2DXHFHLH3TMXRWSC62PJRQKYQPV5UA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643622123 (564h27m23.996407231s) [noise=true , address=77.90.31.14:4662 , piece_id=6JLZCWORTH2PLC2DLIOA2AKMVO3FGJEAECT6AKHGWSTIE3T2WKTQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643761844 (564h27m23.996546973s) [noise=true , address=45.91.116.12:4226 , piece_id=ITSGCGY2Q54SCHFCKWFAOSB7IQ7PT65QSO7DYJ73L75IBN6F4KUA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643898721 (564h27m23.99668383s) [noise=true , address=77.90.31.15:4699 , piece_id=5NUZ5TWZ37TWIFWMZLU4IQIJM2T664LMTZ64G5SF34FNKJIAEY7Q, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644225534 (564h27m23.997010633s) [noise=true , address=145.79.227.17:4971 , piece_id=EXSSAK2YPMX2SNAJ63WGATSYOQSN4UBLWR6HNQT3SBNQKVC3FIEQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644262934 (564h27m23.997048063s) [noise=true , address=45.91.116.5:4297 , piece_id=4MGEUB24HBOREU3JK6AMDM5YVVNRZLSB4JQNVDO6OZTM34OL6RPQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644493046 (564h27m23.997278154s) [noise=true , address=145.79.227.16:4912 , piece_id=Q4LJLSZVZO2QFKZSX5H6PQRMJ4L45OUFIFPTYPXXXIASUJN5KWLA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644710705 (564h27m23.997495833s) [noise=true , address=45.91.116.11:4117 , piece_id=W76RLPI4YS3BRNGQ62PWMIAYE7XXWNELQ7I2GHYP7OHPM7UZTHFQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644748677 (564h27m23.997533775s) [noise=true , address=145.79.227.18:4006 , piece_id=6R6WM3ZKK3QJT432GX4K6JBBNCJP62OW6W2F4WUDPWZH4FZUPUIA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.645117088 (564h27m23.997902215s) [noise=true , address=45.91.116.9:4261 , piece_id=BUJRP5MAQWBUN4574SPGFUJPBL47PTY44EAXZQTJSU3HLRJ3RFJA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.645524543 (564h27m23.998309671s) [noise=true , address=145.79.227.15:4875 , piece_id=VCBGPMFWCYW7HJFLTOHN23N7WE7GJMWOG3EUE4SBI5EAKWFYERSA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.665103293 (564h27m24.017888422s) [noise=true , address=77.90.31.12:4590 , piece_id=HV6UKYLS2DO3D7KAWCZX5QJQM7VKAWOCELLLD7HJMTCBYCMWSCVQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.745677056 (564h27m24.098462164s) [upload=496753]: Next returned nil segment Sep 22 02:35:48.745690191 (564h27m24.098475289s) [upload=496753]: Waiting for error group managing segments... Sep 22 02:35:48.754349571 (564h27m24.107134679s) [noise=true , address=45.91.116.11:4117 , piece_id=W76RLPI4YS3BRNGQ62PWMIAYE7XXWNELQ7I2GHYP7OHPM7UZTHFQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.754626942 (564h27m24.10741207s) [noise=true , address=45.91.116.6:4973 , piece_id=C5C2BYWHKVQZG3RON4BG4HIUZPLKKBQKU7IN3INBO6BTXEKVHFBQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.754852776 (564h27m24.107637874s) [noise=true , address=45.91.116.9:4261 , piece_id=BUJRP5MAQWBUN4574SPGFUJPBL47PTY44EAXZQTJSU3HLRJ3RFJA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.755436311 (564h27m24.108221409s) [noise=true , address=45.91.116.5:4297 , piece_id=4MGEUB24HBOREU3JK6AMDM5YVVNRZLSB4JQNVDO6OZTM34OL6RPQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.755528805 (564h27m24.108313943s) [noise=true , address=45.91.116.8:4045 , piece_id=MELAY6ZTJZLVPUWH42WZMK2DXHFHLH3TMXRWSC62PJRQKYQPV5UA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.756359873 (564h27m24.109144982s) [noise=true , address=45.91.116.7:4009 , piece_id=43CWAMSOEHJ3MBS7CAXRRHT3A2D46N3UPDABBAXJPJKHYHV5FJSA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.756609232 (564h27m24.10939436s) [noise=true , address=45.91.116.14:4190 , piece_id=OG4SFNR4HAYSMJEJMYSVK46KRTM5OK7BWFQ6I6EWJA7CQHWJSDYA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.757064656 (564h27m24.109849754s) [noise=true , address=45.91.116.12:4226 , piece_id=ITSGCGY2Q54SCHFCKWFAOSB7IQ7PT65QSO7DYJ73L75IBN6F4KUA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.757744983 (564h27m24.110530111s) [noise=true , address=77.90.31.14:4662 , piece_id=6JLZCWORTH2PLC2DLIOA2AKMVO3FGJEAECT6AKHGWSTIE3T2WKTQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.758194145 (564h27m24.110979243s) [noise=true , address=77.90.31.15:4699 , piece_id=5NUZ5TWZ37TWIFWMZLU4IQIJM2T664LMTZ64G5SF34FNKJIAEY7Q, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.758960844 (564h27m24.111745972s) [noise=true , address=77.90.31.12:4590 , piece_id=HV6UKYLS2DO3D7KAWCZX5QJQM7VKAWOCELLLD7HJMTCBYCMWSCVQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.761254019 (564h27m24.114039127s) [noise=true , address=77.90.31.21:4879 , piece_id=EC22OY45XUID5AUXWHOGNXNDLB4XDLCV6HPV3UBJPPBHUQ3SSLRA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:36:18.575441938 (564h27m53.928227046s) [noise=true , address=145.79.227.16:4912 , piece_id=Q4LJLSZVZO2QFKZSX5H6PQRMJ4L45OUFIFPTYPXXXIASUJN5KWLA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: rpc: dial tcp 145.79.227.16:4912: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:36:18.575519313 (564h27m53.928304421s) [noise=true , address=145.79.227.17:4971 , piece_id=EXSSAK2YPMX2SNAJ63WGATSYOQSN4UBLWR6HNQT3SBNQKVC3FIEQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: rpc: dial tcp 145.79.227.17:4971: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:36:18.575577842 (564h27m53.92836295s) [noise=true , address=145.79.227.15:4875 , piece_id=VCBGPMFWCYW7HJFLTOHN23N7WE7GJMWOG3EUE4SBI5EAKWFYERSA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: rpc: dial tcp 145.79.227.15:4875: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:36:18.575599934 (564h27m53.928385043s) [noise=true , address=145.79.227.18:4006 , piece_id=6R6WM3ZKK3QJT432GX4K6JBBNCJP62OW6W2F4WUDPWZH4FZUPUIA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: rpc: dial tcp 145.79.227.18:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:36:18.575627306 (564h27m53.928412403s) [seg_pos={0 0}, upload=496753]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 22 02:36:18.593734595 (564h27m53.946519693s) [upload=496753]: Done uploading segments... Sep 22 02:36:18.593751657 (564h27m53.946536755s) [upload=496753]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 440.961496ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [....................X.XXXXXX..X.............................] duration: 747.727314ms FAIL (2025-09-22 02:37:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 747.752211ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [.....................X.XXXXXX..X............................] duration: 489.594849ms FAIL (2025-09-22 02:36:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 489.619184ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [.......................X.X.........X.......X...X.....X.XX..X] duration: 30.001121643s FAIL (2025-09-22 02:36:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001152171s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 21 out of 60 is failed (threshold=3) [....................XXX....XXX.XXXXX..X.XX.XX.XX......XX..X.] duration: 641.971935ms FAIL (2025-09-22 02:36:19 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 22 02:35:48.588539876 (564h27m23.941325003s) [upload=496753]: Starting upload Sep 22 02:35:48.588637940 (564h27m23.941423068s) [upload=496753]: Done starting upload Sep 22 02:35:48.588752174 (564h27m23.941537282s) [upload=496753]: Uploading segments... Sep 22 02:35:48.588998997 (564h27m23.941784126s) [upload=496753]: Got next segment. Inline: false Sep 22 02:35:48.589052377 (564h27m23.941837506s) [upload=496753]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:35:48.589058178 (564h27m23.941843307s) [upload=496753]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:35:48.642639848 (564h27m23.995424987s) [seg_pos={0 0}, upload=496753]: Begin upload segment... Sep 22 02:35:48.642698349 (564h27m23.995483457s) [seg_pos={0 0}, upload=496753]: Done begin upload segment. Sep 22 02:35:48.642730810 (564h27m23.995515918s) [noise=true , address=45.91.116.14:4190 , piece_id=OG4SFNR4HAYSMJEJMYSVK46KRTM5OK7BWFQ6I6EWJA7CQHWJSDYA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.642772568 (564h27m23.995557696s) [noise=true , address=45.91.116.7:4009 , piece_id=43CWAMSOEHJ3MBS7CAXRRHT3A2D46N3UPDABBAXJPJKHYHV5FJSA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643050940 (564h27m23.995836039s) [noise=true , address=45.91.116.6:4973 , piece_id=C5C2BYWHKVQZG3RON4BG4HIUZPLKKBQKU7IN3INBO6BTXEKVHFBQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643309786 (564h27m23.996094914s) [noise=true , address=77.90.31.21:4879 , piece_id=EC22OY45XUID5AUXWHOGNXNDLB4XDLCV6HPV3UBJPPBHUQ3SSLRA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643346544 (564h27m23.996131653s) [noise=true , address=45.91.116.8:4045 , piece_id=MELAY6ZTJZLVPUWH42WZMK2DXHFHLH3TMXRWSC62PJRQKYQPV5UA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643622123 (564h27m23.996407231s) [noise=true , address=77.90.31.14:4662 , piece_id=6JLZCWORTH2PLC2DLIOA2AKMVO3FGJEAECT6AKHGWSTIE3T2WKTQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643761844 (564h27m23.996546973s) [noise=true , address=45.91.116.12:4226 , piece_id=ITSGCGY2Q54SCHFCKWFAOSB7IQ7PT65QSO7DYJ73L75IBN6F4KUA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643898721 (564h27m23.99668383s) [noise=true , address=77.90.31.15:4699 , piece_id=5NUZ5TWZ37TWIFWMZLU4IQIJM2T664LMTZ64G5SF34FNKJIAEY7Q, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644225534 (564h27m23.997010633s) [noise=true , address=145.79.227.17:4971 , piece_id=EXSSAK2YPMX2SNAJ63WGATSYOQSN4UBLWR6HNQT3SBNQKVC3FIEQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644262934 (564h27m23.997048063s) [noise=true , address=45.91.116.5:4297 , piece_id=4MGEUB24HBOREU3JK6AMDM5YVVNRZLSB4JQNVDO6OZTM34OL6RPQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644493046 (564h27m23.997278154s) [noise=true , address=145.79.227.16:4912 , piece_id=Q4LJLSZVZO2QFKZSX5H6PQRMJ4L45OUFIFPTYPXXXIASUJN5KWLA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644710705 (564h27m23.997495833s) [noise=true , address=45.91.116.11:4117 , piece_id=W76RLPI4YS3BRNGQ62PWMIAYE7XXWNELQ7I2GHYP7OHPM7UZTHFQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644748677 (564h27m23.997533775s) [noise=true , address=145.79.227.18:4006 , piece_id=6R6WM3ZKK3QJT432GX4K6JBBNCJP62OW6W2F4WUDPWZH4FZUPUIA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.645117088 (564h27m23.997902215s) [noise=true , address=45.91.116.9:4261 , piece_id=BUJRP5MAQWBUN4574SPGFUJPBL47PTY44EAXZQTJSU3HLRJ3RFJA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.645524543 (564h27m23.998309671s) [noise=true , address=145.79.227.15:4875 , piece_id=VCBGPMFWCYW7HJFLTOHN23N7WE7GJMWOG3EUE4SBI5EAKWFYERSA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.665103293 (564h27m24.017888422s) [noise=true , address=77.90.31.12:4590 , piece_id=HV6UKYLS2DO3D7KAWCZX5QJQM7VKAWOCELLLD7HJMTCBYCMWSCVQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.745677056 (564h27m24.098462164s) [upload=496753]: Next returned nil segment Sep 22 02:35:48.745690191 (564h27m24.098475289s) [upload=496753]: Waiting for error group managing segments... Sep 22 02:35:48.754349571 (564h27m24.107134679s) [noise=true , address=45.91.116.11:4117 , piece_id=W76RLPI4YS3BRNGQ62PWMIAYE7XXWNELQ7I2GHYP7OHPM7UZTHFQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.754626942 (564h27m24.10741207s) [noise=true , address=45.91.116.6:4973 , piece_id=C5C2BYWHKVQZG3RON4BG4HIUZPLKKBQKU7IN3INBO6BTXEKVHFBQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.754852776 (564h27m24.107637874s) [noise=true , address=45.91.116.9:4261 , piece_id=BUJRP5MAQWBUN4574SPGFUJPBL47PTY44EAXZQTJSU3HLRJ3RFJA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.755436311 (564h27m24.108221409s) [noise=true , address=45.91.116.5:4297 , piece_id=4MGEUB24HBOREU3JK6AMDM5YVVNRZLSB4JQNVDO6OZTM34OL6RPQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.755528805 (564h27m24.108313943s) [noise=true , address=45.91.116.8:4045 , piece_id=MELAY6ZTJZLVPUWH42WZMK2DXHFHLH3TMXRWSC62PJRQKYQPV5UA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.756359873 (564h27m24.109144982s) [noise=true , address=45.91.116.7:4009 , piece_id=43CWAMSOEHJ3MBS7CAXRRHT3A2D46N3UPDABBAXJPJKHYHV5FJSA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.756609232 (564h27m24.10939436s) [noise=true , address=45.91.116.14:4190 , piece_id=OG4SFNR4HAYSMJEJMYSVK46KRTM5OK7BWFQ6I6EWJA7CQHWJSDYA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.757064656 (564h27m24.109849754s) [noise=true , address=45.91.116.12:4226 , piece_id=ITSGCGY2Q54SCHFCKWFAOSB7IQ7PT65QSO7DYJ73L75IBN6F4KUA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.757744983 (564h27m24.110530111s) [noise=true , address=77.90.31.14:4662 , piece_id=6JLZCWORTH2PLC2DLIOA2AKMVO3FGJEAECT6AKHGWSTIE3T2WKTQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.758194145 (564h27m24.110979243s) [noise=true , address=77.90.31.15:4699 , piece_id=5NUZ5TWZ37TWIFWMZLU4IQIJM2T664LMTZ64G5SF34FNKJIAEY7Q, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.758960844 (564h27m24.111745972s) [noise=true , address=77.90.31.12:4590 , piece_id=HV6UKYLS2DO3D7KAWCZX5QJQM7VKAWOCELLLD7HJMTCBYCMWSCVQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.761254019 (564h27m24.114039127s) [noise=true , address=77.90.31.21:4879 , piece_id=EC22OY45XUID5AUXWHOGNXNDLB4XDLCV6HPV3UBJPPBHUQ3SSLRA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:36:18.575441938 (564h27m53.928227046s) [noise=true , address=145.79.227.16:4912 , piece_id=Q4LJLSZVZO2QFKZSX5H6PQRMJ4L45OUFIFPTYPXXXIASUJN5KWLA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: rpc: dial tcp 145.79.227.16:4912: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:36:18.575519313 (564h27m53.928304421s) [noise=true , address=145.79.227.17:4971 , piece_id=EXSSAK2YPMX2SNAJ63WGATSYOQSN4UBLWR6HNQT3SBNQKVC3FIEQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: rpc: dial tcp 145.79.227.17:4971: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:36:18.575577842 (564h27m53.92836295s) [noise=true , address=145.79.227.15:4875 , piece_id=VCBGPMFWCYW7HJFLTOHN23N7WE7GJMWOG3EUE4SBI5EAKWFYERSA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: rpc: dial tcp 145.79.227.15:4875: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:36:18.575599934 (564h27m53.928385043s) [noise=true , address=145.79.227.18:4006 , piece_id=6R6WM3ZKK3QJT432GX4K6JBBNCJP62OW6W2F4WUDPWZH4FZUPUIA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: rpc: dial tcp 145.79.227.18:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:36:18.575627306 (564h27m53.928412403s) [seg_pos={0 0}, upload=496753]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 22 02:36:18.593734595 (564h27m53.946519693s) [upload=496753]: Done uploading segments... Sep 22 02:36:18.593751657 (564h27m53.946536755s) [upload=496753]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 641.98492ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 21 out of 60 is failed (threshold=3) [.....................XXX....XXX.XXXXX..X.XX.XX.XX......XX..X] duration: 30.019623355s FAIL (2025-09-22 02:36:18 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 22 02:35:48.588539876 (564h27m23.941325003s) [upload=496753]: Starting upload Sep 22 02:35:48.588637940 (564h27m23.941423068s) [upload=496753]: Done starting upload Sep 22 02:35:48.588752174 (564h27m23.941537282s) [upload=496753]: Uploading segments... Sep 22 02:35:48.588998997 (564h27m23.941784126s) [upload=496753]: Got next segment. Inline: false Sep 22 02:35:48.589052377 (564h27m23.941837506s) [upload=496753]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:35:48.589058178 (564h27m23.941843307s) [upload=496753]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:35:48.642639848 (564h27m23.995424987s) [seg_pos={0 0}, upload=496753]: Begin upload segment... Sep 22 02:35:48.642698349 (564h27m23.995483457s) [seg_pos={0 0}, upload=496753]: Done begin upload segment. Sep 22 02:35:48.642730810 (564h27m23.995515918s) [noise=true , address=45.91.116.14:4190 , piece_id=OG4SFNR4HAYSMJEJMYSVK46KRTM5OK7BWFQ6I6EWJA7CQHWJSDYA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.642772568 (564h27m23.995557696s) [noise=true , address=45.91.116.7:4009 , piece_id=43CWAMSOEHJ3MBS7CAXRRHT3A2D46N3UPDABBAXJPJKHYHV5FJSA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643050940 (564h27m23.995836039s) [noise=true , address=45.91.116.6:4973 , piece_id=C5C2BYWHKVQZG3RON4BG4HIUZPLKKBQKU7IN3INBO6BTXEKVHFBQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643309786 (564h27m23.996094914s) [noise=true , address=77.90.31.21:4879 , piece_id=EC22OY45XUID5AUXWHOGNXNDLB4XDLCV6HPV3UBJPPBHUQ3SSLRA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643346544 (564h27m23.996131653s) [noise=true , address=45.91.116.8:4045 , piece_id=MELAY6ZTJZLVPUWH42WZMK2DXHFHLH3TMXRWSC62PJRQKYQPV5UA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643622123 (564h27m23.996407231s) [noise=true , address=77.90.31.14:4662 , piece_id=6JLZCWORTH2PLC2DLIOA2AKMVO3FGJEAECT6AKHGWSTIE3T2WKTQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643761844 (564h27m23.996546973s) [noise=true , address=45.91.116.12:4226 , piece_id=ITSGCGY2Q54SCHFCKWFAOSB7IQ7PT65QSO7DYJ73L75IBN6F4KUA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.643898721 (564h27m23.99668383s) [noise=true , address=77.90.31.15:4699 , piece_id=5NUZ5TWZ37TWIFWMZLU4IQIJM2T664LMTZ64G5SF34FNKJIAEY7Q, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644225534 (564h27m23.997010633s) [noise=true , address=145.79.227.17:4971 , piece_id=EXSSAK2YPMX2SNAJ63WGATSYOQSN4UBLWR6HNQT3SBNQKVC3FIEQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644262934 (564h27m23.997048063s) [noise=true , address=45.91.116.5:4297 , piece_id=4MGEUB24HBOREU3JK6AMDM5YVVNRZLSB4JQNVDO6OZTM34OL6RPQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644493046 (564h27m23.997278154s) [noise=true , address=145.79.227.16:4912 , piece_id=Q4LJLSZVZO2QFKZSX5H6PQRMJ4L45OUFIFPTYPXXXIASUJN5KWLA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644710705 (564h27m23.997495833s) [noise=true , address=45.91.116.11:4117 , piece_id=W76RLPI4YS3BRNGQ62PWMIAYE7XXWNELQ7I2GHYP7OHPM7UZTHFQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.644748677 (564h27m23.997533775s) [noise=true , address=145.79.227.18:4006 , piece_id=6R6WM3ZKK3QJT432GX4K6JBBNCJP62OW6W2F4WUDPWZH4FZUPUIA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.645117088 (564h27m23.997902215s) [noise=true , address=45.91.116.9:4261 , piece_id=BUJRP5MAQWBUN4574SPGFUJPBL47PTY44EAXZQTJSU3HLRJ3RFJA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.645524543 (564h27m23.998309671s) [noise=true , address=145.79.227.15:4875 , piece_id=VCBGPMFWCYW7HJFLTOHN23N7WE7GJMWOG3EUE4SBI5EAKWFYERSA, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.665103293 (564h27m24.017888422s) [noise=true , address=77.90.31.12:4590 , piece_id=HV6UKYLS2DO3D7KAWCZX5QJQM7VKAWOCELLLD7HJMTCBYCMWSCVQ, seg_pos={0 0}, upload=496753]: Uploading piece... Sep 22 02:35:48.745677056 (564h27m24.098462164s) [upload=496753]: Next returned nil segment Sep 22 02:35:48.745690191 (564h27m24.098475289s) [upload=496753]: Waiting for error group managing segments... Sep 22 02:35:48.754349571 (564h27m24.107134679s) [noise=true , address=45.91.116.11:4117 , piece_id=W76RLPI4YS3BRNGQ62PWMIAYE7XXWNELQ7I2GHYP7OHPM7UZTHFQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.754626942 (564h27m24.10741207s) [noise=true , address=45.91.116.6:4973 , piece_id=C5C2BYWHKVQZG3RON4BG4HIUZPLKKBQKU7IN3INBO6BTXEKVHFBQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.754852776 (564h27m24.107637874s) [noise=true , address=45.91.116.9:4261 , piece_id=BUJRP5MAQWBUN4574SPGFUJPBL47PTY44EAXZQTJSU3HLRJ3RFJA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.755436311 (564h27m24.108221409s) [noise=true , address=45.91.116.5:4297 , piece_id=4MGEUB24HBOREU3JK6AMDM5YVVNRZLSB4JQNVDO6OZTM34OL6RPQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.755528805 (564h27m24.108313943s) [noise=true , address=45.91.116.8:4045 , piece_id=MELAY6ZTJZLVPUWH42WZMK2DXHFHLH3TMXRWSC62PJRQKYQPV5UA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.756359873 (564h27m24.109144982s) [noise=true , address=45.91.116.7:4009 , piece_id=43CWAMSOEHJ3MBS7CAXRRHT3A2D46N3UPDABBAXJPJKHYHV5FJSA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.756609232 (564h27m24.10939436s) [noise=true , address=45.91.116.14:4190 , piece_id=OG4SFNR4HAYSMJEJMYSVK46KRTM5OK7BWFQ6I6EWJA7CQHWJSDYA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.757064656 (564h27m24.109849754s) [noise=true , address=45.91.116.12:4226 , piece_id=ITSGCGY2Q54SCHFCKWFAOSB7IQ7PT65QSO7DYJ73L75IBN6F4KUA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.757744983 (564h27m24.110530111s) [noise=true , address=77.90.31.14:4662 , piece_id=6JLZCWORTH2PLC2DLIOA2AKMVO3FGJEAECT6AKHGWSTIE3T2WKTQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.758194145 (564h27m24.110979243s) [noise=true , address=77.90.31.15:4699 , piece_id=5NUZ5TWZ37TWIFWMZLU4IQIJM2T664LMTZ64G5SF34FNKJIAEY7Q, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.758960844 (564h27m24.111745972s) [noise=true , address=77.90.31.12:4590 , piece_id=HV6UKYLS2DO3D7KAWCZX5QJQM7VKAWOCELLLD7HJMTCBYCMWSCVQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:35:48.761254019 (564h27m24.114039127s) [noise=true , address=77.90.31.21:4879 , piece_id=EC22OY45XUID5AUXWHOGNXNDLB4XDLCV6HPV3UBJPPBHUQ3SSLRA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: <nil> Sep 22 02:36:18.575441938 (564h27m53.928227046s) [noise=true , address=145.79.227.16:4912 , piece_id=Q4LJLSZVZO2QFKZSX5H6PQRMJ4L45OUFIFPTYPXXXIASUJN5KWLA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: rpc: dial tcp 145.79.227.16:4912: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:36:18.575519313 (564h27m53.928304421s) [noise=true , address=145.79.227.17:4971 , piece_id=EXSSAK2YPMX2SNAJ63WGATSYOQSN4UBLWR6HNQT3SBNQKVC3FIEQ, seg_pos={0 0}, upload=496753]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: rpc: dial tcp 145.79.227.17:4971: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:36:18.575577842 (564h27m53.92836295s) [noise=true , address=145.79.227.15:4875 , piece_id=VCBGPMFWCYW7HJFLTOHN23N7WE7GJMWOG3EUE4SBI5EAKWFYERSA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: rpc: dial tcp 145.79.227.15:4875: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:36:18.575599934 (564h27m53.928385043s) [noise=true , address=145.79.227.18:4006 , piece_id=6R6WM3ZKK3QJT432GX4K6JBBNCJP62OW6W2F4WUDPWZH4FZUPUIA, seg_pos={0 0}, upload=496753]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:145.79.227.18:4006): protocol: rpc: dial tcp 145.79.227.18:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:36:18.575627306 (564h27m53.928412403s) [seg_pos={0 0}, upload=496753]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 22 02:36:18.593734595 (564h27m53.946519693s) [upload=496753]: Done uploading segments... Sep 22 02:36:18.593751657 (564h27m53.946536755s) [upload=496753]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.019642291s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [......................X.XXXXXX..X...........................] duration: 472.351891ms FAIL (2025-09-22 02:36:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 472.373902ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [.......................X.XXXXXX..X..........................] duration: 497.778487ms FAIL (2025-09-22 02:35:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 497.80135ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [........................X.X.........X.......X...X.....X.XX..] duration: 493.182862ms FAIL (2025-09-22 02:35:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 493.202119ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [........................X.XXXXXX..X.........................] duration: 588.599811ms FAIL (2025-09-22 02:35:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 588.625138ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 20 out of 60 is failed (threshold=3) [......................XXX....XXX.XXXXX..X.XX.XX.XX......XX..] duration: 582.021996ms FAIL (2025-09-22 02:34:58 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 22 02:33:11.384426612 (564h24m46.73721175s) [upload=496714]: Starting upload Sep 22 02:33:11.384566675 (564h24m46.737351812s) [upload=496714]: Done starting upload Sep 22 02:33:11.384642446 (564h24m46.737427585s) [upload=496714]: Uploading segments... Sep 22 02:33:11.384975351 (564h24m46.737760479s) [upload=496714]: Got next segment. Inline: false Sep 22 02:33:11.385074347 (564h24m46.737859475s) [upload=496714]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:33:11.385081710 (564h24m46.737866839s) [upload=496714]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:33:11.406584783 (564h24m46.759369931s) [seg_pos={0 0}, upload=496714]: Begin upload segment... Sep 22 02:33:11.406646089 (564h24m46.759431227s) [seg_pos={0 0}, upload=496714]: Done begin upload segment. Sep 22 02:33:11.406665836 (564h24m46.759450963s) [noise=true , address=145.79.227.18:4007 , piece_id=KGWD7UHWZCIIPU6HAR6Q47LPSSQ7SGYZRLU4XOCJW6T4WFZN6BCQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.406677097 (564h24m46.759462225s) [noise=true , address=145.79.227.3:4151 , piece_id=PIXQJLVSHRNFCXBREW4SDTREXDKL7MVBGNA46YD2SP2CGBCOE7HQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.406818372 (564h24m46.75960351s) [noise=true , address=45.91.116.6:4974 , piece_id=MS5U3CG36IYXCL4RDRT6IBOXFPY3NZGXDQNCOS6VTSZUYRTUPFEQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.407443044 (564h24m46.760228181s) [noise=true , address=77.90.31.19:4842 , piece_id=BZ6IANMEYTUSP653BRS5TPGWADXJXHLFFZ3WGYL7CYKYJY57XRJQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.408091821 (564h24m46.760876949s) [noise=true , address=45.91.116.11:4117 , piece_id=GHGK4RT6GZ6AJZ5LUDPXEZWKHIZXYB7FQXUZKHUKH2YS6VJE5VOQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.408693110 (564h24m46.761478248s) [noise=true , address=45.91.116.10:4081 , piece_id=NFGJ4LOFNXYZZVE5A7GMT4VKB2JAPWOJ5OPBG3ZIHGHSLPATSWEA, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.409252640 (564h24m46.762037767s) [noise=true , address=77.90.31.19:4843 , piece_id=JSPMTDWLEH62YXHF5K7BJPKL4AYWYNTTRZWAW7VV55UEV7LKS3BA, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.409826727 (564h24m46.762611855s) [noise=true , address=77.90.31.12:4589 , piece_id=OUUEV63FXNDH3YU4DEAZETWCFJCOQF73GY5AY4FTHPYKB4AJUDDA, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.410411845 (564h24m46.763196983s) [noise=true , address=45.91.116.13:4153 , piece_id=Z7X53QODAQ7U2L4P42RLWNMSDRYJ3WYLJ77Y2TG6D3HLJWN4PT3Q, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.411023071 (564h24m46.76380821s) [noise=true , address=45.91.116.13:4154 , piece_id=3LWZ2AIHGNGCFAMF4HUIKALJTXWW7CBYE7PTVY2UT3HLNVBUKYGA, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.411609723 (564h24m46.764394861s) [noise=true , address=145.79.227.11:4730 , piece_id=A67FLQ5IWOE6DARJDATGMQPC7SIXMBYENKX6QBNV5RTLXILPKZOA, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.412208708 (564h24m46.764993845s) [noise=true , address=145.79.227.16:4909 , piece_id=AMXY7BTB33XIPL55IHX55BY5JAUGM3QTFX5KUY5RDMKR7OYV3BLA, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.412766834 (564h24m46.765551972s) [noise=true , address=45.91.116.4:4938 , piece_id=KOMX3BCHZCDJQA4QNUGBXIWS4GU2ES6NDQ4WQRGNO2WT4YNJWEBQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.413099869 (564h24m46.765885007s) [noise=true , address=45.91.116.12:4227 , piece_id=EATRY6TOO5YRZ65GIUR3RAMXTXV2CF7A25WYL7SCNQWCGG6CSYEA, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.414058568 (564h24m46.766843707s) [noise=true , address=77.90.31.15:4699 , piece_id=L7YAK3GJJQFXUDZMWGVZEEGF7MJELC3TV75S4URLIFLUFN64PUVQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.416328989 (564h24m46.769114117s) [noise=true , address=77.90.31.13:4627 , piece_id=A4IN5FKSUYIQY2UCA6Z7FMK7K26AIW2TWSO5JP4HQCHL7UYGRHEQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.539317775 (564h24m46.892102893s) [upload=496714]: Next returned nil segment Sep 22 02:33:11.539331401 (564h24m46.892116519s) [upload=496714]: Waiting for error group managing segments... Sep 22 02:33:11.548881864 (564h24m46.901666992s) [noise=true , address=45.91.116.10:4081 , piece_id=NFGJ4LOFNXYZZVE5A7GMT4VKB2JAPWOJ5OPBG3ZIHGHSLPATSWEA, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.549065759 (564h24m46.901850887s) [noise=true , address=45.91.116.13:4154 , piece_id=3LWZ2AIHGNGCFAMF4HUIKALJTXWW7CBYE7PTVY2UT3HLNVBUKYGA, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.549577719 (564h24m46.902362847s) [noise=true , address=77.90.31.19:4843 , piece_id=JSPMTDWLEH62YXHF5K7BJPKL4AYWYNTTRZWAW7VV55UEV7LKS3BA, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.549997097 (564h24m46.902782225s) [noise=true , address=45.91.116.13:4153 , piece_id=Z7X53QODAQ7U2L4P42RLWNMSDRYJ3WYLJ77Y2TG6D3HLJWN4PT3Q, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.550177956 (564h24m46.902963084s) [noise=true , address=45.91.116.12:4227 , piece_id=EATRY6TOO5YRZ65GIUR3RAMXTXV2CF7A25WYL7SCNQWCGG6CSYEA, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.550836501 (564h24m46.903621629s) [noise=true , address=45.91.116.4:4938 , piece_id=KOMX3BCHZCDJQA4QNUGBXIWS4GU2ES6NDQ4WQRGNO2WT4YNJWEBQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.551112509 (564h24m46.903897648s) [noise=true , address=45.91.116.6:4974 , piece_id=MS5U3CG36IYXCL4RDRT6IBOXFPY3NZGXDQNCOS6VTSZUYRTUPFEQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.551543077 (564h24m46.904328206s) [noise=true , address=45.91.116.11:4117 , piece_id=GHGK4RT6GZ6AJZ5LUDPXEZWKHIZXYB7FQXUZKHUKH2YS6VJE5VOQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.552051401 (564h24m46.90483653s) [noise=true , address=77.90.31.12:4589 , piece_id=OUUEV63FXNDH3YU4DEAZETWCFJCOQF73GY5AY4FTHPYKB4AJUDDA, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.552174573 (564h24m46.9049597s) [noise=true , address=77.90.31.19:4842 , piece_id=BZ6IANMEYTUSP653BRS5TPGWADXJXHLFFZ3WGYL7CYKYJY57XRJQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.553152988 (564h24m46.905938117s) [noise=true , address=77.90.31.13:4627 , piece_id=A4IN5FKSUYIQY2UCA6Z7FMK7K26AIW2TWSO5JP4HQCHL7UYGRHEQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.553551907 (564h24m46.906337035s) [noise=true , address=77.90.31.15:4699 , piece_id=L7YAK3GJJQFXUDZMWGVZEEGF7MJELC3TV75S4URLIFLUFN64PUVQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:41.370257580 (564h25m16.723042689s) [noise=true , address=145.79.227.16:4909 , piece_id=AMXY7BTB33XIPL55IHX55BY5JAUGM3QTFX5KUY5RDMKR7OYV3BLA, seg_pos={0 0}, upload=496714]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: rpc: dial tcp 145.79.227.16:4909: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:33:41.370302615 (564h25m16.723087723s) [noise=true , address=145.79.227.11:4730 , piece_id=A67FLQ5IWOE6DARJDATGMQPC7SIXMBYENKX6QBNV5RTLXILPKZOA, seg_pos={0 0}, upload=496714]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op Sep 22 02:33:41.370310058 (564h25m16.723095157s) [noise=true , address=145.79.227.3:4151 , piece_id=PIXQJLVSHRNFCXBREW4SDTREXDKL7MVBGNA46YD2SP2CGBCOE7HQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:33:41.370330697 (564h25m16.723115805s) [noise=true , address=145.79.227.18:4007 , piece_id=KGWD7UHWZCIIPU6HAR6Q47LPSSQ7SGYZRLU4XOCJW6T4WFZN6BCQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: rpc: dial tcp 145.79.227.18:4007: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:33:41.370348241 (564h25m16.72313334s) [seg_pos={0 0}, upload=496714]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 22 02:33:41.386894130 (564h25m16.739679238s) [upload=496714]: Done uploading segments... Sep 22 02:33:41.386903698 (564h25m16.739688797s) [upload=496714]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 582.03993ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [.........................X.XXXXXX..X........................] duration: 457.491286ms FAIL (2025-09-22 02:34:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 457.523707ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [.........................X.X.........X.......X...X.....X.XX.] duration: 866.676371ms FAIL (2025-09-22 02:34:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 866.701799ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [..........................X.X.........X.......X...X.....X.XX] duration: 30.0012094s FAIL (2025-09-22 02:34:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001226241s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 20 out of 60 is failed (threshold=3) [.......................XXX....XXX.XXXXX..X.XX.XX.XX......XX.] duration: 353.946335ms FAIL (2025-09-22 02:33:55 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 22 02:33:11.384426612 (564h24m46.73721175s) [upload=496714]: Starting upload Sep 22 02:33:11.384566675 (564h24m46.737351812s) [upload=496714]: Done starting upload Sep 22 02:33:11.384642446 (564h24m46.737427585s) [upload=496714]: Uploading segments... Sep 22 02:33:11.384975351 (564h24m46.737760479s) [upload=496714]: Got next segment. Inline: false Sep 22 02:33:11.385074347 (564h24m46.737859475s) [upload=496714]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:33:11.385081710 (564h24m46.737866839s) [upload=496714]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:33:11.406584783 (564h24m46.759369931s) [seg_pos={0 0}, upload=496714]: Begin upload segment... Sep 22 02:33:11.406646089 (564h24m46.759431227s) [seg_pos={0 0}, upload=496714]: Done begin upload segment. Sep 22 02:33:11.406665836 (564h24m46.759450963s) [noise=true , address=145.79.227.18:4007 , piece_id=KGWD7UHWZCIIPU6HAR6Q47LPSSQ7SGYZRLU4XOCJW6T4WFZN6BCQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.406677097 (564h24m46.759462225s) [noise=true , address=145.79.227.3:4151 , piece_id=PIXQJLVSHRNFCXBREW4SDTREXDKL7MVBGNA46YD2SP2CGBCOE7HQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.406818372 (564h24m46.75960351s) [noise=true , address=45.91.116.6:4974 , piece_id=MS5U3CG36IYXCL4RDRT6IBOXFPY3NZGXDQNCOS6VTSZUYRTUPFEQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.407443044 (564h24m46.760228181s) [noise=true , address=77.90.31.19:4842 , piece_id=BZ6IANMEYTUSP653BRS5TPGWADXJXHLFFZ3WGYL7CYKYJY57XRJQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.408091821 (564h24m46.760876949s) [noise=true , address=45.91.116.11:4117 , piece_id=GHGK4RT6GZ6AJZ5LUDPXEZWKHIZXYB7FQXUZKHUKH2YS6VJE5VOQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.408693110 (564h24m46.761478248s) [noise=true , address=45.91.116.10:4081 , piece_id=NFGJ4LOFNXYZZVE5A7GMT4VKB2JAPWOJ5OPBG3ZIHGHSLPATSWEA, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.409252640 (564h24m46.762037767s) [noise=true , address=77.90.31.19:4843 , piece_id=JSPMTDWLEH62YXHF5K7BJPKL4AYWYNTTRZWAW7VV55UEV7LKS3BA, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.409826727 (564h24m46.762611855s) [noise=true , address=77.90.31.12:4589 , piece_id=OUUEV63FXNDH3YU4DEAZETWCFJCOQF73GY5AY4FTHPYKB4AJUDDA, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.410411845 (564h24m46.763196983s) [noise=true , address=45.91.116.13:4153 , piece_id=Z7X53QODAQ7U2L4P42RLWNMSDRYJ3WYLJ77Y2TG6D3HLJWN4PT3Q, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.411023071 (564h24m46.76380821s) [noise=true , address=45.91.116.13:4154 , piece_id=3LWZ2AIHGNGCFAMF4HUIKALJTXWW7CBYE7PTVY2UT3HLNVBUKYGA, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.411609723 (564h24m46.764394861s) [noise=true , address=145.79.227.11:4730 , piece_id=A67FLQ5IWOE6DARJDATGMQPC7SIXMBYENKX6QBNV5RTLXILPKZOA, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.412208708 (564h24m46.764993845s) [noise=true , address=145.79.227.16:4909 , piece_id=AMXY7BTB33XIPL55IHX55BY5JAUGM3QTFX5KUY5RDMKR7OYV3BLA, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.412766834 (564h24m46.765551972s) [noise=true , address=45.91.116.4:4938 , piece_id=KOMX3BCHZCDJQA4QNUGBXIWS4GU2ES6NDQ4WQRGNO2WT4YNJWEBQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.413099869 (564h24m46.765885007s) [noise=true , address=45.91.116.12:4227 , piece_id=EATRY6TOO5YRZ65GIUR3RAMXTXV2CF7A25WYL7SCNQWCGG6CSYEA, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.414058568 (564h24m46.766843707s) [noise=true , address=77.90.31.15:4699 , piece_id=L7YAK3GJJQFXUDZMWGVZEEGF7MJELC3TV75S4URLIFLUFN64PUVQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.416328989 (564h24m46.769114117s) [noise=true , address=77.90.31.13:4627 , piece_id=A4IN5FKSUYIQY2UCA6Z7FMK7K26AIW2TWSO5JP4HQCHL7UYGRHEQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.539317775 (564h24m46.892102893s) [upload=496714]: Next returned nil segment Sep 22 02:33:11.539331401 (564h24m46.892116519s) [upload=496714]: Waiting for error group managing segments... Sep 22 02:33:11.548881864 (564h24m46.901666992s) [noise=true , address=45.91.116.10:4081 , piece_id=NFGJ4LOFNXYZZVE5A7GMT4VKB2JAPWOJ5OPBG3ZIHGHSLPATSWEA, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.549065759 (564h24m46.901850887s) [noise=true , address=45.91.116.13:4154 , piece_id=3LWZ2AIHGNGCFAMF4HUIKALJTXWW7CBYE7PTVY2UT3HLNVBUKYGA, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.549577719 (564h24m46.902362847s) [noise=true , address=77.90.31.19:4843 , piece_id=JSPMTDWLEH62YXHF5K7BJPKL4AYWYNTTRZWAW7VV55UEV7LKS3BA, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.549997097 (564h24m46.902782225s) [noise=true , address=45.91.116.13:4153 , piece_id=Z7X53QODAQ7U2L4P42RLWNMSDRYJ3WYLJ77Y2TG6D3HLJWN4PT3Q, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.550177956 (564h24m46.902963084s) [noise=true , address=45.91.116.12:4227 , piece_id=EATRY6TOO5YRZ65GIUR3RAMXTXV2CF7A25WYL7SCNQWCGG6CSYEA, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.550836501 (564h24m46.903621629s) [noise=true , address=45.91.116.4:4938 , piece_id=KOMX3BCHZCDJQA4QNUGBXIWS4GU2ES6NDQ4WQRGNO2WT4YNJWEBQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.551112509 (564h24m46.903897648s) [noise=true , address=45.91.116.6:4974 , piece_id=MS5U3CG36IYXCL4RDRT6IBOXFPY3NZGXDQNCOS6VTSZUYRTUPFEQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.551543077 (564h24m46.904328206s) [noise=true , address=45.91.116.11:4117 , piece_id=GHGK4RT6GZ6AJZ5LUDPXEZWKHIZXYB7FQXUZKHUKH2YS6VJE5VOQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.552051401 (564h24m46.90483653s) [noise=true , address=77.90.31.12:4589 , piece_id=OUUEV63FXNDH3YU4DEAZETWCFJCOQF73GY5AY4FTHPYKB4AJUDDA, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.552174573 (564h24m46.9049597s) [noise=true , address=77.90.31.19:4842 , piece_id=BZ6IANMEYTUSP653BRS5TPGWADXJXHLFFZ3WGYL7CYKYJY57XRJQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.553152988 (564h24m46.905938117s) [noise=true , address=77.90.31.13:4627 , piece_id=A4IN5FKSUYIQY2UCA6Z7FMK7K26AIW2TWSO5JP4HQCHL7UYGRHEQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.553551907 (564h24m46.906337035s) [noise=true , address=77.90.31.15:4699 , piece_id=L7YAK3GJJQFXUDZMWGVZEEGF7MJELC3TV75S4URLIFLUFN64PUVQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:41.370257580 (564h25m16.723042689s) [noise=true , address=145.79.227.16:4909 , piece_id=AMXY7BTB33XIPL55IHX55BY5JAUGM3QTFX5KUY5RDMKR7OYV3BLA, seg_pos={0 0}, upload=496714]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: rpc: dial tcp 145.79.227.16:4909: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:33:41.370302615 (564h25m16.723087723s) [noise=true , address=145.79.227.11:4730 , piece_id=A67FLQ5IWOE6DARJDATGMQPC7SIXMBYENKX6QBNV5RTLXILPKZOA, seg_pos={0 0}, upload=496714]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op Sep 22 02:33:41.370310058 (564h25m16.723095157s) [noise=true , address=145.79.227.3:4151 , piece_id=PIXQJLVSHRNFCXBREW4SDTREXDKL7MVBGNA46YD2SP2CGBCOE7HQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:33:41.370330697 (564h25m16.723115805s) [noise=true , address=145.79.227.18:4007 , piece_id=KGWD7UHWZCIIPU6HAR6Q47LPSSQ7SGYZRLU4XOCJW6T4WFZN6BCQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: rpc: dial tcp 145.79.227.18:4007: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:33:41.370348241 (564h25m16.72313334s) [seg_pos={0 0}, upload=496714]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 22 02:33:41.386894130 (564h25m16.739679238s) [upload=496714]: Done uploading segments... Sep 22 02:33:41.386903698 (564h25m16.739688797s) [upload=496714]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 353.965751ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [..........................X.XXXXXX..X.......................] duration: 428.128824ms FAIL (2025-09-22 02:33:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 428.157538ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 20 out of 60 is failed (threshold=3) [........................XXX....XXX.XXXXX..X.XX.XX.XX......XX] duration: 30.017876575s FAIL (2025-09-22 02:33:41 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 22 02:33:11.384426612 (564h24m46.73721175s) [upload=496714]: Starting upload Sep 22 02:33:11.384566675 (564h24m46.737351812s) [upload=496714]: Done starting upload Sep 22 02:33:11.384642446 (564h24m46.737427585s) [upload=496714]: Uploading segments... Sep 22 02:33:11.384975351 (564h24m46.737760479s) [upload=496714]: Got next segment. Inline: false Sep 22 02:33:11.385074347 (564h24m46.737859475s) [upload=496714]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:33:11.385081710 (564h24m46.737866839s) [upload=496714]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:33:11.406584783 (564h24m46.759369931s) [seg_pos={0 0}, upload=496714]: Begin upload segment... Sep 22 02:33:11.406646089 (564h24m46.759431227s) [seg_pos={0 0}, upload=496714]: Done begin upload segment. Sep 22 02:33:11.406665836 (564h24m46.759450963s) [noise=true , address=145.79.227.18:4007 , piece_id=KGWD7UHWZCIIPU6HAR6Q47LPSSQ7SGYZRLU4XOCJW6T4WFZN6BCQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.406677097 (564h24m46.759462225s) [noise=true , address=145.79.227.3:4151 , piece_id=PIXQJLVSHRNFCXBREW4SDTREXDKL7MVBGNA46YD2SP2CGBCOE7HQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.406818372 (564h24m46.75960351s) [noise=true , address=45.91.116.6:4974 , piece_id=MS5U3CG36IYXCL4RDRT6IBOXFPY3NZGXDQNCOS6VTSZUYRTUPFEQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.407443044 (564h24m46.760228181s) [noise=true , address=77.90.31.19:4842 , piece_id=BZ6IANMEYTUSP653BRS5TPGWADXJXHLFFZ3WGYL7CYKYJY57XRJQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.408091821 (564h24m46.760876949s) [noise=true , address=45.91.116.11:4117 , piece_id=GHGK4RT6GZ6AJZ5LUDPXEZWKHIZXYB7FQXUZKHUKH2YS6VJE5VOQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.408693110 (564h24m46.761478248s) [noise=true , address=45.91.116.10:4081 , piece_id=NFGJ4LOFNXYZZVE5A7GMT4VKB2JAPWOJ5OPBG3ZIHGHSLPATSWEA, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.409252640 (564h24m46.762037767s) [noise=true , address=77.90.31.19:4843 , piece_id=JSPMTDWLEH62YXHF5K7BJPKL4AYWYNTTRZWAW7VV55UEV7LKS3BA, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.409826727 (564h24m46.762611855s) [noise=true , address=77.90.31.12:4589 , piece_id=OUUEV63FXNDH3YU4DEAZETWCFJCOQF73GY5AY4FTHPYKB4AJUDDA, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.410411845 (564h24m46.763196983s) [noise=true , address=45.91.116.13:4153 , piece_id=Z7X53QODAQ7U2L4P42RLWNMSDRYJ3WYLJ77Y2TG6D3HLJWN4PT3Q, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.411023071 (564h24m46.76380821s) [noise=true , address=45.91.116.13:4154 , piece_id=3LWZ2AIHGNGCFAMF4HUIKALJTXWW7CBYE7PTVY2UT3HLNVBUKYGA, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.411609723 (564h24m46.764394861s) [noise=true , address=145.79.227.11:4730 , piece_id=A67FLQ5IWOE6DARJDATGMQPC7SIXMBYENKX6QBNV5RTLXILPKZOA, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.412208708 (564h24m46.764993845s) [noise=true , address=145.79.227.16:4909 , piece_id=AMXY7BTB33XIPL55IHX55BY5JAUGM3QTFX5KUY5RDMKR7OYV3BLA, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.412766834 (564h24m46.765551972s) [noise=true , address=45.91.116.4:4938 , piece_id=KOMX3BCHZCDJQA4QNUGBXIWS4GU2ES6NDQ4WQRGNO2WT4YNJWEBQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.413099869 (564h24m46.765885007s) [noise=true , address=45.91.116.12:4227 , piece_id=EATRY6TOO5YRZ65GIUR3RAMXTXV2CF7A25WYL7SCNQWCGG6CSYEA, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.414058568 (564h24m46.766843707s) [noise=true , address=77.90.31.15:4699 , piece_id=L7YAK3GJJQFXUDZMWGVZEEGF7MJELC3TV75S4URLIFLUFN64PUVQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.416328989 (564h24m46.769114117s) [noise=true , address=77.90.31.13:4627 , piece_id=A4IN5FKSUYIQY2UCA6Z7FMK7K26AIW2TWSO5JP4HQCHL7UYGRHEQ, seg_pos={0 0}, upload=496714]: Uploading piece... Sep 22 02:33:11.539317775 (564h24m46.892102893s) [upload=496714]: Next returned nil segment Sep 22 02:33:11.539331401 (564h24m46.892116519s) [upload=496714]: Waiting for error group managing segments... Sep 22 02:33:11.548881864 (564h24m46.901666992s) [noise=true , address=45.91.116.10:4081 , piece_id=NFGJ4LOFNXYZZVE5A7GMT4VKB2JAPWOJ5OPBG3ZIHGHSLPATSWEA, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.549065759 (564h24m46.901850887s) [noise=true , address=45.91.116.13:4154 , piece_id=3LWZ2AIHGNGCFAMF4HUIKALJTXWW7CBYE7PTVY2UT3HLNVBUKYGA, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.549577719 (564h24m46.902362847s) [noise=true , address=77.90.31.19:4843 , piece_id=JSPMTDWLEH62YXHF5K7BJPKL4AYWYNTTRZWAW7VV55UEV7LKS3BA, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.549997097 (564h24m46.902782225s) [noise=true , address=45.91.116.13:4153 , piece_id=Z7X53QODAQ7U2L4P42RLWNMSDRYJ3WYLJ77Y2TG6D3HLJWN4PT3Q, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.550177956 (564h24m46.902963084s) [noise=true , address=45.91.116.12:4227 , piece_id=EATRY6TOO5YRZ65GIUR3RAMXTXV2CF7A25WYL7SCNQWCGG6CSYEA, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.550836501 (564h24m46.903621629s) [noise=true , address=45.91.116.4:4938 , piece_id=KOMX3BCHZCDJQA4QNUGBXIWS4GU2ES6NDQ4WQRGNO2WT4YNJWEBQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.551112509 (564h24m46.903897648s) [noise=true , address=45.91.116.6:4974 , piece_id=MS5U3CG36IYXCL4RDRT6IBOXFPY3NZGXDQNCOS6VTSZUYRTUPFEQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.551543077 (564h24m46.904328206s) [noise=true , address=45.91.116.11:4117 , piece_id=GHGK4RT6GZ6AJZ5LUDPXEZWKHIZXYB7FQXUZKHUKH2YS6VJE5VOQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.552051401 (564h24m46.90483653s) [noise=true , address=77.90.31.12:4589 , piece_id=OUUEV63FXNDH3YU4DEAZETWCFJCOQF73GY5AY4FTHPYKB4AJUDDA, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.552174573 (564h24m46.9049597s) [noise=true , address=77.90.31.19:4842 , piece_id=BZ6IANMEYTUSP653BRS5TPGWADXJXHLFFZ3WGYL7CYKYJY57XRJQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.553152988 (564h24m46.905938117s) [noise=true , address=77.90.31.13:4627 , piece_id=A4IN5FKSUYIQY2UCA6Z7FMK7K26AIW2TWSO5JP4HQCHL7UYGRHEQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:11.553551907 (564h24m46.906337035s) [noise=true , address=77.90.31.15:4699 , piece_id=L7YAK3GJJQFXUDZMWGVZEEGF7MJELC3TV75S4URLIFLUFN64PUVQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: <nil> Sep 22 02:33:41.370257580 (564h25m16.723042689s) [noise=true , address=145.79.227.16:4909 , piece_id=AMXY7BTB33XIPL55IHX55BY5JAUGM3QTFX5KUY5RDMKR7OYV3BLA, seg_pos={0 0}, upload=496714]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: rpc: dial tcp 145.79.227.16:4909: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:33:41.370302615 (564h25m16.723087723s) [noise=true , address=145.79.227.11:4730 , piece_id=A67FLQ5IWOE6DARJDATGMQPC7SIXMBYENKX6QBNV5RTLXILPKZOA, seg_pos={0 0}, upload=496714]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op Sep 22 02:33:41.370310058 (564h25m16.723095157s) [noise=true , address=145.79.227.3:4151 , piece_id=PIXQJLVSHRNFCXBREW4SDTREXDKL7MVBGNA46YD2SP2CGBCOE7HQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:33:41.370330697 (564h25m16.723115805s) [noise=true , address=145.79.227.18:4007 , piece_id=KGWD7UHWZCIIPU6HAR6Q47LPSSQ7SGYZRLU4XOCJW6T4WFZN6BCQ, seg_pos={0 0}, upload=496714]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: rpc: dial tcp 145.79.227.18:4007: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:33:41.370348241 (564h25m16.72313334s) [seg_pos={0 0}, upload=496714]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 22 02:33:41.386894130 (564h25m16.739679238s) [upload=496714]: Done uploading segments... Sep 22 02:33:41.386903698 (564h25m16.739688797s) [upload=496714]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.017895681s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [...........................X.X.........X.......X...X.....X.X] duration: 30.000427904s FAIL (2025-09-22 02:33:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000468399s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [...........................X.XXXXXX..X......................] duration: 493.208431ms FAIL (2025-09-22 02:33:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 493.241092ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 19 out of 60 is failed (threshold=3) [.........................XXX....XXX.XXXXX..X.XX.XX.XX......X] duration: 30.015603166s FAIL (2025-09-22 02:32:47 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 22 02:32:17.561001510 (564h23m52.913786638s) [upload=496704]: Starting upload Sep 22 02:32:17.561081721 (564h23m52.913866848s) [upload=496704]: Done starting upload Sep 22 02:32:17.561156601 (564h23m52.913941729s) [upload=496704]: Uploading segments... Sep 22 02:32:17.561439963 (564h23m52.914225092s) [upload=496704]: Got next segment. Inline: false Sep 22 02:32:17.561505175 (564h23m52.914290304s) [upload=496704]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:32:17.561510806 (564h23m52.914295945s) [upload=496704]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:32:17.584647795 (564h23m52.937432933s) [seg_pos={0 0}, upload=496704]: Begin upload segment... Sep 22 02:32:17.584683622 (564h23m52.93746875s) [seg_pos={0 0}, upload=496704]: Done begin upload segment. Sep 22 02:32:17.584709260 (564h23m52.937494388s) [noise=true , address=45.91.116.11:4118 , piece_id=WMKWUDXDE4WGA4ICQIYF2FAQLLUB6OZBKXLHB6VJ24DEQC5M2A6A, seg_pos={0 0}, upload=496704]: Uploading piece... Sep 22 02:32:17.584802105 (564h23m52.937587232s) [noise=true , address=145.79.227.15:4874 , piece_id=NUXCC7TI4V7BEKXWEEKMXAZIA54YLH2RDDFNNQH5CSB5OAXN2X6Q, seg_pos={0 0}, upload=496704]: Uploading piece... Sep 22 02:32:17.585255975 (564h23m52.938041104s) [noise=true , address=45.91.116.9:4261 , piece_id=HCTW4MILM5TRTHZD5IGSNRXJT2A6XKNMLANSPEG5C7JM4U5Z6OJA, seg_pos={0 0}, upload=496704]: Uploading piece... Sep 22 02:32:17.585264762 (564h23m52.9380499s) [noise=true , address=77.90.31.15:4698 , piece_id=ERPWOXFF5AZGCMV5JRQ7KN2IDYREPI2DN4RENVSR57DPQMCRXXLA, seg_pos={0 0}, upload=496704]: Uploading piece... Sep 22 02:32:17.585659043 (564h23m52.938444181s) [noise=true , address=45.91.116.5:4299 , piece_id=XINWOUV76XZDBRQJYF6Z4M6OUCHMAFCPAGVBQES3F6VKWDC3S3OA, seg_pos={0 0}, upload=496704]: Uploading piece... Sep 22 02:32:17.585756876 (564h23m52.938542004s) [noise=true , address=77.90.31.18:4806 , piece_id=GWWHOON3JS5O7OSGBLZIEIYAKM2BPPKQ3KQ7I6I5LOXLTX2OQ6NA, seg_pos={0 0}, upload=496704]: Uploading piece... Sep 22 02:32:17.586194006 (564h23m52.938979134s) [noise=true , address=77.90.31.18:4805 , piece_id=IHTZ4RSHD4PWYDULZ3QWESAANWDHCAEJSZLY2ORXMHK5IXOZWVEQ, seg_pos={0 0}, upload=496704]: Uploading piece... Sep 22 02:32:17.586472809 (564h23m52.939257947s) [noise=true , address=45.91.116.13:4154 , piece_id=IROXYH4LVZHUVOZHJJPHGI4HTRF6M6GU6UDW6KFH3DCGPDBNO4MQ, seg_pos={0 0}, upload=496704]: Uploading piece... Sep 22 02:32:17.586747896 (564h23m52.939533024s) [noise=true , address=45.91.116.13:4153 , piece_id=CEYOIB3MCU2TNXKC3QZEYTE7J3R2VX4ZZ2EX7YVMQEJXL7IHP3DQ, seg_pos={0 0}, upload=496704]: Uploading piece... Sep 22 02:32:17.586908046 (564h23m52.939693174s) [noise=true , address=45.91.116.5:4298 , piece_id=U3J7SSB6NDJSO57LM7THUER2E6RSNH3G4QA37FSJABLGATUGIKDQ, seg_pos={0 0}, upload=496704]: Uploading piece... Sep 22 02:32:17.587295402 (564h23m52.940080531s) [noise=true , address=145.79.227.3:4151 , piece_id=EST7QVVR5Q7BLOKWATODZTWJZYQCSVPTW4JLVQ77DI73VVPLNT6Q, seg_pos={0 0}, upload=496704]: Uploading piece... Sep 22 02:32:17.587349303 (564h23m52.940134432s) [noise=true , address=45.91.116.11:4119 , piece_id=ENC577VIT6SDAWFCBU6BEDKTVX2KVNCCIMJB26L6Z57VOK75NV4Q, seg_pos={0 0}, upload=496704]: Uploading piece... Sep 22 02:32:17.587747441 (564h23m52.940532569s) [noise=true , address=45.91.116.6:4973 , piece_id=Q46L5POKWHBXB2YOKF774XBNUAG6QSM6DAPWFMBA2MZLCZH46DLA, seg_pos={0 0}, upload=496704]: Uploading piece... Sep 22 02:32:17.587896090 (564h23m52.940681218s) [noise=true , address=145.79.227.14:4837 , piece_id=Y6JQW2ZYM333HN3XEGPGSPBUEUZHZMBR5YDSGLX47QQLVLEDWC2Q, seg_pos={0 0}, upload=496704]: Uploading piece... Sep 22 02:32:17.588164954 (564h23m52.940950083s) [noise=true , address=145.79.227.6:4258 , piece_id=VIHMN2WUEZTOR4MJ5Z2RTZKTHJYPJWA46RIQSZUGLZAGKO2HXFEA, seg_pos={0 0}, upload=496704]: Uploading piece... Sep 22 02:32:17.588558223 (564h23m52.941343351s) [noise=true , address=77.90.31.13:4626 , piece_id=G3TRUHNAHPS4KGYXXGGGWJDETXDMOVSRBIIXQNVF3QRGAYFB62QQ, seg_pos={0 0}, upload=496704]: Uploading piece... Sep 22 02:32:17.710478787 (564h23m53.063263915s) [upload=496704]: Next returned nil segment Sep 22 02:32:17.710516859 (564h23m53.063302036s) [upload=496704]: Waiting for error group managing segments... Sep 22 02:32:17.717844008 (564h23m53.070629135s) [noise=true , address=77.90.31.18:4806 , piece_id=GWWHOON3JS5O7OSGBLZIEIYAKM2BPPKQ3KQ7I6I5LOXLTX2OQ6NA, seg_pos={0 0}, upload=496704]: Done uploading piece. err: <nil> Sep 22 02:32:17.718309982 (564h23m53.071095111s) [noise=true , address=45.91.116.13:4154 , piece_id=IROXYH4LVZHUVOZHJJPHGI4HTRF6M6GU6UDW6KFH3DCGPDBNO4MQ, seg_pos={0 0}, upload=496704]: Done uploading piece. err: <nil> Sep 22 02:32:17.718941839 (564h23m53.071726977s) [noise=true , address=45.91.116.6:4973 , piece_id=Q46L5POKWHBXB2YOKF774XBNUAG6QSM6DAPWFMBA2MZLCZH46DLA, seg_pos={0 0}, upload=496704]: Done uploading piece. err: <nil> Sep 22 02:32:17.719279632 (564h23m53.07206476s) [noise=true , address=45.91.116.13:4153 , piece_id=CEYOIB3MCU2TNXKC3QZEYTE7J3R2VX4ZZ2EX7YVMQEJXL7IHP3DQ, seg_pos={0 0}, upload=496704]: Done uploading piece. err: <nil> Sep 22 02:32:17.719974626 (564h23m53.072759765s) [noise=true , address=45.91.116.5:4299 , piece_id=XINWOUV76XZDBRQJYF6Z4M6OUCHMAFCPAGVBQES3F6VKWDC3S3OA, seg_pos={0 0}, upload=496704]: Done uploading piece. err: <nil> Sep 22 02:32:17.720238351 (564h23m53.073023479s) [noise=true , address=77.90.31.13:4626 , piece_id=G3TRUHNAHPS4KGYXXGGGWJDETXDMOVSRBIIXQNVF3QRGAYFB62QQ, seg_pos={0 0}, upload=496704]: Done uploading piece. err: <nil> Sep 22 02:32:17.720909020 (564h23m53.073694148s) [noise=true , address=77.90.31.18:4805 , piece_id=IHTZ4RSHD4PWYDULZ3QWESAANWDHCAEJSZLY2ORXMHK5IXOZWVEQ, seg_pos={0 0}, upload=496704]: Done uploading piece. err: <nil> Sep 22 02:32:17.721287840 (564h23m53.074072979s) [noise=true , address=45.91.116.11:4118 , piece_id=WMKWUDXDE4WGA4ICQIYF2FAQLLUB6OZBKXLHB6VJ24DEQC5M2A6A, seg_pos={0 0}, upload=496704]: Done uploading piece. err: <nil> Sep 22 02:32:17.721516660 (564h23m53.074301788s) [noise=true , address=45.91.116.11:4119 , piece_id=ENC577VIT6SDAWFCBU6BEDKTVX2KVNCCIMJB26L6Z57VOK75NV4Q, seg_pos={0 0}, upload=496704]: Done uploading piece. err: <nil> Sep 22 02:32:17.722109953 (564h23m53.074895082s) [noise=true , address=45.91.116.5:4298 , piece_id=U3J7SSB6NDJSO57LM7THUER2E6RSNH3G4QA37FSJABLGATUGIKDQ, seg_pos={0 0}, upload=496704]: Done uploading piece. err: <nil> Sep 22 02:32:17.722223106 (564h23m53.075008233s) [noise=true , address=45.91.116.9:4261 , piece_id=HCTW4MILM5TRTHZD5IGSNRXJT2A6XKNMLANSPEG5C7JM4U5Z6OJA, seg_pos={0 0}, upload=496704]: Done uploading piece. err: <nil> Sep 22 02:32:17.722752550 (564h23m53.075537677s) [noise=true , address=77.90.31.15:4698 , piece_id=ERPWOXFF5AZGCMV5JRQ7KN2IDYREPI2DN4RENVSR57DPQMCRXXLA, seg_pos={0 0}, upload=496704]: Done uploading piece. err: <nil> Sep 22 02:32:47.546749030 (564h24m22.899534138s) [noise=true , address=145.79.227.15:4874 , piece_id=NUXCC7TI4V7BEKXWEEKMXAZIA54YLH2RDDFNNQH5CSB5OAXN2X6Q, seg_pos={0 0}, upload=496704]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:145.79.227.15:4874): protocol: context deadline exceeded; context deadline exceeded Sep 22 02:32:47.546912677 (564h24m22.899697785s) [noise=true , address=145.79.227.6:4258 , piece_id=VIHMN2WUEZTOR4MJ5Z2RTZKTHJYPJWA46RIQSZUGLZAGKO2HXFEA, seg_pos={0 0}, upload=496704]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: rpc: dial tcp 145.79.227.6:4258: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:32:47.546917767 (564h24m22.899702895s) [noise=true , address=145.79.227.3:4151 , piece_id=EST7QVVR5Q7BLOKWATODZTWJZYQCSVPTW4JLVQ77DI73VVPLNT6Q, seg_pos={0 0}, upload=496704]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op Sep 22 02:32:47.547021642 (564h24m22.899806739s) [noise=true , address=145.79.227.14:4837 , piece_id=Y6JQW2ZYM333HN3XEGPGSPBUEUZHZMBR5YDSGLX47QQLVLEDWC2Q, seg_pos={0 0}, upload=496704]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: rpc: dial tcp 145.79.227.14:4837: i/o timeout; context deadline exceeded Sep 22 02:32:47.547046027 (564h24m22.899831125s) [seg_pos={0 0}, upload=496704]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 22 02:32:47.561195069 (564h24m22.913980168s) [upload=496704]: Done uploading segments... Sep 22 02:32:47.561207363 (564h24m22.913992461s) [upload=496704]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.015623185s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [............................X.XXXXXX..X.....................] duration: 429.773441ms FAIL (2025-09-22 02:32:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 429.802385ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [............................X.X.........X.......X...X.....X.] duration: 435.985146ms FAIL (2025-09-22 02:32:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 436.101655ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [.............................X.X.........X.......X...X.....X] duration: 30.000995147s FAIL (2025-09-22 02:32:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001014795s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [.............................X.XXXXXX..X....................] duration: 366.796008ms FAIL (2025-09-22 02:31:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 366.837207ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 18 out of 60 is failed (threshold=3) [..........................XXX....XXX.XXXXX..X.XX.XX.XX......] duration: 371.380602ms FAIL (2025-09-22 02:31:31 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 22 02:26:47.079589262 (564h18m22.43237436s) [upload=496619]: Starting upload Sep 22 02:26:47.079635679 (564h18m22.432420787s) [upload=496619]: Done starting upload Sep 22 02:26:47.079683168 (564h18m22.432468266s) [upload=496619]: Uploading segments... Sep 22 02:26:47.079847085 (564h18m22.432632184s) [upload=496619]: Got next segment. Inline: false Sep 22 02:26:47.079880538 (564h18m22.432665637s) [upload=496619]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:26:47.079884426 (564h18m22.432669524s) [upload=496619]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:26:47.098941027 (564h18m22.451726136s) [seg_pos={0 0}, upload=496619]: Begin upload segment... Sep 22 02:26:47.098967026 (564h18m22.451752124s) [seg_pos={0 0}, upload=496619]: Done begin upload segment. Sep 22 02:26:47.098988436 (564h18m22.451773544s) [noise=true , address=45.91.116.13:4153 , piece_id=KEVDRJJG3U53XZ42Y2N6JHAAWCI55B2LOTVXLTOLFRA7KLSIH6OA, seg_pos={0 0}, upload=496619]: Uploading piece... Sep 22 02:26:47.099011058 (564h18m22.451796166s) [noise=true , address=145.79.227.2:4114 , piece_id=RIGKONJTORRHSKCZYTY5RHRKRWZG3ZPJLNP6MNFJENKINXUA3V7A, seg_pos={0 0}, upload=496619]: Uploading piece... Sep 22 02:26:47.099264234 (564h18m22.452049342s) [noise=true , address=45.91.116.9:4261 , piece_id=T36MVEHIYIU6GT23PS635SUF2K6OOU7JCSVKJ4TT6L43JEJV5CQA, seg_pos={0 0}, upload=496619]: Uploading piece... Sep 22 02:26:47.099278360 (564h18m22.452063468s) [noise=true , address=145.79.227.19:4078 , piece_id=RDISZTZGXWT6C63QJ5A6ISV6YLTWMGFK43AZ37UN6TH7FB6IADUA, seg_pos={0 0}, upload=496619]: Uploading piece... Sep 22 02:26:47.099503983 (564h18m22.452289081s) [noise=true , address=77.90.31.13:4626 , piece_id=NFHSBU7BRIFCYUOSOMPTJBUCJ5NBDHTRVJOET4W5IATUT6TMOYLA, seg_pos={0 0}, upload=496619]: Uploading piece... Sep 22 02:26:47.099518230 (564h18m22.452303338s) [noise=true , address=145.79.227.6:4259 , piece_id=BBTEHIIGU2C7CTREQ7LF6GAIP66LMPQWS3CNHP5STLNOHSHRSALA, seg_pos={0 0}, upload=496619]: Uploading piece... Sep 22 02:26:47.099716462 (564h18m22.452501561s) [noise=true , address=145.79.227.13:4804 , piece_id=TBHQSYEJUGV2XWHJIIPRWAYCLCMNKE7RKTPQY5PHDKNQJ5E5DA4A, seg_pos={0 0}, upload=496619]: Uploading piece... Sep 22 02:26:47.099730319 (564h18m22.452515417s) [noise=true , address=77.90.31.17:4771 , piece_id=MKFA2NQ6VFYBSYCYOQH7ILEZPYJ22CF3QGLQ5IMJYAPUXCAXQHUA, seg_pos={0 0}, upload=496619]: Uploading piece... Sep 22 02:26:47.099964939 (564h18m22.452750047s) [noise=true , address=77.90.31.21:4878 , piece_id=64AOV3HKKUU6PCGD4SNDR3FVSGMTKKAMIV4JONEB5NIHQA2YJLIQ, seg_pos={0 0}, upload=496619]: Uploading piece... Sep 22 02:26:47.099968655 (564h18m22.452753754s) [noise=true , address=77.90.31.17:4770 , piece_id=RFZW4THLK3KTDNFJ25M3MXF2F3LD73APWI5EMZKBKIMQ72W6M65A, seg_pos={0 0}, upload=496619]: Uploading piece... Sep 22 02:26:47.100179582 (564h18m22.452964679s) [noise=true , address=45.91.116.8:4047 , piece_id=J4L2SJIV6VWR4O2VOH3PGNBPJIJG54QWRFKJAY72IWIL2UM3VBSA, seg_pos={0 0}, upload=496619]: Uploading piece... Sep 22 02:26:47.100184851 (564h18m22.452969949s) [noise=true , address=77.90.31.14:4663 , piece_id=BHXXI4OQDYIR2E7PDGLEUYTLX5LRICO7THFGBS3BE4BCOWOX5NCA, seg_pos={0 0}, upload=496619]: Uploading piece... Sep 22 02:26:47.100410064 (564h18m22.453195172s) [noise=true , address=77.90.31.15:4699 , piece_id=C25UYB5QNC7VOEDFN5TS26L424PTH7MQTESIQ4E24NLLHM35AABQ, seg_pos={0 0}, upload=496619]: Uploading piece... Sep 22 02:26:47.100477561 (564h18m22.453262669s) [noise=true , address=45.91.116.5:4297 , piece_id=YDYN4PVNPURJ6AHCQFVBTKVOLIZOIPKQYFJZ6GE2WR5TOEAW3IVQ, seg_pos={0 0}, upload=496619]: Uploading piece... Sep 22 02:26:47.100637391 (564h18m22.453422499s) [noise=true , address=45.91.116.4:4937 , piece_id=PL2JXVI6Q5A46PAIUGMJXRFQE4HYOPISL7KEE7CATBNLFABD75LQ, seg_pos={0 0}, upload=496619]: Uploading piece... Sep 22 02:26:47.100854929 (564h18m22.453640037s) [noise=true , address=45.91.116.6:4973 , piece_id=2KURM2DOGKAN3EDAZXIJDOPC6ACAE6GH7ORMQ45CV4TDN35DWE3Q, seg_pos={0 0}, upload=496619]: Uploading piece... Sep 22 02:26:47.179812078 (564h18m22.532597186s) [upload=496619]: Next returned nil segment Sep 22 02:26:47.179824220 (564h18m22.532609328s) [upload=496619]: Waiting for error group managing segments... Sep 22 02:26:47.189480151 (564h18m22.542265249s) [noise=true , address=45.91.116.5:4297 , piece_id=YDYN4PVNPURJ6AHCQFVBTKVOLIZOIPKQYFJZ6GE2WR5TOEAW3IVQ, seg_pos={0 0}, upload=496619]: Done uploading piece. err: <nil> Sep 22 02:26:47.189604965 (564h18m22.542390064s) [noise=true , address=77.90.31.21:4878 , piece_id=64AOV3HKKUU6PCGD4SNDR3FVSGMTKKAMIV4JONEB5NIHQA2YJLIQ, seg_pos={0 0}, upload=496619]: Done uploading piece. err: <nil> Sep 22 02:26:47.189887455 (564h18m22.542672553s) [noise=true , address=45.91.116.8:4047 , piece_id=J4L2SJIV6VWR4O2VOH3PGNBPJIJG54QWRFKJAY72IWIL2UM3VBSA, seg_pos={0 0}, upload=496619]: Done uploading piece. err: <nil> Sep 22 02:26:47.190226310 (564h18m22.543011409s) [noise=true , address=77.90.31.17:4770 , piece_id=RFZW4THLK3KTDNFJ25M3MXF2F3LD73APWI5EMZKBKIMQ72W6M65A, seg_pos={0 0}, upload=496619]: Done uploading piece. err: <nil> Sep 22 02:26:47.190460461 (564h18m22.543245559s) [noise=true , address=45.91.116.6:4973 , piece_id=2KURM2DOGKAN3EDAZXIJDOPC6ACAE6GH7ORMQ45CV4TDN35DWE3Q, seg_pos={0 0}, upload=496619]: Done uploading piece. err: <nil> Sep 22 02:26:47.191343909 (564h18m22.544129007s) [noise=true , address=45.91.116.9:4261 , piece_id=T36MVEHIYIU6GT23PS635SUF2K6OOU7JCSVKJ4TT6L43JEJV5CQA, seg_pos={0 0}, upload=496619]: Done uploading piece. err: <nil> Sep 22 02:26:47.191584671 (564h18m22.544369779s) [noise=true , address=77.90.31.13:4626 , piece_id=NFHSBU7BRIFCYUOSOMPTJBUCJ5NBDHTRVJOET4W5IATUT6TMOYLA, seg_pos={0 0}, upload=496619]: Done uploading piece. err: <nil> Sep 22 02:26:47.191710486 (564h18m22.544495584s) [noise=true , address=45.91.116.4:4937 , piece_id=PL2JXVI6Q5A46PAIUGMJXRFQE4HYOPISL7KEE7CATBNLFABD75LQ, seg_pos={0 0}, upload=496619]: Done uploading piece. err: <nil> Sep 22 02:26:47.192393257 (564h18m22.545178366s) [noise=true , address=77.90.31.17:4771 , piece_id=MKFA2NQ6VFYBSYCYOQH7ILEZPYJ22CF3QGLQ5IMJYAPUXCAXQHUA, seg_pos={0 0}, upload=496619]: Done uploading piece. err: <nil> Sep 22 02:26:47.192411743 (564h18m22.54519684s) [noise=true , address=77.90.31.14:4663 , piece_id=BHXXI4OQDYIR2E7PDGLEUYTLX5LRICO7THFGBS3BE4BCOWOX5NCA, seg_pos={0 0}, upload=496619]: Done uploading piece. err: <nil> Sep 22 02:26:47.192846608 (564h18m22.545631706s) [noise=true , address=45.91.116.13:4153 , piece_id=KEVDRJJG3U53XZ42Y2N6JHAAWCI55B2LOTVXLTOLFRA7KLSIH6OA, seg_pos={0 0}, upload=496619]: Done uploading piece. err: <nil> Sep 22 02:26:47.194370378 (564h18m22.547155486s) [noise=true , address=77.90.31.15:4699 , piece_id=C25UYB5QNC7VOEDFN5TS26L424PTH7MQTESIQ4E24NLLHM35AABQ, seg_pos={0 0}, upload=496619]: Done uploading piece. err: <nil> Sep 22 02:27:17.067340274 (564h18m52.420125392s) [noise=true , address=145.79.227.2:4114 , piece_id=RIGKONJTORRHSKCZYTY5RHRKRWZG3ZPJLNP6MNFJENKINXUA3V7A, seg_pos={0 0}, upload=496619]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:27:17.067382292 (564h18m52.420167421s) [noise=true , address=145.79.227.19:4078 , piece_id=RDISZTZGXWT6C63QJ5A6ISV6YLTWMGFK43AZ37UN6TH7FB6IADUA, seg_pos={0 0}, upload=496619]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:145.79.227.19:4078): protocol: context deadline exceeded; context deadline exceeded Sep 22 02:27:17.067415285 (564h18m52.420200412s) [noise=true , address=145.79.227.13:4804 , piece_id=TBHQSYEJUGV2XWHJIIPRWAYCLCMNKE7RKTPQY5PHDKNQJ5E5DA4A, seg_pos={0 0}, upload=496619]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:27:17.067426626 (564h18m52.420211754s) [noise=true , address=145.79.227.6:4259 , piece_id=BBTEHIIGU2C7CTREQ7LF6GAIP66LMPQWS3CNHP5STLNOHSHRSALA, seg_pos={0 0}, upload=496619]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: rpc: dial tcp 145.79.227.6:4259: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:27:17.067470808 (564h18m52.420255937s) [seg_pos={0 0}, upload=496619]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 22 02:27:17.079419761 (564h18m52.43220488s) [upload=496619]: Done uploading segments... Sep 22 02:27:17.079433988 (564h18m52.432219117s) [upload=496619]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 371.399617ms core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)