Orbiter History

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000954041s FAIL (2025-09-22 02:55:40 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 30.000974409s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 28 out of 60 is failed (threshold=3) [.XXX.XXXXX..X.XX.XX.XX......XX..X....XX.XXXX.XX..X...X......] duration: 470.389642ms FAIL (2025-09-22 02:55:37 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Sep 22 02:50:51.268997916 (564h42m26.621783024s) [upload=496974]: Starting upload Sep 22 02:50:51.269054642 (564h42m26.62183974s) [upload=496974]: Done starting upload Sep 22 02:50:51.269157625 (564h42m26.621942733s) [upload=496974]: Uploading segments... Sep 22 02:50:51.269282900 (564h42m26.622067998s) [upload=496974]: Got next segment. Inline: false Sep 22 02:50:51.269317225 (564h42m26.622102333s) [upload=496974]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:50:51.269320862 (564h42m26.622105959s) [upload=496974]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:50:51.293324496 (564h42m26.646109594s) [seg_pos={0 0}, upload=496974]: Begin upload segment... Sep 22 02:50:51.293358701 (564h42m26.646143799s) [seg_pos={0 0}, upload=496974]: Done begin upload segment. Sep 22 02:50:51.293373027 (564h42m26.646158135s) [noise=true , address=45.91.116.8:4047 , piece_id=PAMGMPEIDM24FMMTPHXIBLKTM7LARUR3EMVSSVURPR33KNXULREQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.293380561 (564h42m26.646165669s) [noise=true , address=145.79.227.2:4113 , piece_id=XP6CQ6MS55PDBL53D5N443C2EB5FXYIZFMNJF6ZH7YQEOC2AJH7Q, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.293708096 (564h42m26.646493194s) [noise=true , address=45.91.116.6:4975 , piece_id=NKBANVG4EAZEB44IYJRKJ36GJYXXBVIN7DVNKTY4O4MQLT2RK6OQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.293797443 (564h42m26.646582542s) [noise=true , address=145.79.227.15:4874 , piece_id=6AEPQHAL33H4VGZZHYBSQWFS2XOEQE23HGBLSZRHVBUTG64KLX7A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294062983 (564h42m26.646848091s) [noise=true , address=45.91.116.11:4118 , piece_id=QCJ5B5F2BBJAADD3XZ4VQCA67BKOKC77GWIUXLWGWFFVJAJTQLNQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294317470 (564h42m26.647102578s) [noise=true , address=145.79.227.11:4729 , piece_id=7YMPN37CDYMMUQBPG32X72CFL252TJUGEPEMHVJ25AOKBXQ7YCKQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294554444 (564h42m26.647339552s) [noise=true , address=145.79.227.5:4223 , piece_id=QDJOR4KBU74KQBL3IAUKTZMCWE5VX6HXKI5IIBAFLM6MNVWVXT6A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294767033 (564h42m26.647552141s) [noise=true , address=77.90.31.11:4553 , piece_id=3HZSIJ7QI6HQOWRTSL57LAYEEE6PRVEZPIVB6O6FL273FJO5OF5Q, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.295156915 (564h42m26.647942023s) [noise=true , address=45.91.116.12:4225 , piece_id=LNKVKQH24CDG4RSKYTZCGHAKA6I2VIZP232WYRRO6YIXK3JQ3CKA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.295396825 (564h42m26.648181923s) [noise=true , address=145.79.227.16:4911 , piece_id=NNXWBIWEYV62YXWNVNHU5X3K2FRCOLIHSLHX3TRSMSDZWZJP5KAA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.295773862 (564h42m26.64855896s) [noise=true , address=77.90.31.19:4842 , piece_id=EBAFUIGTOR5XIIROSTK6IY7SR7A3RH6WAP3Z5LBALDOKPJ45OC7A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296023902 (564h42m26.648809s) [noise=true , address=77.90.31.13:4628 , piece_id=QXLD6K3FVAV4MS4UPRUJHFIDJPFA25MK7LFYNQHAALITYC7HXHVA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296248182 (564h42m26.649033291s) [noise=true , address=77.90.31.12:4592 , piece_id=2WB4NPAFIKBYB5HFVEKW46VIGUSHHXGMHPXPLLJN2W6NDXLEW53Q, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296648865 (564h42m26.649433962s) [noise=true , address=45.91.116.9:4263 , piece_id=UVJC2F4DCJUQ6W3MVTCZDPUSYGGHPLMI563GOM4G2ONUDIGKXIBA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296917749 (564h42m26.649702867s) [noise=true , address=77.90.31.17:4772 , piece_id=4MKBTSQXAQVHCDF2WTWGSYC4KDFRENIRMG2J3E2X3Q5CRB5QV34A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.297394384 (564h42m26.650179502s) [noise=true , address=145.79.227.4:4187 , piece_id=JBXUEGJEZGCWYPYW2AEHFBH6PHXPCNRBYB52LUOFKKINLTQ5KXSA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.406323968 (564h42m26.759109086s) [upload=496974]: Next returned nil segment Sep 22 02:50:51.406339777 (564h42m26.759124896s) [upload=496974]: Waiting for error group managing segments... Sep 22 02:50:51.415462687 (564h42m26.768247786s) [noise=true , address=77.90.31.17:4772 , piece_id=4MKBTSQXAQVHCDF2WTWGSYC4KDFRENIRMG2J3E2X3Q5CRB5QV34A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416018330 (564h42m26.768803428s) [noise=true , address=45.91.116.12:4225 , piece_id=LNKVKQH24CDG4RSKYTZCGHAKA6I2VIZP232WYRRO6YIXK3JQ3CKA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416381793 (564h42m26.769166901s) [noise=true , address=45.91.116.11:4118 , piece_id=QCJ5B5F2BBJAADD3XZ4VQCA67BKOKC77GWIUXLWGWFFVJAJTQLNQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416638223 (564h42m26.769423342s) [noise=true , address=45.91.116.8:4047 , piece_id=PAMGMPEIDM24FMMTPHXIBLKTM7LARUR3EMVSSVURPR33KNXULREQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416754572 (564h42m26.76953968s) [noise=true , address=45.91.116.6:4975 , piece_id=NKBANVG4EAZEB44IYJRKJ36GJYXXBVIN7DVNKTY4O4MQLT2RK6OQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.417408329 (564h42m26.770193447s) [noise=true , address=45.91.116.9:4263 , piece_id=UVJC2F4DCJUQ6W3MVTCZDPUSYGGHPLMI563GOM4G2ONUDIGKXIBA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.418054872 (564h42m26.77083998s) [noise=true , address=77.90.31.19:4842 , piece_id=EBAFUIGTOR5XIIROSTK6IY7SR7A3RH6WAP3Z5LBALDOKPJ45OC7A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.418414527 (564h42m26.771199635s) [noise=true , address=77.90.31.11:4553 , piece_id=3HZSIJ7QI6HQOWRTSL57LAYEEE6PRVEZPIVB6O6FL273FJO5OF5Q, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.418776847 (564h42m26.771561944s) [noise=true , address=77.90.31.13:4628 , piece_id=QXLD6K3FVAV4MS4UPRUJHFIDJPFA25MK7LFYNQHAALITYC7HXHVA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.419130170 (564h42m26.771915268s) [noise=true , address=77.90.31.12:4592 , piece_id=2WB4NPAFIKBYB5HFVEKW46VIGUSHHXGMHPXPLLJN2W6NDXLEW53Q, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:51:21.257406930 (564h42m56.610192058s) [noise=true , address=145.79.227.5:4223 , piece_id=QDJOR4KBU74KQBL3IAUKTZMCWE5VX6HXKI5IIBAFLM6MNVWVXT6A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: rpc: dial tcp 145.79.227.5:4223: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257604651 (564h42m56.610389779s) [noise=true , address=145.79.227.2:4113 , piece_id=XP6CQ6MS55PDBL53D5N443C2EB5FXYIZFMNJF6ZH7YQEOC2AJH7Q, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: context deadline exceeded; context deadline exceeded Sep 22 02:51:21.257687526 (564h42m56.610472655s) [noise=true , address=145.79.227.16:4911 , piece_id=NNXWBIWEYV62YXWNVNHU5X3K2FRCOLIHSLHX3TRSMSDZWZJP5KAA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257735567 (564h42m56.610520694s) [noise=true , address=145.79.227.11:4729 , piece_id=7YMPN37CDYMMUQBPG32X72CFL252TJUGEPEMHVJ25AOKBXQ7YCKQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: rpc: dial tcp 145.79.227.11:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257752248 (564h42m56.610537376s) [noise=true , address=145.79.227.15:4874 , piece_id=6AEPQHAL33H4VGZZHYBSQWFS2XOEQE23HGBLSZRHVBUTG64KLX7A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:145.79.227.15:4874): protocol: rpc: dial tcp 145.79.227.15:4874: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257795389 (564h42m56.610580527s) [noise=true , address=145.79.227.4:4187 , piece_id=JBXUEGJEZGCWYPYW2AEHFBH6PHXPCNRBYB52LUOFKKINLTQ5KXSA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: rpc: dial tcp 145.79.227.4:4187: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257831697 (564h42m56.610616825s) [seg_pos={0 0}, upload=496974]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 22 02:51:21.277589665 (564h42m56.630374793s) [upload=496974]: Done uploading segments... Sep 22 02:51:21.277606296 (564h42m56.630391424s) [upload=496974]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 470.416482ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [X..X........................................................] duration: 364.451951ms FAIL (2025-09-22 02:55:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 364.470035ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [X.X.........X.......X...X.....X.XX..XX..X.........X...X.....] duration: 743.716569ms FAIL (2025-09-22 02:55:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 743.735073ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [.X.X.........X.......X...X.....X.XX..XX..X.........X...X....] duration: 402.609796ms FAIL (2025-09-22 02:54:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 402.632137ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 3 out of 60 is failed (threshold=3) [XX..X.......................................................] duration: 369.748422ms FAIL (2025-09-22 02:54:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 369.771265ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 28 out of 60 is failed (threshold=3) [..XXX.XXXXX..X.XX.XX.XX......XX..X....XX.XXXX.XX..X...X.....] duration: 577.297231ms FAIL (2025-09-22 02:54:30 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Sep 22 02:50:51.268997916 (564h42m26.621783024s) [upload=496974]: Starting upload Sep 22 02:50:51.269054642 (564h42m26.62183974s) [upload=496974]: Done starting upload Sep 22 02:50:51.269157625 (564h42m26.621942733s) [upload=496974]: Uploading segments... Sep 22 02:50:51.269282900 (564h42m26.622067998s) [upload=496974]: Got next segment. Inline: false Sep 22 02:50:51.269317225 (564h42m26.622102333s) [upload=496974]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:50:51.269320862 (564h42m26.622105959s) [upload=496974]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:50:51.293324496 (564h42m26.646109594s) [seg_pos={0 0}, upload=496974]: Begin upload segment... Sep 22 02:50:51.293358701 (564h42m26.646143799s) [seg_pos={0 0}, upload=496974]: Done begin upload segment. Sep 22 02:50:51.293373027 (564h42m26.646158135s) [noise=true , address=45.91.116.8:4047 , piece_id=PAMGMPEIDM24FMMTPHXIBLKTM7LARUR3EMVSSVURPR33KNXULREQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.293380561 (564h42m26.646165669s) [noise=true , address=145.79.227.2:4113 , piece_id=XP6CQ6MS55PDBL53D5N443C2EB5FXYIZFMNJF6ZH7YQEOC2AJH7Q, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.293708096 (564h42m26.646493194s) [noise=true , address=45.91.116.6:4975 , piece_id=NKBANVG4EAZEB44IYJRKJ36GJYXXBVIN7DVNKTY4O4MQLT2RK6OQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.293797443 (564h42m26.646582542s) [noise=true , address=145.79.227.15:4874 , piece_id=6AEPQHAL33H4VGZZHYBSQWFS2XOEQE23HGBLSZRHVBUTG64KLX7A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294062983 (564h42m26.646848091s) [noise=true , address=45.91.116.11:4118 , piece_id=QCJ5B5F2BBJAADD3XZ4VQCA67BKOKC77GWIUXLWGWFFVJAJTQLNQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294317470 (564h42m26.647102578s) [noise=true , address=145.79.227.11:4729 , piece_id=7YMPN37CDYMMUQBPG32X72CFL252TJUGEPEMHVJ25AOKBXQ7YCKQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294554444 (564h42m26.647339552s) [noise=true , address=145.79.227.5:4223 , piece_id=QDJOR4KBU74KQBL3IAUKTZMCWE5VX6HXKI5IIBAFLM6MNVWVXT6A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294767033 (564h42m26.647552141s) [noise=true , address=77.90.31.11:4553 , piece_id=3HZSIJ7QI6HQOWRTSL57LAYEEE6PRVEZPIVB6O6FL273FJO5OF5Q, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.295156915 (564h42m26.647942023s) [noise=true , address=45.91.116.12:4225 , piece_id=LNKVKQH24CDG4RSKYTZCGHAKA6I2VIZP232WYRRO6YIXK3JQ3CKA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.295396825 (564h42m26.648181923s) [noise=true , address=145.79.227.16:4911 , piece_id=NNXWBIWEYV62YXWNVNHU5X3K2FRCOLIHSLHX3TRSMSDZWZJP5KAA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.295773862 (564h42m26.64855896s) [noise=true , address=77.90.31.19:4842 , piece_id=EBAFUIGTOR5XIIROSTK6IY7SR7A3RH6WAP3Z5LBALDOKPJ45OC7A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296023902 (564h42m26.648809s) [noise=true , address=77.90.31.13:4628 , piece_id=QXLD6K3FVAV4MS4UPRUJHFIDJPFA25MK7LFYNQHAALITYC7HXHVA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296248182 (564h42m26.649033291s) [noise=true , address=77.90.31.12:4592 , piece_id=2WB4NPAFIKBYB5HFVEKW46VIGUSHHXGMHPXPLLJN2W6NDXLEW53Q, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296648865 (564h42m26.649433962s) [noise=true , address=45.91.116.9:4263 , piece_id=UVJC2F4DCJUQ6W3MVTCZDPUSYGGHPLMI563GOM4G2ONUDIGKXIBA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296917749 (564h42m26.649702867s) [noise=true , address=77.90.31.17:4772 , piece_id=4MKBTSQXAQVHCDF2WTWGSYC4KDFRENIRMG2J3E2X3Q5CRB5QV34A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.297394384 (564h42m26.650179502s) [noise=true , address=145.79.227.4:4187 , piece_id=JBXUEGJEZGCWYPYW2AEHFBH6PHXPCNRBYB52LUOFKKINLTQ5KXSA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.406323968 (564h42m26.759109086s) [upload=496974]: Next returned nil segment Sep 22 02:50:51.406339777 (564h42m26.759124896s) [upload=496974]: Waiting for error group managing segments... Sep 22 02:50:51.415462687 (564h42m26.768247786s) [noise=true , address=77.90.31.17:4772 , piece_id=4MKBTSQXAQVHCDF2WTWGSYC4KDFRENIRMG2J3E2X3Q5CRB5QV34A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416018330 (564h42m26.768803428s) [noise=true , address=45.91.116.12:4225 , piece_id=LNKVKQH24CDG4RSKYTZCGHAKA6I2VIZP232WYRRO6YIXK3JQ3CKA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416381793 (564h42m26.769166901s) [noise=true , address=45.91.116.11:4118 , piece_id=QCJ5B5F2BBJAADD3XZ4VQCA67BKOKC77GWIUXLWGWFFVJAJTQLNQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416638223 (564h42m26.769423342s) [noise=true , address=45.91.116.8:4047 , piece_id=PAMGMPEIDM24FMMTPHXIBLKTM7LARUR3EMVSSVURPR33KNXULREQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416754572 (564h42m26.76953968s) [noise=true , address=45.91.116.6:4975 , piece_id=NKBANVG4EAZEB44IYJRKJ36GJYXXBVIN7DVNKTY4O4MQLT2RK6OQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.417408329 (564h42m26.770193447s) [noise=true , address=45.91.116.9:4263 , piece_id=UVJC2F4DCJUQ6W3MVTCZDPUSYGGHPLMI563GOM4G2ONUDIGKXIBA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.418054872 (564h42m26.77083998s) [noise=true , address=77.90.31.19:4842 , piece_id=EBAFUIGTOR5XIIROSTK6IY7SR7A3RH6WAP3Z5LBALDOKPJ45OC7A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.418414527 (564h42m26.771199635s) [noise=true , address=77.90.31.11:4553 , piece_id=3HZSIJ7QI6HQOWRTSL57LAYEEE6PRVEZPIVB6O6FL273FJO5OF5Q, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.418776847 (564h42m26.771561944s) [noise=true , address=77.90.31.13:4628 , piece_id=QXLD6K3FVAV4MS4UPRUJHFIDJPFA25MK7LFYNQHAALITYC7HXHVA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.419130170 (564h42m26.771915268s) [noise=true , address=77.90.31.12:4592 , piece_id=2WB4NPAFIKBYB5HFVEKW46VIGUSHHXGMHPXPLLJN2W6NDXLEW53Q, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:51:21.257406930 (564h42m56.610192058s) [noise=true , address=145.79.227.5:4223 , piece_id=QDJOR4KBU74KQBL3IAUKTZMCWE5VX6HXKI5IIBAFLM6MNVWVXT6A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: rpc: dial tcp 145.79.227.5:4223: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257604651 (564h42m56.610389779s) [noise=true , address=145.79.227.2:4113 , piece_id=XP6CQ6MS55PDBL53D5N443C2EB5FXYIZFMNJF6ZH7YQEOC2AJH7Q, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: context deadline exceeded; context deadline exceeded Sep 22 02:51:21.257687526 (564h42m56.610472655s) [noise=true , address=145.79.227.16:4911 , piece_id=NNXWBIWEYV62YXWNVNHU5X3K2FRCOLIHSLHX3TRSMSDZWZJP5KAA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257735567 (564h42m56.610520694s) [noise=true , address=145.79.227.11:4729 , piece_id=7YMPN37CDYMMUQBPG32X72CFL252TJUGEPEMHVJ25AOKBXQ7YCKQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: rpc: dial tcp 145.79.227.11:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257752248 (564h42m56.610537376s) [noise=true , address=145.79.227.15:4874 , piece_id=6AEPQHAL33H4VGZZHYBSQWFS2XOEQE23HGBLSZRHVBUTG64KLX7A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:145.79.227.15:4874): protocol: rpc: dial tcp 145.79.227.15:4874: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257795389 (564h42m56.610580527s) [noise=true , address=145.79.227.4:4187 , piece_id=JBXUEGJEZGCWYPYW2AEHFBH6PHXPCNRBYB52LUOFKKINLTQ5KXSA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: rpc: dial tcp 145.79.227.4:4187: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257831697 (564h42m56.610616825s) [seg_pos={0 0}, upload=496974]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 22 02:51:21.277589665 (564h42m56.630374793s) [upload=496974]: Done uploading segments... Sep 22 02:51:21.277606296 (564h42m56.630391424s) [upload=496974]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 577.317029ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 4 out of 60 is failed (threshold=3) [XXX..X......................................................] duration: 360.298427ms FAIL (2025-09-22 02:53:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 360.315089ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [..X.X.........X.......X...X.....X.XX..XX..X.........X...X...] duration: 391.062296ms FAIL (2025-09-22 02:53:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 391.087574ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 28 out of 60 is failed (threshold=3) [...XXX.XXXXX..X.XX.XX.XX......XX..X....XX.XXXX.XX..X...X....] duration: 453.369821ms FAIL (2025-09-22 02:53:23 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Sep 22 02:50:51.268997916 (564h42m26.621783024s) [upload=496974]: Starting upload Sep 22 02:50:51.269054642 (564h42m26.62183974s) [upload=496974]: Done starting upload Sep 22 02:50:51.269157625 (564h42m26.621942733s) [upload=496974]: Uploading segments... Sep 22 02:50:51.269282900 (564h42m26.622067998s) [upload=496974]: Got next segment. Inline: false Sep 22 02:50:51.269317225 (564h42m26.622102333s) [upload=496974]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:50:51.269320862 (564h42m26.622105959s) [upload=496974]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:50:51.293324496 (564h42m26.646109594s) [seg_pos={0 0}, upload=496974]: Begin upload segment... Sep 22 02:50:51.293358701 (564h42m26.646143799s) [seg_pos={0 0}, upload=496974]: Done begin upload segment. Sep 22 02:50:51.293373027 (564h42m26.646158135s) [noise=true , address=45.91.116.8:4047 , piece_id=PAMGMPEIDM24FMMTPHXIBLKTM7LARUR3EMVSSVURPR33KNXULREQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.293380561 (564h42m26.646165669s) [noise=true , address=145.79.227.2:4113 , piece_id=XP6CQ6MS55PDBL53D5N443C2EB5FXYIZFMNJF6ZH7YQEOC2AJH7Q, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.293708096 (564h42m26.646493194s) [noise=true , address=45.91.116.6:4975 , piece_id=NKBANVG4EAZEB44IYJRKJ36GJYXXBVIN7DVNKTY4O4MQLT2RK6OQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.293797443 (564h42m26.646582542s) [noise=true , address=145.79.227.15:4874 , piece_id=6AEPQHAL33H4VGZZHYBSQWFS2XOEQE23HGBLSZRHVBUTG64KLX7A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294062983 (564h42m26.646848091s) [noise=true , address=45.91.116.11:4118 , piece_id=QCJ5B5F2BBJAADD3XZ4VQCA67BKOKC77GWIUXLWGWFFVJAJTQLNQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294317470 (564h42m26.647102578s) [noise=true , address=145.79.227.11:4729 , piece_id=7YMPN37CDYMMUQBPG32X72CFL252TJUGEPEMHVJ25AOKBXQ7YCKQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294554444 (564h42m26.647339552s) [noise=true , address=145.79.227.5:4223 , piece_id=QDJOR4KBU74KQBL3IAUKTZMCWE5VX6HXKI5IIBAFLM6MNVWVXT6A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294767033 (564h42m26.647552141s) [noise=true , address=77.90.31.11:4553 , piece_id=3HZSIJ7QI6HQOWRTSL57LAYEEE6PRVEZPIVB6O6FL273FJO5OF5Q, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.295156915 (564h42m26.647942023s) [noise=true , address=45.91.116.12:4225 , piece_id=LNKVKQH24CDG4RSKYTZCGHAKA6I2VIZP232WYRRO6YIXK3JQ3CKA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.295396825 (564h42m26.648181923s) [noise=true , address=145.79.227.16:4911 , piece_id=NNXWBIWEYV62YXWNVNHU5X3K2FRCOLIHSLHX3TRSMSDZWZJP5KAA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.295773862 (564h42m26.64855896s) [noise=true , address=77.90.31.19:4842 , piece_id=EBAFUIGTOR5XIIROSTK6IY7SR7A3RH6WAP3Z5LBALDOKPJ45OC7A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296023902 (564h42m26.648809s) [noise=true , address=77.90.31.13:4628 , piece_id=QXLD6K3FVAV4MS4UPRUJHFIDJPFA25MK7LFYNQHAALITYC7HXHVA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296248182 (564h42m26.649033291s) [noise=true , address=77.90.31.12:4592 , piece_id=2WB4NPAFIKBYB5HFVEKW46VIGUSHHXGMHPXPLLJN2W6NDXLEW53Q, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296648865 (564h42m26.649433962s) [noise=true , address=45.91.116.9:4263 , piece_id=UVJC2F4DCJUQ6W3MVTCZDPUSYGGHPLMI563GOM4G2ONUDIGKXIBA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296917749 (564h42m26.649702867s) [noise=true , address=77.90.31.17:4772 , piece_id=4MKBTSQXAQVHCDF2WTWGSYC4KDFRENIRMG2J3E2X3Q5CRB5QV34A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.297394384 (564h42m26.650179502s) [noise=true , address=145.79.227.4:4187 , piece_id=JBXUEGJEZGCWYPYW2AEHFBH6PHXPCNRBYB52LUOFKKINLTQ5KXSA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.406323968 (564h42m26.759109086s) [upload=496974]: Next returned nil segment Sep 22 02:50:51.406339777 (564h42m26.759124896s) [upload=496974]: Waiting for error group managing segments... Sep 22 02:50:51.415462687 (564h42m26.768247786s) [noise=true , address=77.90.31.17:4772 , piece_id=4MKBTSQXAQVHCDF2WTWGSYC4KDFRENIRMG2J3E2X3Q5CRB5QV34A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416018330 (564h42m26.768803428s) [noise=true , address=45.91.116.12:4225 , piece_id=LNKVKQH24CDG4RSKYTZCGHAKA6I2VIZP232WYRRO6YIXK3JQ3CKA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416381793 (564h42m26.769166901s) [noise=true , address=45.91.116.11:4118 , piece_id=QCJ5B5F2BBJAADD3XZ4VQCA67BKOKC77GWIUXLWGWFFVJAJTQLNQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416638223 (564h42m26.769423342s) [noise=true , address=45.91.116.8:4047 , piece_id=PAMGMPEIDM24FMMTPHXIBLKTM7LARUR3EMVSSVURPR33KNXULREQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416754572 (564h42m26.76953968s) [noise=true , address=45.91.116.6:4975 , piece_id=NKBANVG4EAZEB44IYJRKJ36GJYXXBVIN7DVNKTY4O4MQLT2RK6OQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.417408329 (564h42m26.770193447s) [noise=true , address=45.91.116.9:4263 , piece_id=UVJC2F4DCJUQ6W3MVTCZDPUSYGGHPLMI563GOM4G2ONUDIGKXIBA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.418054872 (564h42m26.77083998s) [noise=true , address=77.90.31.19:4842 , piece_id=EBAFUIGTOR5XIIROSTK6IY7SR7A3RH6WAP3Z5LBALDOKPJ45OC7A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.418414527 (564h42m26.771199635s) [noise=true , address=77.90.31.11:4553 , piece_id=3HZSIJ7QI6HQOWRTSL57LAYEEE6PRVEZPIVB6O6FL273FJO5OF5Q, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.418776847 (564h42m26.771561944s) [noise=true , address=77.90.31.13:4628 , piece_id=QXLD6K3FVAV4MS4UPRUJHFIDJPFA25MK7LFYNQHAALITYC7HXHVA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.419130170 (564h42m26.771915268s) [noise=true , address=77.90.31.12:4592 , piece_id=2WB4NPAFIKBYB5HFVEKW46VIGUSHHXGMHPXPLLJN2W6NDXLEW53Q, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:51:21.257406930 (564h42m56.610192058s) [noise=true , address=145.79.227.5:4223 , piece_id=QDJOR4KBU74KQBL3IAUKTZMCWE5VX6HXKI5IIBAFLM6MNVWVXT6A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: rpc: dial tcp 145.79.227.5:4223: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257604651 (564h42m56.610389779s) [noise=true , address=145.79.227.2:4113 , piece_id=XP6CQ6MS55PDBL53D5N443C2EB5FXYIZFMNJF6ZH7YQEOC2AJH7Q, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: context deadline exceeded; context deadline exceeded Sep 22 02:51:21.257687526 (564h42m56.610472655s) [noise=true , address=145.79.227.16:4911 , piece_id=NNXWBIWEYV62YXWNVNHU5X3K2FRCOLIHSLHX3TRSMSDZWZJP5KAA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257735567 (564h42m56.610520694s) [noise=true , address=145.79.227.11:4729 , piece_id=7YMPN37CDYMMUQBPG32X72CFL252TJUGEPEMHVJ25AOKBXQ7YCKQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: rpc: dial tcp 145.79.227.11:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257752248 (564h42m56.610537376s) [noise=true , address=145.79.227.15:4874 , piece_id=6AEPQHAL33H4VGZZHYBSQWFS2XOEQE23HGBLSZRHVBUTG64KLX7A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:145.79.227.15:4874): protocol: rpc: dial tcp 145.79.227.15:4874: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257795389 (564h42m56.610580527s) [noise=true , address=145.79.227.4:4187 , piece_id=JBXUEGJEZGCWYPYW2AEHFBH6PHXPCNRBYB52LUOFKKINLTQ5KXSA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: rpc: dial tcp 145.79.227.4:4187: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257831697 (564h42m56.610616825s) [seg_pos={0 0}, upload=496974]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 22 02:51:21.277589665 (564h42m56.630374793s) [upload=496974]: Done uploading segments... Sep 22 02:51:21.277606296 (564h42m56.630391424s) [upload=496974]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 453.393826ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 5 out of 60 is failed (threshold=3) [XXXX..X.....................................................] duration: 496.693261ms FAIL (2025-09-22 02:53:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 496.712297ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 28 out of 60 is failed (threshold=3) [....XXX.XXXXX..X.XX.XX.XX......XX..X....XX.XXXX.XX..X...X...] duration: 364.859045ms FAIL (2025-09-22 02:52:47 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Sep 22 02:50:51.268997916 (564h42m26.621783024s) [upload=496974]: Starting upload Sep 22 02:50:51.269054642 (564h42m26.62183974s) [upload=496974]: Done starting upload Sep 22 02:50:51.269157625 (564h42m26.621942733s) [upload=496974]: Uploading segments... Sep 22 02:50:51.269282900 (564h42m26.622067998s) [upload=496974]: Got next segment. Inline: false Sep 22 02:50:51.269317225 (564h42m26.622102333s) [upload=496974]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:50:51.269320862 (564h42m26.622105959s) [upload=496974]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:50:51.293324496 (564h42m26.646109594s) [seg_pos={0 0}, upload=496974]: Begin upload segment... Sep 22 02:50:51.293358701 (564h42m26.646143799s) [seg_pos={0 0}, upload=496974]: Done begin upload segment. Sep 22 02:50:51.293373027 (564h42m26.646158135s) [noise=true , address=45.91.116.8:4047 , piece_id=PAMGMPEIDM24FMMTPHXIBLKTM7LARUR3EMVSSVURPR33KNXULREQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.293380561 (564h42m26.646165669s) [noise=true , address=145.79.227.2:4113 , piece_id=XP6CQ6MS55PDBL53D5N443C2EB5FXYIZFMNJF6ZH7YQEOC2AJH7Q, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.293708096 (564h42m26.646493194s) [noise=true , address=45.91.116.6:4975 , piece_id=NKBANVG4EAZEB44IYJRKJ36GJYXXBVIN7DVNKTY4O4MQLT2RK6OQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.293797443 (564h42m26.646582542s) [noise=true , address=145.79.227.15:4874 , piece_id=6AEPQHAL33H4VGZZHYBSQWFS2XOEQE23HGBLSZRHVBUTG64KLX7A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294062983 (564h42m26.646848091s) [noise=true , address=45.91.116.11:4118 , piece_id=QCJ5B5F2BBJAADD3XZ4VQCA67BKOKC77GWIUXLWGWFFVJAJTQLNQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294317470 (564h42m26.647102578s) [noise=true , address=145.79.227.11:4729 , piece_id=7YMPN37CDYMMUQBPG32X72CFL252TJUGEPEMHVJ25AOKBXQ7YCKQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294554444 (564h42m26.647339552s) [noise=true , address=145.79.227.5:4223 , piece_id=QDJOR4KBU74KQBL3IAUKTZMCWE5VX6HXKI5IIBAFLM6MNVWVXT6A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294767033 (564h42m26.647552141s) [noise=true , address=77.90.31.11:4553 , piece_id=3HZSIJ7QI6HQOWRTSL57LAYEEE6PRVEZPIVB6O6FL273FJO5OF5Q, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.295156915 (564h42m26.647942023s) [noise=true , address=45.91.116.12:4225 , piece_id=LNKVKQH24CDG4RSKYTZCGHAKA6I2VIZP232WYRRO6YIXK3JQ3CKA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.295396825 (564h42m26.648181923s) [noise=true , address=145.79.227.16:4911 , piece_id=NNXWBIWEYV62YXWNVNHU5X3K2FRCOLIHSLHX3TRSMSDZWZJP5KAA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.295773862 (564h42m26.64855896s) [noise=true , address=77.90.31.19:4842 , piece_id=EBAFUIGTOR5XIIROSTK6IY7SR7A3RH6WAP3Z5LBALDOKPJ45OC7A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296023902 (564h42m26.648809s) [noise=true , address=77.90.31.13:4628 , piece_id=QXLD6K3FVAV4MS4UPRUJHFIDJPFA25MK7LFYNQHAALITYC7HXHVA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296248182 (564h42m26.649033291s) [noise=true , address=77.90.31.12:4592 , piece_id=2WB4NPAFIKBYB5HFVEKW46VIGUSHHXGMHPXPLLJN2W6NDXLEW53Q, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296648865 (564h42m26.649433962s) [noise=true , address=45.91.116.9:4263 , piece_id=UVJC2F4DCJUQ6W3MVTCZDPUSYGGHPLMI563GOM4G2ONUDIGKXIBA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296917749 (564h42m26.649702867s) [noise=true , address=77.90.31.17:4772 , piece_id=4MKBTSQXAQVHCDF2WTWGSYC4KDFRENIRMG2J3E2X3Q5CRB5QV34A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.297394384 (564h42m26.650179502s) [noise=true , address=145.79.227.4:4187 , piece_id=JBXUEGJEZGCWYPYW2AEHFBH6PHXPCNRBYB52LUOFKKINLTQ5KXSA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.406323968 (564h42m26.759109086s) [upload=496974]: Next returned nil segment Sep 22 02:50:51.406339777 (564h42m26.759124896s) [upload=496974]: Waiting for error group managing segments... Sep 22 02:50:51.415462687 (564h42m26.768247786s) [noise=true , address=77.90.31.17:4772 , piece_id=4MKBTSQXAQVHCDF2WTWGSYC4KDFRENIRMG2J3E2X3Q5CRB5QV34A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416018330 (564h42m26.768803428s) [noise=true , address=45.91.116.12:4225 , piece_id=LNKVKQH24CDG4RSKYTZCGHAKA6I2VIZP232WYRRO6YIXK3JQ3CKA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416381793 (564h42m26.769166901s) [noise=true , address=45.91.116.11:4118 , piece_id=QCJ5B5F2BBJAADD3XZ4VQCA67BKOKC77GWIUXLWGWFFVJAJTQLNQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416638223 (564h42m26.769423342s) [noise=true , address=45.91.116.8:4047 , piece_id=PAMGMPEIDM24FMMTPHXIBLKTM7LARUR3EMVSSVURPR33KNXULREQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416754572 (564h42m26.76953968s) [noise=true , address=45.91.116.6:4975 , piece_id=NKBANVG4EAZEB44IYJRKJ36GJYXXBVIN7DVNKTY4O4MQLT2RK6OQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.417408329 (564h42m26.770193447s) [noise=true , address=45.91.116.9:4263 , piece_id=UVJC2F4DCJUQ6W3MVTCZDPUSYGGHPLMI563GOM4G2ONUDIGKXIBA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.418054872 (564h42m26.77083998s) [noise=true , address=77.90.31.19:4842 , piece_id=EBAFUIGTOR5XIIROSTK6IY7SR7A3RH6WAP3Z5LBALDOKPJ45OC7A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.418414527 (564h42m26.771199635s) [noise=true , address=77.90.31.11:4553 , piece_id=3HZSIJ7QI6HQOWRTSL57LAYEEE6PRVEZPIVB6O6FL273FJO5OF5Q, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.418776847 (564h42m26.771561944s) [noise=true , address=77.90.31.13:4628 , piece_id=QXLD6K3FVAV4MS4UPRUJHFIDJPFA25MK7LFYNQHAALITYC7HXHVA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.419130170 (564h42m26.771915268s) [noise=true , address=77.90.31.12:4592 , piece_id=2WB4NPAFIKBYB5HFVEKW46VIGUSHHXGMHPXPLLJN2W6NDXLEW53Q, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:51:21.257406930 (564h42m56.610192058s) [noise=true , address=145.79.227.5:4223 , piece_id=QDJOR4KBU74KQBL3IAUKTZMCWE5VX6HXKI5IIBAFLM6MNVWVXT6A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: rpc: dial tcp 145.79.227.5:4223: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257604651 (564h42m56.610389779s) [noise=true , address=145.79.227.2:4113 , piece_id=XP6CQ6MS55PDBL53D5N443C2EB5FXYIZFMNJF6ZH7YQEOC2AJH7Q, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: context deadline exceeded; context deadline exceeded Sep 22 02:51:21.257687526 (564h42m56.610472655s) [noise=true , address=145.79.227.16:4911 , piece_id=NNXWBIWEYV62YXWNVNHU5X3K2FRCOLIHSLHX3TRSMSDZWZJP5KAA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257735567 (564h42m56.610520694s) [noise=true , address=145.79.227.11:4729 , piece_id=7YMPN37CDYMMUQBPG32X72CFL252TJUGEPEMHVJ25AOKBXQ7YCKQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: rpc: dial tcp 145.79.227.11:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257752248 (564h42m56.610537376s) [noise=true , address=145.79.227.15:4874 , piece_id=6AEPQHAL33H4VGZZHYBSQWFS2XOEQE23HGBLSZRHVBUTG64KLX7A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:145.79.227.15:4874): protocol: rpc: dial tcp 145.79.227.15:4874: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257795389 (564h42m56.610580527s) [noise=true , address=145.79.227.4:4187 , piece_id=JBXUEGJEZGCWYPYW2AEHFBH6PHXPCNRBYB52LUOFKKINLTQ5KXSA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: rpc: dial tcp 145.79.227.4:4187: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257831697 (564h42m56.610616825s) [seg_pos={0 0}, upload=496974]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 22 02:51:21.277589665 (564h42m56.630374793s) [upload=496974]: Done uploading segments... Sep 22 02:51:21.277606296 (564h42m56.630391424s) [upload=496974]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 364.875926ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 6 out of 60 is failed (threshold=3) [XXXXX..X....................................................] duration: 592.201495ms FAIL (2025-09-22 02:52:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 592.221202ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [...X.X.........X.......X...X.....X.XX..XX..X.........X...X..] duration: 410.911355ms FAIL (2025-09-22 02:52:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 410.966981ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 7 out of 60 is failed (threshold=3) [XXXXXX..X...................................................] duration: 479.926556ms FAIL (2025-09-22 02:52:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 479.953056ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 7 out of 60 is failed (threshold=3) [.XXXXXX..X..................................................] duration: 400.946308ms FAIL (2025-09-22 02:51:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 400.965814ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 29 out of 60 is failed (threshold=3) [X....XXX.XXXXX..X.XX.XX.XX......XX..X....XX.XXXX.XX..X...X..] duration: 433.040243ms FAIL (2025-09-22 02:51:47 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Sep 22 02:50:51.268997916 (564h42m26.621783024s) [upload=496974]: Starting upload Sep 22 02:50:51.269054642 (564h42m26.62183974s) [upload=496974]: Done starting upload Sep 22 02:50:51.269157625 (564h42m26.621942733s) [upload=496974]: Uploading segments... Sep 22 02:50:51.269282900 (564h42m26.622067998s) [upload=496974]: Got next segment. Inline: false Sep 22 02:50:51.269317225 (564h42m26.622102333s) [upload=496974]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:50:51.269320862 (564h42m26.622105959s) [upload=496974]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:50:51.293324496 (564h42m26.646109594s) [seg_pos={0 0}, upload=496974]: Begin upload segment... Sep 22 02:50:51.293358701 (564h42m26.646143799s) [seg_pos={0 0}, upload=496974]: Done begin upload segment. Sep 22 02:50:51.293373027 (564h42m26.646158135s) [noise=true , address=45.91.116.8:4047 , piece_id=PAMGMPEIDM24FMMTPHXIBLKTM7LARUR3EMVSSVURPR33KNXULREQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.293380561 (564h42m26.646165669s) [noise=true , address=145.79.227.2:4113 , piece_id=XP6CQ6MS55PDBL53D5N443C2EB5FXYIZFMNJF6ZH7YQEOC2AJH7Q, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.293708096 (564h42m26.646493194s) [noise=true , address=45.91.116.6:4975 , piece_id=NKBANVG4EAZEB44IYJRKJ36GJYXXBVIN7DVNKTY4O4MQLT2RK6OQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.293797443 (564h42m26.646582542s) [noise=true , address=145.79.227.15:4874 , piece_id=6AEPQHAL33H4VGZZHYBSQWFS2XOEQE23HGBLSZRHVBUTG64KLX7A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294062983 (564h42m26.646848091s) [noise=true , address=45.91.116.11:4118 , piece_id=QCJ5B5F2BBJAADD3XZ4VQCA67BKOKC77GWIUXLWGWFFVJAJTQLNQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294317470 (564h42m26.647102578s) [noise=true , address=145.79.227.11:4729 , piece_id=7YMPN37CDYMMUQBPG32X72CFL252TJUGEPEMHVJ25AOKBXQ7YCKQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294554444 (564h42m26.647339552s) [noise=true , address=145.79.227.5:4223 , piece_id=QDJOR4KBU74KQBL3IAUKTZMCWE5VX6HXKI5IIBAFLM6MNVWVXT6A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294767033 (564h42m26.647552141s) [noise=true , address=77.90.31.11:4553 , piece_id=3HZSIJ7QI6HQOWRTSL57LAYEEE6PRVEZPIVB6O6FL273FJO5OF5Q, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.295156915 (564h42m26.647942023s) [noise=true , address=45.91.116.12:4225 , piece_id=LNKVKQH24CDG4RSKYTZCGHAKA6I2VIZP232WYRRO6YIXK3JQ3CKA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.295396825 (564h42m26.648181923s) [noise=true , address=145.79.227.16:4911 , piece_id=NNXWBIWEYV62YXWNVNHU5X3K2FRCOLIHSLHX3TRSMSDZWZJP5KAA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.295773862 (564h42m26.64855896s) [noise=true , address=77.90.31.19:4842 , piece_id=EBAFUIGTOR5XIIROSTK6IY7SR7A3RH6WAP3Z5LBALDOKPJ45OC7A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296023902 (564h42m26.648809s) [noise=true , address=77.90.31.13:4628 , piece_id=QXLD6K3FVAV4MS4UPRUJHFIDJPFA25MK7LFYNQHAALITYC7HXHVA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296248182 (564h42m26.649033291s) [noise=true , address=77.90.31.12:4592 , piece_id=2WB4NPAFIKBYB5HFVEKW46VIGUSHHXGMHPXPLLJN2W6NDXLEW53Q, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296648865 (564h42m26.649433962s) [noise=true , address=45.91.116.9:4263 , piece_id=UVJC2F4DCJUQ6W3MVTCZDPUSYGGHPLMI563GOM4G2ONUDIGKXIBA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296917749 (564h42m26.649702867s) [noise=true , address=77.90.31.17:4772 , piece_id=4MKBTSQXAQVHCDF2WTWGSYC4KDFRENIRMG2J3E2X3Q5CRB5QV34A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.297394384 (564h42m26.650179502s) [noise=true , address=145.79.227.4:4187 , piece_id=JBXUEGJEZGCWYPYW2AEHFBH6PHXPCNRBYB52LUOFKKINLTQ5KXSA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.406323968 (564h42m26.759109086s) [upload=496974]: Next returned nil segment Sep 22 02:50:51.406339777 (564h42m26.759124896s) [upload=496974]: Waiting for error group managing segments... Sep 22 02:50:51.415462687 (564h42m26.768247786s) [noise=true , address=77.90.31.17:4772 , piece_id=4MKBTSQXAQVHCDF2WTWGSYC4KDFRENIRMG2J3E2X3Q5CRB5QV34A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416018330 (564h42m26.768803428s) [noise=true , address=45.91.116.12:4225 , piece_id=LNKVKQH24CDG4RSKYTZCGHAKA6I2VIZP232WYRRO6YIXK3JQ3CKA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416381793 (564h42m26.769166901s) [noise=true , address=45.91.116.11:4118 , piece_id=QCJ5B5F2BBJAADD3XZ4VQCA67BKOKC77GWIUXLWGWFFVJAJTQLNQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416638223 (564h42m26.769423342s) [noise=true , address=45.91.116.8:4047 , piece_id=PAMGMPEIDM24FMMTPHXIBLKTM7LARUR3EMVSSVURPR33KNXULREQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416754572 (564h42m26.76953968s) [noise=true , address=45.91.116.6:4975 , piece_id=NKBANVG4EAZEB44IYJRKJ36GJYXXBVIN7DVNKTY4O4MQLT2RK6OQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.417408329 (564h42m26.770193447s) [noise=true , address=45.91.116.9:4263 , piece_id=UVJC2F4DCJUQ6W3MVTCZDPUSYGGHPLMI563GOM4G2ONUDIGKXIBA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.418054872 (564h42m26.77083998s) [noise=true , address=77.90.31.19:4842 , piece_id=EBAFUIGTOR5XIIROSTK6IY7SR7A3RH6WAP3Z5LBALDOKPJ45OC7A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.418414527 (564h42m26.771199635s) [noise=true , address=77.90.31.11:4553 , piece_id=3HZSIJ7QI6HQOWRTSL57LAYEEE6PRVEZPIVB6O6FL273FJO5OF5Q, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.418776847 (564h42m26.771561944s) [noise=true , address=77.90.31.13:4628 , piece_id=QXLD6K3FVAV4MS4UPRUJHFIDJPFA25MK7LFYNQHAALITYC7HXHVA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.419130170 (564h42m26.771915268s) [noise=true , address=77.90.31.12:4592 , piece_id=2WB4NPAFIKBYB5HFVEKW46VIGUSHHXGMHPXPLLJN2W6NDXLEW53Q, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:51:21.257406930 (564h42m56.610192058s) [noise=true , address=145.79.227.5:4223 , piece_id=QDJOR4KBU74KQBL3IAUKTZMCWE5VX6HXKI5IIBAFLM6MNVWVXT6A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: rpc: dial tcp 145.79.227.5:4223: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257604651 (564h42m56.610389779s) [noise=true , address=145.79.227.2:4113 , piece_id=XP6CQ6MS55PDBL53D5N443C2EB5FXYIZFMNJF6ZH7YQEOC2AJH7Q, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: context deadline exceeded; context deadline exceeded Sep 22 02:51:21.257687526 (564h42m56.610472655s) [noise=true , address=145.79.227.16:4911 , piece_id=NNXWBIWEYV62YXWNVNHU5X3K2FRCOLIHSLHX3TRSMSDZWZJP5KAA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257735567 (564h42m56.610520694s) [noise=true , address=145.79.227.11:4729 , piece_id=7YMPN37CDYMMUQBPG32X72CFL252TJUGEPEMHVJ25AOKBXQ7YCKQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: rpc: dial tcp 145.79.227.11:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257752248 (564h42m56.610537376s) [noise=true , address=145.79.227.15:4874 , piece_id=6AEPQHAL33H4VGZZHYBSQWFS2XOEQE23HGBLSZRHVBUTG64KLX7A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:145.79.227.15:4874): protocol: rpc: dial tcp 145.79.227.15:4874: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257795389 (564h42m56.610580527s) [noise=true , address=145.79.227.4:4187 , piece_id=JBXUEGJEZGCWYPYW2AEHFBH6PHXPCNRBYB52LUOFKKINLTQ5KXSA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: rpc: dial tcp 145.79.227.4:4187: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257831697 (564h42m56.610616825s) [seg_pos={0 0}, upload=496974]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 22 02:51:21.277589665 (564h42m56.630374793s) [upload=496974]: Done uploading segments... Sep 22 02:51:21.277606296 (564h42m56.630391424s) [upload=496974]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 433.065018ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 30 out of 60 is failed (threshold=3) [XX....XXX.XXXXX..X.XX.XX.XX......XX..X....XX.XXXX.XX..X...X.] duration: 442.206511ms FAIL (2025-09-22 02:51:25 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Sep 22 02:50:51.268997916 (564h42m26.621783024s) [upload=496974]: Starting upload Sep 22 02:50:51.269054642 (564h42m26.62183974s) [upload=496974]: Done starting upload Sep 22 02:50:51.269157625 (564h42m26.621942733s) [upload=496974]: Uploading segments... Sep 22 02:50:51.269282900 (564h42m26.622067998s) [upload=496974]: Got next segment. Inline: false Sep 22 02:50:51.269317225 (564h42m26.622102333s) [upload=496974]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:50:51.269320862 (564h42m26.622105959s) [upload=496974]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:50:51.293324496 (564h42m26.646109594s) [seg_pos={0 0}, upload=496974]: Begin upload segment... Sep 22 02:50:51.293358701 (564h42m26.646143799s) [seg_pos={0 0}, upload=496974]: Done begin upload segment. Sep 22 02:50:51.293373027 (564h42m26.646158135s) [noise=true , address=45.91.116.8:4047 , piece_id=PAMGMPEIDM24FMMTPHXIBLKTM7LARUR3EMVSSVURPR33KNXULREQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.293380561 (564h42m26.646165669s) [noise=true , address=145.79.227.2:4113 , piece_id=XP6CQ6MS55PDBL53D5N443C2EB5FXYIZFMNJF6ZH7YQEOC2AJH7Q, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.293708096 (564h42m26.646493194s) [noise=true , address=45.91.116.6:4975 , piece_id=NKBANVG4EAZEB44IYJRKJ36GJYXXBVIN7DVNKTY4O4MQLT2RK6OQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.293797443 (564h42m26.646582542s) [noise=true , address=145.79.227.15:4874 , piece_id=6AEPQHAL33H4VGZZHYBSQWFS2XOEQE23HGBLSZRHVBUTG64KLX7A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294062983 (564h42m26.646848091s) [noise=true , address=45.91.116.11:4118 , piece_id=QCJ5B5F2BBJAADD3XZ4VQCA67BKOKC77GWIUXLWGWFFVJAJTQLNQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294317470 (564h42m26.647102578s) [noise=true , address=145.79.227.11:4729 , piece_id=7YMPN37CDYMMUQBPG32X72CFL252TJUGEPEMHVJ25AOKBXQ7YCKQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294554444 (564h42m26.647339552s) [noise=true , address=145.79.227.5:4223 , piece_id=QDJOR4KBU74KQBL3IAUKTZMCWE5VX6HXKI5IIBAFLM6MNVWVXT6A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294767033 (564h42m26.647552141s) [noise=true , address=77.90.31.11:4553 , piece_id=3HZSIJ7QI6HQOWRTSL57LAYEEE6PRVEZPIVB6O6FL273FJO5OF5Q, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.295156915 (564h42m26.647942023s) [noise=true , address=45.91.116.12:4225 , piece_id=LNKVKQH24CDG4RSKYTZCGHAKA6I2VIZP232WYRRO6YIXK3JQ3CKA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.295396825 (564h42m26.648181923s) [noise=true , address=145.79.227.16:4911 , piece_id=NNXWBIWEYV62YXWNVNHU5X3K2FRCOLIHSLHX3TRSMSDZWZJP5KAA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.295773862 (564h42m26.64855896s) [noise=true , address=77.90.31.19:4842 , piece_id=EBAFUIGTOR5XIIROSTK6IY7SR7A3RH6WAP3Z5LBALDOKPJ45OC7A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296023902 (564h42m26.648809s) [noise=true , address=77.90.31.13:4628 , piece_id=QXLD6K3FVAV4MS4UPRUJHFIDJPFA25MK7LFYNQHAALITYC7HXHVA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296248182 (564h42m26.649033291s) [noise=true , address=77.90.31.12:4592 , piece_id=2WB4NPAFIKBYB5HFVEKW46VIGUSHHXGMHPXPLLJN2W6NDXLEW53Q, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296648865 (564h42m26.649433962s) [noise=true , address=45.91.116.9:4263 , piece_id=UVJC2F4DCJUQ6W3MVTCZDPUSYGGHPLMI563GOM4G2ONUDIGKXIBA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296917749 (564h42m26.649702867s) [noise=true , address=77.90.31.17:4772 , piece_id=4MKBTSQXAQVHCDF2WTWGSYC4KDFRENIRMG2J3E2X3Q5CRB5QV34A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.297394384 (564h42m26.650179502s) [noise=true , address=145.79.227.4:4187 , piece_id=JBXUEGJEZGCWYPYW2AEHFBH6PHXPCNRBYB52LUOFKKINLTQ5KXSA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.406323968 (564h42m26.759109086s) [upload=496974]: Next returned nil segment Sep 22 02:50:51.406339777 (564h42m26.759124896s) [upload=496974]: Waiting for error group managing segments... Sep 22 02:50:51.415462687 (564h42m26.768247786s) [noise=true , address=77.90.31.17:4772 , piece_id=4MKBTSQXAQVHCDF2WTWGSYC4KDFRENIRMG2J3E2X3Q5CRB5QV34A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416018330 (564h42m26.768803428s) [noise=true , address=45.91.116.12:4225 , piece_id=LNKVKQH24CDG4RSKYTZCGHAKA6I2VIZP232WYRRO6YIXK3JQ3CKA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416381793 (564h42m26.769166901s) [noise=true , address=45.91.116.11:4118 , piece_id=QCJ5B5F2BBJAADD3XZ4VQCA67BKOKC77GWIUXLWGWFFVJAJTQLNQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416638223 (564h42m26.769423342s) [noise=true , address=45.91.116.8:4047 , piece_id=PAMGMPEIDM24FMMTPHXIBLKTM7LARUR3EMVSSVURPR33KNXULREQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416754572 (564h42m26.76953968s) [noise=true , address=45.91.116.6:4975 , piece_id=NKBANVG4EAZEB44IYJRKJ36GJYXXBVIN7DVNKTY4O4MQLT2RK6OQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.417408329 (564h42m26.770193447s) [noise=true , address=45.91.116.9:4263 , piece_id=UVJC2F4DCJUQ6W3MVTCZDPUSYGGHPLMI563GOM4G2ONUDIGKXIBA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.418054872 (564h42m26.77083998s) [noise=true , address=77.90.31.19:4842 , piece_id=EBAFUIGTOR5XIIROSTK6IY7SR7A3RH6WAP3Z5LBALDOKPJ45OC7A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.418414527 (564h42m26.771199635s) [noise=true , address=77.90.31.11:4553 , piece_id=3HZSIJ7QI6HQOWRTSL57LAYEEE6PRVEZPIVB6O6FL273FJO5OF5Q, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.418776847 (564h42m26.771561944s) [noise=true , address=77.90.31.13:4628 , piece_id=QXLD6K3FVAV4MS4UPRUJHFIDJPFA25MK7LFYNQHAALITYC7HXHVA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.419130170 (564h42m26.771915268s) [noise=true , address=77.90.31.12:4592 , piece_id=2WB4NPAFIKBYB5HFVEKW46VIGUSHHXGMHPXPLLJN2W6NDXLEW53Q, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:51:21.257406930 (564h42m56.610192058s) [noise=true , address=145.79.227.5:4223 , piece_id=QDJOR4KBU74KQBL3IAUKTZMCWE5VX6HXKI5IIBAFLM6MNVWVXT6A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: rpc: dial tcp 145.79.227.5:4223: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257604651 (564h42m56.610389779s) [noise=true , address=145.79.227.2:4113 , piece_id=XP6CQ6MS55PDBL53D5N443C2EB5FXYIZFMNJF6ZH7YQEOC2AJH7Q, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: context deadline exceeded; context deadline exceeded Sep 22 02:51:21.257687526 (564h42m56.610472655s) [noise=true , address=145.79.227.16:4911 , piece_id=NNXWBIWEYV62YXWNVNHU5X3K2FRCOLIHSLHX3TRSMSDZWZJP5KAA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257735567 (564h42m56.610520694s) [noise=true , address=145.79.227.11:4729 , piece_id=7YMPN37CDYMMUQBPG32X72CFL252TJUGEPEMHVJ25AOKBXQ7YCKQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: rpc: dial tcp 145.79.227.11:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257752248 (564h42m56.610537376s) [noise=true , address=145.79.227.15:4874 , piece_id=6AEPQHAL33H4VGZZHYBSQWFS2XOEQE23HGBLSZRHVBUTG64KLX7A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:145.79.227.15:4874): protocol: rpc: dial tcp 145.79.227.15:4874: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257795389 (564h42m56.610580527s) [noise=true , address=145.79.227.4:4187 , piece_id=JBXUEGJEZGCWYPYW2AEHFBH6PHXPCNRBYB52LUOFKKINLTQ5KXSA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: rpc: dial tcp 145.79.227.4:4187: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257831697 (564h42m56.610616825s) [seg_pos={0 0}, upload=496974]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 22 02:51:21.277589665 (564h42m56.630374793s) [upload=496974]: Done uploading segments... Sep 22 02:51:21.277606296 (564h42m56.630391424s) [upload=496974]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 442.230497ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 31 out of 60 is failed (threshold=3) [XXX....XXX.XXXXX..X.XX.XX.XX......XX..X....XX.XXXX.XX..X...X] duration: 30.02239432s FAIL (2025-09-22 02:51:21 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Sep 22 02:50:51.268997916 (564h42m26.621783024s) [upload=496974]: Starting upload Sep 22 02:50:51.269054642 (564h42m26.62183974s) [upload=496974]: Done starting upload Sep 22 02:50:51.269157625 (564h42m26.621942733s) [upload=496974]: Uploading segments... Sep 22 02:50:51.269282900 (564h42m26.622067998s) [upload=496974]: Got next segment. Inline: false Sep 22 02:50:51.269317225 (564h42m26.622102333s) [upload=496974]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:50:51.269320862 (564h42m26.622105959s) [upload=496974]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:50:51.293324496 (564h42m26.646109594s) [seg_pos={0 0}, upload=496974]: Begin upload segment... Sep 22 02:50:51.293358701 (564h42m26.646143799s) [seg_pos={0 0}, upload=496974]: Done begin upload segment. Sep 22 02:50:51.293373027 (564h42m26.646158135s) [noise=true , address=45.91.116.8:4047 , piece_id=PAMGMPEIDM24FMMTPHXIBLKTM7LARUR3EMVSSVURPR33KNXULREQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.293380561 (564h42m26.646165669s) [noise=true , address=145.79.227.2:4113 , piece_id=XP6CQ6MS55PDBL53D5N443C2EB5FXYIZFMNJF6ZH7YQEOC2AJH7Q, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.293708096 (564h42m26.646493194s) [noise=true , address=45.91.116.6:4975 , piece_id=NKBANVG4EAZEB44IYJRKJ36GJYXXBVIN7DVNKTY4O4MQLT2RK6OQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.293797443 (564h42m26.646582542s) [noise=true , address=145.79.227.15:4874 , piece_id=6AEPQHAL33H4VGZZHYBSQWFS2XOEQE23HGBLSZRHVBUTG64KLX7A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294062983 (564h42m26.646848091s) [noise=true , address=45.91.116.11:4118 , piece_id=QCJ5B5F2BBJAADD3XZ4VQCA67BKOKC77GWIUXLWGWFFVJAJTQLNQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294317470 (564h42m26.647102578s) [noise=true , address=145.79.227.11:4729 , piece_id=7YMPN37CDYMMUQBPG32X72CFL252TJUGEPEMHVJ25AOKBXQ7YCKQ, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294554444 (564h42m26.647339552s) [noise=true , address=145.79.227.5:4223 , piece_id=QDJOR4KBU74KQBL3IAUKTZMCWE5VX6HXKI5IIBAFLM6MNVWVXT6A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.294767033 (564h42m26.647552141s) [noise=true , address=77.90.31.11:4553 , piece_id=3HZSIJ7QI6HQOWRTSL57LAYEEE6PRVEZPIVB6O6FL273FJO5OF5Q, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.295156915 (564h42m26.647942023s) [noise=true , address=45.91.116.12:4225 , piece_id=LNKVKQH24CDG4RSKYTZCGHAKA6I2VIZP232WYRRO6YIXK3JQ3CKA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.295396825 (564h42m26.648181923s) [noise=true , address=145.79.227.16:4911 , piece_id=NNXWBIWEYV62YXWNVNHU5X3K2FRCOLIHSLHX3TRSMSDZWZJP5KAA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.295773862 (564h42m26.64855896s) [noise=true , address=77.90.31.19:4842 , piece_id=EBAFUIGTOR5XIIROSTK6IY7SR7A3RH6WAP3Z5LBALDOKPJ45OC7A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296023902 (564h42m26.648809s) [noise=true , address=77.90.31.13:4628 , piece_id=QXLD6K3FVAV4MS4UPRUJHFIDJPFA25MK7LFYNQHAALITYC7HXHVA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296248182 (564h42m26.649033291s) [noise=true , address=77.90.31.12:4592 , piece_id=2WB4NPAFIKBYB5HFVEKW46VIGUSHHXGMHPXPLLJN2W6NDXLEW53Q, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296648865 (564h42m26.649433962s) [noise=true , address=45.91.116.9:4263 , piece_id=UVJC2F4DCJUQ6W3MVTCZDPUSYGGHPLMI563GOM4G2ONUDIGKXIBA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.296917749 (564h42m26.649702867s) [noise=true , address=77.90.31.17:4772 , piece_id=4MKBTSQXAQVHCDF2WTWGSYC4KDFRENIRMG2J3E2X3Q5CRB5QV34A, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.297394384 (564h42m26.650179502s) [noise=true , address=145.79.227.4:4187 , piece_id=JBXUEGJEZGCWYPYW2AEHFBH6PHXPCNRBYB52LUOFKKINLTQ5KXSA, seg_pos={0 0}, upload=496974]: Uploading piece... Sep 22 02:50:51.406323968 (564h42m26.759109086s) [upload=496974]: Next returned nil segment Sep 22 02:50:51.406339777 (564h42m26.759124896s) [upload=496974]: Waiting for error group managing segments... Sep 22 02:50:51.415462687 (564h42m26.768247786s) [noise=true , address=77.90.31.17:4772 , piece_id=4MKBTSQXAQVHCDF2WTWGSYC4KDFRENIRMG2J3E2X3Q5CRB5QV34A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416018330 (564h42m26.768803428s) [noise=true , address=45.91.116.12:4225 , piece_id=LNKVKQH24CDG4RSKYTZCGHAKA6I2VIZP232WYRRO6YIXK3JQ3CKA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416381793 (564h42m26.769166901s) [noise=true , address=45.91.116.11:4118 , piece_id=QCJ5B5F2BBJAADD3XZ4VQCA67BKOKC77GWIUXLWGWFFVJAJTQLNQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416638223 (564h42m26.769423342s) [noise=true , address=45.91.116.8:4047 , piece_id=PAMGMPEIDM24FMMTPHXIBLKTM7LARUR3EMVSSVURPR33KNXULREQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.416754572 (564h42m26.76953968s) [noise=true , address=45.91.116.6:4975 , piece_id=NKBANVG4EAZEB44IYJRKJ36GJYXXBVIN7DVNKTY4O4MQLT2RK6OQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.417408329 (564h42m26.770193447s) [noise=true , address=45.91.116.9:4263 , piece_id=UVJC2F4DCJUQ6W3MVTCZDPUSYGGHPLMI563GOM4G2ONUDIGKXIBA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.418054872 (564h42m26.77083998s) [noise=true , address=77.90.31.19:4842 , piece_id=EBAFUIGTOR5XIIROSTK6IY7SR7A3RH6WAP3Z5LBALDOKPJ45OC7A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.418414527 (564h42m26.771199635s) [noise=true , address=77.90.31.11:4553 , piece_id=3HZSIJ7QI6HQOWRTSL57LAYEEE6PRVEZPIVB6O6FL273FJO5OF5Q, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.418776847 (564h42m26.771561944s) [noise=true , address=77.90.31.13:4628 , piece_id=QXLD6K3FVAV4MS4UPRUJHFIDJPFA25MK7LFYNQHAALITYC7HXHVA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:50:51.419130170 (564h42m26.771915268s) [noise=true , address=77.90.31.12:4592 , piece_id=2WB4NPAFIKBYB5HFVEKW46VIGUSHHXGMHPXPLLJN2W6NDXLEW53Q, seg_pos={0 0}, upload=496974]: Done uploading piece. err: <nil> Sep 22 02:51:21.257406930 (564h42m56.610192058s) [noise=true , address=145.79.227.5:4223 , piece_id=QDJOR4KBU74KQBL3IAUKTZMCWE5VX6HXKI5IIBAFLM6MNVWVXT6A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: rpc: dial tcp 145.79.227.5:4223: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257604651 (564h42m56.610389779s) [noise=true , address=145.79.227.2:4113 , piece_id=XP6CQ6MS55PDBL53D5N443C2EB5FXYIZFMNJF6ZH7YQEOC2AJH7Q, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: context deadline exceeded; context deadline exceeded Sep 22 02:51:21.257687526 (564h42m56.610472655s) [noise=true , address=145.79.227.16:4911 , piece_id=NNXWBIWEYV62YXWNVNHU5X3K2FRCOLIHSLHX3TRSMSDZWZJP5KAA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257735567 (564h42m56.610520694s) [noise=true , address=145.79.227.11:4729 , piece_id=7YMPN37CDYMMUQBPG32X72CFL252TJUGEPEMHVJ25AOKBXQ7YCKQ, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: rpc: dial tcp 145.79.227.11:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257752248 (564h42m56.610537376s) [noise=true , address=145.79.227.15:4874 , piece_id=6AEPQHAL33H4VGZZHYBSQWFS2XOEQE23HGBLSZRHVBUTG64KLX7A, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:145.79.227.15:4874): protocol: rpc: dial tcp 145.79.227.15:4874: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257795389 (564h42m56.610580527s) [noise=true , address=145.79.227.4:4187 , piece_id=JBXUEGJEZGCWYPYW2AEHFBH6PHXPCNRBYB52LUOFKKINLTQ5KXSA, seg_pos={0 0}, upload=496974]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: rpc: dial tcp 145.79.227.4:4187: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:51:21.257831697 (564h42m56.610616825s) [seg_pos={0 0}, upload=496974]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 22 02:51:21.277589665 (564h42m56.630374793s) [upload=496974]: Done uploading segments... Sep 22 02:51:21.277606296 (564h42m56.630391424s) [upload=496974]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 30.022413798s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [....X.X.........X.......X...X.....X.XX..XX..X.........X...X.] duration: 418.395118ms FAIL (2025-09-22 02:51:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 418.417901ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [.....X.X.........X.......X...X.....X.XX..XX..X.........X...X] duration: 30.000621597s FAIL (2025-09-22 02:51:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000632086s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [X.XXXXXX..X.................................................] duration: 465.716823ms FAIL (2025-09-22 02:50:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 465.74215ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 30 out of 60 is failed (threshold=3) [.XXX....XXX.XXXXX..X.XX.XX.XX......XX..X....XX.XXXX.XX..X...] duration: 483.691013ms FAIL (2025-09-22 02:50:30 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Sep 22 02:48:52.333512861 (564h40m27.686297999s) [upload=496942]: Starting upload Sep 22 02:48:52.333591489 (564h40m27.686376626s) [upload=496942]: Done starting upload Sep 22 02:48:52.333642394 (564h40m27.686427522s) [upload=496942]: Uploading segments... Sep 22 02:48:52.333968245 (564h40m27.686753384s) [upload=496942]: Got next segment. Inline: false Sep 22 02:48:52.334027867 (564h40m27.686812995s) [upload=496942]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:48:52.334034449 (564h40m27.686819577s) [upload=496942]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:48:52.354033550 (564h40m27.706818678s) [seg_pos={0 0}, upload=496942]: Begin upload segment... Sep 22 02:48:52.354073855 (564h40m27.706858983s) [seg_pos={0 0}, upload=496942]: Done begin upload segment. Sep 22 02:48:52.354100776 (564h40m27.706885904s) [noise=true , address=145.79.227.16:4912 , piece_id=H5QTUVDKJUDBU6SEP2DAGS6OUIOIXAPQEGNYTFM7OPM3ADHVN5VQ, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.354193009 (564h40m27.706978137s) [noise=true , address=45.91.116.12:4226 , piece_id=4EI7Z2KCJGGQ23V7DL6YMKRJ77XC5FOD4V5BFSH4VMD6WW4SBSFA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.354559185 (564h40m27.707344314s) [noise=true , address=45.91.116.14:4189 , piece_id=JDSRPCEM6EKA36O47DLXRIBBK5BKMM4XLFNB5FYQERP3EIUQLWRQ, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.354700742 (564h40m27.70748587s) [noise=true , address=45.91.116.4:4937 , piece_id=PUKTS2EQS6J65JVK7HVWFL63FXFYTLJT25YU6G7QYF6S7KHSXYZA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.355003881 (564h40m27.707789008s) [noise=true , address=145.79.227.12:4767 , piece_id=4XLNWEN7FCTOXM3AJ3YLPW4M5VUKB5DBPLPG3IGJZ3OPHSIJTJUQ, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.355165334 (564h40m27.707950461s) [noise=true , address=145.79.227.13:4802 , piece_id=SIDFMO6L5SFWSAKXPB2I3GCKFQ46OZDIYAW7RCFPP4BOLVFBVF6A, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.355357634 (564h40m27.708142763s) [noise=true , address=77.90.31.17:4770 , piece_id=5ZN6LT65BCX5MWNZJUFJGXT4E3BXCABKD7DVIVZSE3VYDC2F7VAA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.355567899 (564h40m27.708353026s) [noise=true , address=77.90.31.11:4555 , piece_id=O7XIB6YHGXGEICP3SGQDITYSTKDQLR4UCCPLU34HNQVPXMRY3R5A, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.355764037 (564h40m27.708549166s) [noise=true , address=145.79.227.17:4971 , piece_id=ZDPD7A4G3BWGNR5VR6RELSAB36STT6BGQ3LUG3ZLQVVWFEAYTUHQ, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.355953522 (564h40m27.708738651s) [noise=true , address=45.91.116.5:4299 , piece_id=JGG74WOIGOSYNHRP5WE7EVKAESJE5D5D4FQZUBKIGNKOCUOZLJBA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.356219171 (564h40m27.709004299s) [noise=true , address=145.79.227.14:4837 , piece_id=QS76YNZ6P6HUR4UMCR4ILAAP4QY5GYPZBEKPQG5NWKVRFI7QHGMA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.356328255 (564h40m27.709113394s) [noise=true , address=45.91.116.10:4082 , piece_id=WDBNDLMOJBPF3YJB6BJ5H3CI5AOH6WTCKPZDQDF3RQZQI6O2CNZA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.356608522 (564h40m27.70939366s) [noise=true , address=77.90.31.15:4699 , piece_id=VVCZ5UBUCNIKSZ5QPPQWBCG4PQ5P2H3Y3QPX5O2I6RYBUBYZSL6Q, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.356721935 (564h40m27.709507063s) [noise=true , address=45.91.116.13:4155 , piece_id=TA727ASAGLAFP3D3RU54KT5BGZCRSFF3A7FHU7DJ7B3C6G5NOCWA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.356977274 (564h40m27.709762402s) [noise=true , address=45.91.116.8:4048 , piece_id=EGIAB6WX6DA7RMUEQMANZWHL4FD4NGKQEYDIKT7IUMFRMBYWFAHA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.357350534 (564h40m27.710135662s) [noise=true , address=45.91.116.11:4119 , piece_id=6SWTRUVMXY57TVWWR6KAJLNF7MDXWMBHINSHLE2PYW6TA6VYBY7Q, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.453962594 (564h40m27.806747693s) [upload=496942]: Next returned nil segment Sep 22 02:48:52.453972964 (564h40m27.806758072s) [upload=496942]: Waiting for error group managing segments... Sep 22 02:48:52.461631725 (564h40m27.814416833s) [noise=true , address=45.91.116.5:4299 , piece_id=JGG74WOIGOSYNHRP5WE7EVKAESJE5D5D4FQZUBKIGNKOCUOZLJBA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.462560658 (564h40m27.815345777s) [noise=true , address=45.91.116.4:4937 , piece_id=PUKTS2EQS6J65JVK7HVWFL63FXFYTLJT25YU6G7QYF6S7KHSXYZA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.463140918 (564h40m27.815926026s) [noise=true , address=45.91.116.10:4082 , piece_id=WDBNDLMOJBPF3YJB6BJ5H3CI5AOH6WTCKPZDQDF3RQZQI6O2CNZA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.463824972 (564h40m27.81661008s) [noise=true , address=45.91.116.13:4155 , piece_id=TA727ASAGLAFP3D3RU54KT5BGZCRSFF3A7FHU7DJ7B3C6G5NOCWA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.464527459 (564h40m27.817312567s) [noise=true , address=45.91.116.8:4048 , piece_id=EGIAB6WX6DA7RMUEQMANZWHL4FD4NGKQEYDIKT7IUMFRMBYWFAHA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.464766178 (564h40m27.817551296s) [noise=true , address=45.91.116.12:4226 , piece_id=4EI7Z2KCJGGQ23V7DL6YMKRJ77XC5FOD4V5BFSH4VMD6WW4SBSFA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.465000728 (564h40m27.817785836s) [noise=true , address=77.90.31.15:4699 , piece_id=VVCZ5UBUCNIKSZ5QPPQWBCG4PQ5P2H3Y3QPX5O2I6RYBUBYZSL6Q, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.465376051 (564h40m27.81816116s) [noise=true , address=77.90.31.11:4555 , piece_id=O7XIB6YHGXGEICP3SGQDITYSTKDQLR4UCCPLU34HNQVPXMRY3R5A, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.465481510 (564h40m27.818266607s) [noise=true , address=77.90.31.17:4770 , piece_id=5ZN6LT65BCX5MWNZJUFJGXT4E3BXCABKD7DVIVZSE3VYDC2F7VAA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.465969606 (564h40m27.818754724s) [noise=true , address=45.91.116.14:4189 , piece_id=JDSRPCEM6EKA36O47DLXRIBBK5BKMM4XLFNB5FYQERP3EIUQLWRQ, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.466166825 (564h40m27.818951924s) [noise=true , address=45.91.116.11:4119 , piece_id=6SWTRUVMXY57TVWWR6KAJLNF7MDXWMBHINSHLE2PYW6TA6VYBY7Q, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:49:22.319219605 (564h40m57.672004703s) [noise=true , address=145.79.227.12:4767 , piece_id=4XLNWEN7FCTOXM3AJ3YLPW4M5VUKB5DBPLPG3IGJZ3OPHSIJTJUQ, seg_pos={0 0}, upload=496942]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: rpc: dial tcp 145.79.227.12:4767: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:49:22.319268486 (564h40m57.672053584s) [noise=true , address=145.79.227.17:4971 , piece_id=ZDPD7A4G3BWGNR5VR6RELSAB36STT6BGQ3LUG3ZLQVVWFEAYTUHQ, seg_pos={0 0}, upload=496942]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: rpc: dial tcp 145.79.227.17:4971: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:49:22.319302190 (564h40m57.672087287s) [noise=true , address=145.79.227.13:4802 , piece_id=SIDFMO6L5SFWSAKXPB2I3GCKFQ46OZDIYAW7RCFPP4BOLVFBVF6A, seg_pos={0 0}, upload=496942]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: rpc: dial tcp 145.79.227.13:4802: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:49:22.319334911 (564h40m57.672119999s) [noise=true , address=145.79.227.14:4837 , piece_id=QS76YNZ6P6HUR4UMCR4ILAAP4QY5GYPZBEKPQG5NWKVRFI7QHGMA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: rpc: dial tcp 145.79.227.14:4837: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:49:22.319366390 (564h40m57.672151488s) [noise=true , address=145.79.227.16:4912 , piece_id=H5QTUVDKJUDBU6SEP2DAGS6OUIOIXAPQEGNYTFM7OPM3ADHVN5VQ, seg_pos={0 0}, upload=496942]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: rpc: dial tcp 145.79.227.16:4912: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:49:22.319380426 (564h40m57.672165524s) [seg_pos={0 0}, upload=496942]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Sep 22 02:49:22.339788043 (564h40m57.692573141s) [upload=496942]: Done uploading segments... Sep 22 02:49:22.339800236 (564h40m57.692585334s) [upload=496942]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 483.72202ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [.X.XXXXXX..X................................................] duration: 669.203952ms FAIL (2025-09-22 02:50:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 669.222557ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 30 out of 60 is failed (threshold=3) [..XXX....XXX.XXXXX..X.XX.XX.XX......XX..X....XX.XXXX.XX..X..] duration: 440.779825ms FAIL (2025-09-22 02:50:13 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Sep 22 02:48:52.333512861 (564h40m27.686297999s) [upload=496942]: Starting upload Sep 22 02:48:52.333591489 (564h40m27.686376626s) [upload=496942]: Done starting upload Sep 22 02:48:52.333642394 (564h40m27.686427522s) [upload=496942]: Uploading segments... Sep 22 02:48:52.333968245 (564h40m27.686753384s) [upload=496942]: Got next segment. Inline: false Sep 22 02:48:52.334027867 (564h40m27.686812995s) [upload=496942]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:48:52.334034449 (564h40m27.686819577s) [upload=496942]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:48:52.354033550 (564h40m27.706818678s) [seg_pos={0 0}, upload=496942]: Begin upload segment... Sep 22 02:48:52.354073855 (564h40m27.706858983s) [seg_pos={0 0}, upload=496942]: Done begin upload segment. Sep 22 02:48:52.354100776 (564h40m27.706885904s) [noise=true , address=145.79.227.16:4912 , piece_id=H5QTUVDKJUDBU6SEP2DAGS6OUIOIXAPQEGNYTFM7OPM3ADHVN5VQ, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.354193009 (564h40m27.706978137s) [noise=true , address=45.91.116.12:4226 , piece_id=4EI7Z2KCJGGQ23V7DL6YMKRJ77XC5FOD4V5BFSH4VMD6WW4SBSFA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.354559185 (564h40m27.707344314s) [noise=true , address=45.91.116.14:4189 , piece_id=JDSRPCEM6EKA36O47DLXRIBBK5BKMM4XLFNB5FYQERP3EIUQLWRQ, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.354700742 (564h40m27.70748587s) [noise=true , address=45.91.116.4:4937 , piece_id=PUKTS2EQS6J65JVK7HVWFL63FXFYTLJT25YU6G7QYF6S7KHSXYZA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.355003881 (564h40m27.707789008s) [noise=true , address=145.79.227.12:4767 , piece_id=4XLNWEN7FCTOXM3AJ3YLPW4M5VUKB5DBPLPG3IGJZ3OPHSIJTJUQ, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.355165334 (564h40m27.707950461s) [noise=true , address=145.79.227.13:4802 , piece_id=SIDFMO6L5SFWSAKXPB2I3GCKFQ46OZDIYAW7RCFPP4BOLVFBVF6A, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.355357634 (564h40m27.708142763s) [noise=true , address=77.90.31.17:4770 , piece_id=5ZN6LT65BCX5MWNZJUFJGXT4E3BXCABKD7DVIVZSE3VYDC2F7VAA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.355567899 (564h40m27.708353026s) [noise=true , address=77.90.31.11:4555 , piece_id=O7XIB6YHGXGEICP3SGQDITYSTKDQLR4UCCPLU34HNQVPXMRY3R5A, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.355764037 (564h40m27.708549166s) [noise=true , address=145.79.227.17:4971 , piece_id=ZDPD7A4G3BWGNR5VR6RELSAB36STT6BGQ3LUG3ZLQVVWFEAYTUHQ, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.355953522 (564h40m27.708738651s) [noise=true , address=45.91.116.5:4299 , piece_id=JGG74WOIGOSYNHRP5WE7EVKAESJE5D5D4FQZUBKIGNKOCUOZLJBA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.356219171 (564h40m27.709004299s) [noise=true , address=145.79.227.14:4837 , piece_id=QS76YNZ6P6HUR4UMCR4ILAAP4QY5GYPZBEKPQG5NWKVRFI7QHGMA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.356328255 (564h40m27.709113394s) [noise=true , address=45.91.116.10:4082 , piece_id=WDBNDLMOJBPF3YJB6BJ5H3CI5AOH6WTCKPZDQDF3RQZQI6O2CNZA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.356608522 (564h40m27.70939366s) [noise=true , address=77.90.31.15:4699 , piece_id=VVCZ5UBUCNIKSZ5QPPQWBCG4PQ5P2H3Y3QPX5O2I6RYBUBYZSL6Q, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.356721935 (564h40m27.709507063s) [noise=true , address=45.91.116.13:4155 , piece_id=TA727ASAGLAFP3D3RU54KT5BGZCRSFF3A7FHU7DJ7B3C6G5NOCWA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.356977274 (564h40m27.709762402s) [noise=true , address=45.91.116.8:4048 , piece_id=EGIAB6WX6DA7RMUEQMANZWHL4FD4NGKQEYDIKT7IUMFRMBYWFAHA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.357350534 (564h40m27.710135662s) [noise=true , address=45.91.116.11:4119 , piece_id=6SWTRUVMXY57TVWWR6KAJLNF7MDXWMBHINSHLE2PYW6TA6VYBY7Q, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.453962594 (564h40m27.806747693s) [upload=496942]: Next returned nil segment Sep 22 02:48:52.453972964 (564h40m27.806758072s) [upload=496942]: Waiting for error group managing segments... Sep 22 02:48:52.461631725 (564h40m27.814416833s) [noise=true , address=45.91.116.5:4299 , piece_id=JGG74WOIGOSYNHRP5WE7EVKAESJE5D5D4FQZUBKIGNKOCUOZLJBA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.462560658 (564h40m27.815345777s) [noise=true , address=45.91.116.4:4937 , piece_id=PUKTS2EQS6J65JVK7HVWFL63FXFYTLJT25YU6G7QYF6S7KHSXYZA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.463140918 (564h40m27.815926026s) [noise=true , address=45.91.116.10:4082 , piece_id=WDBNDLMOJBPF3YJB6BJ5H3CI5AOH6WTCKPZDQDF3RQZQI6O2CNZA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.463824972 (564h40m27.81661008s) [noise=true , address=45.91.116.13:4155 , piece_id=TA727ASAGLAFP3D3RU54KT5BGZCRSFF3A7FHU7DJ7B3C6G5NOCWA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.464527459 (564h40m27.817312567s) [noise=true , address=45.91.116.8:4048 , piece_id=EGIAB6WX6DA7RMUEQMANZWHL4FD4NGKQEYDIKT7IUMFRMBYWFAHA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.464766178 (564h40m27.817551296s) [noise=true , address=45.91.116.12:4226 , piece_id=4EI7Z2KCJGGQ23V7DL6YMKRJ77XC5FOD4V5BFSH4VMD6WW4SBSFA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.465000728 (564h40m27.817785836s) [noise=true , address=77.90.31.15:4699 , piece_id=VVCZ5UBUCNIKSZ5QPPQWBCG4PQ5P2H3Y3QPX5O2I6RYBUBYZSL6Q, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.465376051 (564h40m27.81816116s) [noise=true , address=77.90.31.11:4555 , piece_id=O7XIB6YHGXGEICP3SGQDITYSTKDQLR4UCCPLU34HNQVPXMRY3R5A, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.465481510 (564h40m27.818266607s) [noise=true , address=77.90.31.17:4770 , piece_id=5ZN6LT65BCX5MWNZJUFJGXT4E3BXCABKD7DVIVZSE3VYDC2F7VAA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.465969606 (564h40m27.818754724s) [noise=true , address=45.91.116.14:4189 , piece_id=JDSRPCEM6EKA36O47DLXRIBBK5BKMM4XLFNB5FYQERP3EIUQLWRQ, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.466166825 (564h40m27.818951924s) [noise=true , address=45.91.116.11:4119 , piece_id=6SWTRUVMXY57TVWWR6KAJLNF7MDXWMBHINSHLE2PYW6TA6VYBY7Q, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:49:22.319219605 (564h40m57.672004703s) [noise=true , address=145.79.227.12:4767 , piece_id=4XLNWEN7FCTOXM3AJ3YLPW4M5VUKB5DBPLPG3IGJZ3OPHSIJTJUQ, seg_pos={0 0}, upload=496942]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: rpc: dial tcp 145.79.227.12:4767: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:49:22.319268486 (564h40m57.672053584s) [noise=true , address=145.79.227.17:4971 , piece_id=ZDPD7A4G3BWGNR5VR6RELSAB36STT6BGQ3LUG3ZLQVVWFEAYTUHQ, seg_pos={0 0}, upload=496942]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: rpc: dial tcp 145.79.227.17:4971: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:49:22.319302190 (564h40m57.672087287s) [noise=true , address=145.79.227.13:4802 , piece_id=SIDFMO6L5SFWSAKXPB2I3GCKFQ46OZDIYAW7RCFPP4BOLVFBVF6A, seg_pos={0 0}, upload=496942]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: rpc: dial tcp 145.79.227.13:4802: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:49:22.319334911 (564h40m57.672119999s) [noise=true , address=145.79.227.14:4837 , piece_id=QS76YNZ6P6HUR4UMCR4ILAAP4QY5GYPZBEKPQG5NWKVRFI7QHGMA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: rpc: dial tcp 145.79.227.14:4837: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:49:22.319366390 (564h40m57.672151488s) [noise=true , address=145.79.227.16:4912 , piece_id=H5QTUVDKJUDBU6SEP2DAGS6OUIOIXAPQEGNYTFM7OPM3ADHVN5VQ, seg_pos={0 0}, upload=496942]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: rpc: dial tcp 145.79.227.16:4912: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:49:22.319380426 (564h40m57.672165524s) [seg_pos={0 0}, upload=496942]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Sep 22 02:49:22.339788043 (564h40m57.692573141s) [upload=496942]: Done uploading segments... Sep 22 02:49:22.339800236 (564h40m57.692585334s) [upload=496942]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 440.806626ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [......X.X.........X.......X...X.....X.XX..XX..X.........X...] duration: 484.614836ms FAIL (2025-09-22 02:49:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 484.638382ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [..X.XXXXXX..X...............................................] duration: 599.055062ms FAIL (2025-09-22 02:49:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 599.079978ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 30 out of 60 is failed (threshold=3) [...XXX....XXX.XXXXX..X.XX.XX.XX......XX..X....XX.XXXX.XX..X.] duration: 453.434854ms FAIL (2025-09-22 02:49:22 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Sep 22 02:48:52.333512861 (564h40m27.686297999s) [upload=496942]: Starting upload Sep 22 02:48:52.333591489 (564h40m27.686376626s) [upload=496942]: Done starting upload Sep 22 02:48:52.333642394 (564h40m27.686427522s) [upload=496942]: Uploading segments... Sep 22 02:48:52.333968245 (564h40m27.686753384s) [upload=496942]: Got next segment. Inline: false Sep 22 02:48:52.334027867 (564h40m27.686812995s) [upload=496942]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:48:52.334034449 (564h40m27.686819577s) [upload=496942]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:48:52.354033550 (564h40m27.706818678s) [seg_pos={0 0}, upload=496942]: Begin upload segment... Sep 22 02:48:52.354073855 (564h40m27.706858983s) [seg_pos={0 0}, upload=496942]: Done begin upload segment. Sep 22 02:48:52.354100776 (564h40m27.706885904s) [noise=true , address=145.79.227.16:4912 , piece_id=H5QTUVDKJUDBU6SEP2DAGS6OUIOIXAPQEGNYTFM7OPM3ADHVN5VQ, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.354193009 (564h40m27.706978137s) [noise=true , address=45.91.116.12:4226 , piece_id=4EI7Z2KCJGGQ23V7DL6YMKRJ77XC5FOD4V5BFSH4VMD6WW4SBSFA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.354559185 (564h40m27.707344314s) [noise=true , address=45.91.116.14:4189 , piece_id=JDSRPCEM6EKA36O47DLXRIBBK5BKMM4XLFNB5FYQERP3EIUQLWRQ, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.354700742 (564h40m27.70748587s) [noise=true , address=45.91.116.4:4937 , piece_id=PUKTS2EQS6J65JVK7HVWFL63FXFYTLJT25YU6G7QYF6S7KHSXYZA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.355003881 (564h40m27.707789008s) [noise=true , address=145.79.227.12:4767 , piece_id=4XLNWEN7FCTOXM3AJ3YLPW4M5VUKB5DBPLPG3IGJZ3OPHSIJTJUQ, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.355165334 (564h40m27.707950461s) [noise=true , address=145.79.227.13:4802 , piece_id=SIDFMO6L5SFWSAKXPB2I3GCKFQ46OZDIYAW7RCFPP4BOLVFBVF6A, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.355357634 (564h40m27.708142763s) [noise=true , address=77.90.31.17:4770 , piece_id=5ZN6LT65BCX5MWNZJUFJGXT4E3BXCABKD7DVIVZSE3VYDC2F7VAA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.355567899 (564h40m27.708353026s) [noise=true , address=77.90.31.11:4555 , piece_id=O7XIB6YHGXGEICP3SGQDITYSTKDQLR4UCCPLU34HNQVPXMRY3R5A, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.355764037 (564h40m27.708549166s) [noise=true , address=145.79.227.17:4971 , piece_id=ZDPD7A4G3BWGNR5VR6RELSAB36STT6BGQ3LUG3ZLQVVWFEAYTUHQ, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.355953522 (564h40m27.708738651s) [noise=true , address=45.91.116.5:4299 , piece_id=JGG74WOIGOSYNHRP5WE7EVKAESJE5D5D4FQZUBKIGNKOCUOZLJBA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.356219171 (564h40m27.709004299s) [noise=true , address=145.79.227.14:4837 , piece_id=QS76YNZ6P6HUR4UMCR4ILAAP4QY5GYPZBEKPQG5NWKVRFI7QHGMA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.356328255 (564h40m27.709113394s) [noise=true , address=45.91.116.10:4082 , piece_id=WDBNDLMOJBPF3YJB6BJ5H3CI5AOH6WTCKPZDQDF3RQZQI6O2CNZA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.356608522 (564h40m27.70939366s) [noise=true , address=77.90.31.15:4699 , piece_id=VVCZ5UBUCNIKSZ5QPPQWBCG4PQ5P2H3Y3QPX5O2I6RYBUBYZSL6Q, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.356721935 (564h40m27.709507063s) [noise=true , address=45.91.116.13:4155 , piece_id=TA727ASAGLAFP3D3RU54KT5BGZCRSFF3A7FHU7DJ7B3C6G5NOCWA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.356977274 (564h40m27.709762402s) [noise=true , address=45.91.116.8:4048 , piece_id=EGIAB6WX6DA7RMUEQMANZWHL4FD4NGKQEYDIKT7IUMFRMBYWFAHA, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.357350534 (564h40m27.710135662s) [noise=true , address=45.91.116.11:4119 , piece_id=6SWTRUVMXY57TVWWR6KAJLNF7MDXWMBHINSHLE2PYW6TA6VYBY7Q, seg_pos={0 0}, upload=496942]: Uploading piece... Sep 22 02:48:52.453962594 (564h40m27.806747693s) [upload=496942]: Next returned nil segment Sep 22 02:48:52.453972964 (564h40m27.806758072s) [upload=496942]: Waiting for error group managing segments... Sep 22 02:48:52.461631725 (564h40m27.814416833s) [noise=true , address=45.91.116.5:4299 , piece_id=JGG74WOIGOSYNHRP5WE7EVKAESJE5D5D4FQZUBKIGNKOCUOZLJBA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.462560658 (564h40m27.815345777s) [noise=true , address=45.91.116.4:4937 , piece_id=PUKTS2EQS6J65JVK7HVWFL63FXFYTLJT25YU6G7QYF6S7KHSXYZA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.463140918 (564h40m27.815926026s) [noise=true , address=45.91.116.10:4082 , piece_id=WDBNDLMOJBPF3YJB6BJ5H3CI5AOH6WTCKPZDQDF3RQZQI6O2CNZA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.463824972 (564h40m27.81661008s) [noise=true , address=45.91.116.13:4155 , piece_id=TA727ASAGLAFP3D3RU54KT5BGZCRSFF3A7FHU7DJ7B3C6G5NOCWA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.464527459 (564h40m27.817312567s) [noise=true , address=45.91.116.8:4048 , piece_id=EGIAB6WX6DA7RMUEQMANZWHL4FD4NGKQEYDIKT7IUMFRMBYWFAHA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.464766178 (564h40m27.817551296s) [noise=true , address=45.91.116.12:4226 , piece_id=4EI7Z2KCJGGQ23V7DL6YMKRJ77XC5FOD4V5BFSH4VMD6WW4SBSFA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.465000728 (564h40m27.817785836s) [noise=true , address=77.90.31.15:4699 , piece_id=VVCZ5UBUCNIKSZ5QPPQWBCG4PQ5P2H3Y3QPX5O2I6RYBUBYZSL6Q, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.465376051 (564h40m27.81816116s) [noise=true , address=77.90.31.11:4555 , piece_id=O7XIB6YHGXGEICP3SGQDITYSTKDQLR4UCCPLU34HNQVPXMRY3R5A, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.465481510 (564h40m27.818266607s) [noise=true , address=77.90.31.17:4770 , piece_id=5ZN6LT65BCX5MWNZJUFJGXT4E3BXCABKD7DVIVZSE3VYDC2F7VAA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.465969606 (564h40m27.818754724s) [noise=true , address=45.91.116.14:4189 , piece_id=JDSRPCEM6EKA36O47DLXRIBBK5BKMM4XLFNB5FYQERP3EIUQLWRQ, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:48:52.466166825 (564h40m27.818951924s) [noise=true , address=45.91.116.11:4119 , piece_id=6SWTRUVMXY57TVWWR6KAJLNF7MDXWMBHINSHLE2PYW6TA6VYBY7Q, seg_pos={0 0}, upload=496942]: Done uploading piece. err: <nil> Sep 22 02:49:22.319219605 (564h40m57.672004703s) [noise=true , address=145.79.227.12:4767 , piece_id=4XLNWEN7FCTOXM3AJ3YLPW4M5VUKB5DBPLPG3IGJZ3OPHSIJTJUQ, seg_pos={0 0}, upload=496942]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: rpc: dial tcp 145.79.227.12:4767: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:49:22.319268486 (564h40m57.672053584s) [noise=true , address=145.79.227.17:4971 , piece_id=ZDPD7A4G3BWGNR5VR6RELSAB36STT6BGQ3LUG3ZLQVVWFEAYTUHQ, seg_pos={0 0}, upload=496942]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: rpc: dial tcp 145.79.227.17:4971: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:49:22.319302190 (564h40m57.672087287s) [noise=true , address=145.79.227.13:4802 , piece_id=SIDFMO6L5SFWSAKXPB2I3GCKFQ46OZDIYAW7RCFPP4BOLVFBVF6A, seg_pos={0 0}, upload=496942]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: rpc: dial tcp 145.79.227.13:4802: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:49:22.319334911 (564h40m57.672119999s) [noise=true , address=145.79.227.14:4837 , piece_id=QS76YNZ6P6HUR4UMCR4ILAAP4QY5GYPZBEKPQG5NWKVRFI7QHGMA, seg_pos={0 0}, upload=496942]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: rpc: dial tcp 145.79.227.14:4837: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:49:22.319366390 (564h40m57.672151488s) [noise=true , address=145.79.227.16:4912 , piece_id=H5QTUVDKJUDBU6SEP2DAGS6OUIOIXAPQEGNYTFM7OPM3ADHVN5VQ, seg_pos={0 0}, upload=496942]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: rpc: dial tcp 145.79.227.16:4912: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:49:22.319380426 (564h40m57.672165524s) [seg_pos={0 0}, upload=496942]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Sep 22 02:49:22.339788043 (564h40m57.692573141s) [upload=496942]: Done uploading segments... Sep 22 02:49:22.339800236 (564h40m57.692585334s) [upload=496942]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 453.454019ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [...X.XXXXXX..X..............................................] duration: 388.486533ms FAIL (2025-09-22 02:48:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 388.517542ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.......X.X.........X.......X...X.....X.XX..XX..X.........X..] duration: 393.124258ms FAIL (2025-09-22 02:48:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 393.144154ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 29 out of 60 is failed (threshold=3) [.....XXX....XXX.XXXXX..X.XX.XX.XX......XX..X....XX.XXXX.XX..] duration: 689.886513ms FAIL (2025-09-22 02:48:14 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 22 02:46:35.399447578 (564h38m10.752232705s) [upload=496908]: Starting upload Sep 22 02:46:35.399541243 (564h38m10.752326372s) [upload=496908]: Done starting upload Sep 22 02:46:35.399826067 (564h38m10.752611196s) [upload=496908]: Uploading segments... Sep 22 02:46:35.399933509 (564h38m10.752718637s) [upload=496908]: Got next segment. Inline: false Sep 22 02:46:35.399984635 (564h38m10.752769773s) [upload=496908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:46:35.399990325 (564h38m10.752775454s) [upload=496908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:46:35.423429781 (564h38m10.776214909s) [seg_pos={0 0}, upload=496908]: Begin upload segment... Sep 22 02:46:35.423485115 (564h38m10.776270243s) [seg_pos={0 0}, upload=496908]: Done begin upload segment. Sep 22 02:46:35.423521153 (564h38m10.776306281s) [noise=true , address=77.90.31.16:4733 , piece_id=YAIQDUBVWNCJMUEP2GHG4T5KNR45SYLP76U52G45T77OLFW4FVJA, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.423581405 (564h38m10.776366544s) [noise=true , address=45.91.116.6:4975 , piece_id=VAMKLQBODTTJ5QYZWUFVJEGL4GBLI2XBCYRC72B4Q5EFIV64P4WA, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.423985655 (564h38m10.776770773s) [noise=true , address=45.91.116.10:4082 , piece_id=5OFGIHWR6EDNQPGLV45FT6VIBQYZZSO2CHF3OJ5BHHR2EMTC75VQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.424271741 (564h38m10.777056879s) [noise=true , address=45.91.116.13:4154 , piece_id=ZMN7EH26CQIUKFNAASDDIAHKC6TFS4ETYND6D3RRMJ2DDPMDYC3A, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.424406855 (564h38m10.777191983s) [noise=true , address=77.90.31.12:4590 , piece_id=SJFCO4ZPKKB6JZQHS3UAL4PYYCEISXBII34ZZZNJGBWXNTLJUGSQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.424804632 (564h38m10.77758977s) [noise=true , address=77.90.31.11:4555 , piece_id=OSVZWRJ6FLC7PPVC4WGNOONCB5EWBY5BCUKHPQXEQI4G3YHZ2PUA, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.424850919 (564h38m10.777636047s) [noise=true , address=145.79.227.11:4730 , piece_id=5AAYNMHQ6EQ3FSTPIZLDFX7QF6ZEEBBMINI7YHD2JMOLS3KTFXJQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.425223337 (564h38m10.778008465s) [noise=true , address=45.91.116.4:4937 , piece_id=YZPFI5VQF3KVTHGAMVL5S7TEPDH426VTUDEHS5TMFJPCQDL6R26A, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.425322223 (564h38m10.778107361s) [noise=true , address=145.79.227.12:4767 , piece_id=GRPGOOUDTQ2YMXQTHTO4RXYXBLH34WWGHMXNIMFJWYQLK6HCDESQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.425583363 (564h38m10.778368482s) [noise=true , address=145.79.227.15:4876 , piece_id=UXIV35AF3MNP2F7DCKUG5O4L7HHON34XNMITUSTZD5WRMCWIP4SQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.425861916 (564h38m10.778647044s) [noise=true , address=45.91.116.9:4261 , piece_id=6YF5DQF3OMEY6GGOCXEGMGWK6KUOBXHGPMYYZM4SJOIBSMOVC6VA, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.425930785 (564h38m10.778715903s) [noise=true , address=145.79.227.2:4114 , piece_id=H6RE4XBFFWNUCNBJVBN7XTMP3SAT26P4JTTYJDZ7RT7MDNE25YAQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.426261135 (564h38m10.779046262s) [noise=true , address=45.91.116.5:4298 , piece_id=KRWUXXNWND6FHOJT3Y2FEZNQDSVQN36HU3QEMURF2XPWEBWYR5XQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.426394915 (564h38m10.779180124s) [noise=true , address=45.91.116.14:4189 , piece_id=S2ZHXMRCRUIL24ZYEO245TX54GQ3EZEJYAJE6WM26PFMKQDE4EHQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.426617664 (564h38m10.779402792s) [noise=true , address=45.91.116.11:4117 , piece_id=DISYXYVCPUN7MHQVMOVWAU2CUBSGKLM7JOAETDROWCQNKQFJ57KA, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.426927275 (564h38m10.779712413s) [noise=true , address=77.90.31.21:4878 , piece_id=LKCT2HVGNP4IGHKFUAG2HJIS6GPC5TZHNOHF4XW5NMMQNCMNGUQA, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.526475325 (564h38m10.879260423s) [upload=496908]: Next returned nil segment Sep 22 02:46:35.526485063 (564h38m10.879270152s) [upload=496908]: Waiting for error group managing segments... Sep 22 02:46:35.534416647 (564h38m10.887201756s) [noise=true , address=45.91.116.14:4189 , piece_id=S2ZHXMRCRUIL24ZYEO245TX54GQ3EZEJYAJE6WM26PFMKQDE4EHQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.535104148 (564h38m10.887889246s) [noise=true , address=45.91.116.13:4154 , piece_id=ZMN7EH26CQIUKFNAASDDIAHKC6TFS4ETYND6D3RRMJ2DDPMDYC3A, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.535125628 (564h38m10.887910736s) [noise=true , address=45.91.116.10:4082 , piece_id=5OFGIHWR6EDNQPGLV45FT6VIBQYZZSO2CHF3OJ5BHHR2EMTC75VQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.535506463 (564h38m10.888291561s) [noise=true , address=45.91.116.11:4117 , piece_id=DISYXYVCPUN7MHQVMOVWAU2CUBSGKLM7JOAETDROWCQNKQFJ57KA, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.535724041 (564h38m10.888509149s) [noise=true , address=45.91.116.6:4975 , piece_id=VAMKLQBODTTJ5QYZWUFVJEGL4GBLI2XBCYRC72B4Q5EFIV64P4WA, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.535774516 (564h38m10.888559614s) [noise=true , address=45.91.116.5:4298 , piece_id=KRWUXXNWND6FHOJT3Y2FEZNQDSVQN36HU3QEMURF2XPWEBWYR5XQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.536404838 (564h38m10.889189936s) [noise=true , address=77.90.31.21:4878 , piece_id=LKCT2HVGNP4IGHKFUAG2HJIS6GPC5TZHNOHF4XW5NMMQNCMNGUQA, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.536447639 (564h38m10.889232747s) [noise=true , address=45.91.116.9:4261 , piece_id=6YF5DQF3OMEY6GGOCXEGMGWK6KUOBXHGPMYYZM4SJOIBSMOVC6VA, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.536797656 (564h38m10.889582754s) [noise=true , address=45.91.116.4:4937 , piece_id=YZPFI5VQF3KVTHGAMVL5S7TEPDH426VTUDEHS5TMFJPCQDL6R26A, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.537653271 (564h38m10.890438369s) [noise=true , address=77.90.31.16:4733 , piece_id=YAIQDUBVWNCJMUEP2GHG4T5KNR45SYLP76U52G45T77OLFW4FVJA, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.540822618 (564h38m10.893607737s) [noise=true , address=77.90.31.11:4555 , piece_id=OSVZWRJ6FLC7PPVC4WGNOONCB5EWBY5BCUKHPQXEQI4G3YHZ2PUA, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.543505283 (564h38m10.896290401s) [noise=true , address=77.90.31.12:4590 , piece_id=SJFCO4ZPKKB6JZQHS3UAL4PYYCEISXBII34ZZZNJGBWXNTLJUGSQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:47:05.384909711 (564h38m40.737694819s) [noise=true , address=145.79.227.11:4730 , piece_id=5AAYNMHQ6EQ3FSTPIZLDFX7QF6ZEEBBMINI7YHD2JMOLS3KTFXJQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:47:05.384967039 (564h38m40.737752147s) [noise=true , address=145.79.227.12:4767 , piece_id=GRPGOOUDTQ2YMXQTHTO4RXYXBLH34WWGHMXNIMFJWYQLK6HCDESQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: rpc: dial tcp 145.79.227.12:4767: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:47:05.384998918 (564h38m40.737784026s) [noise=true , address=145.79.227.15:4876 , piece_id=UXIV35AF3MNP2F7DCKUG5O4L7HHON34XNMITUSTZD5WRMCWIP4SQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: rpc: dial tcp 145.79.227.15:4876: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:47:05.385007795 (564h38m40.737792903s) [noise=true , address=145.79.227.2:4114 , piece_id=H6RE4XBFFWNUCNBJVBN7XTMP3SAT26P4JTTYJDZ7RT7MDNE25YAQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:47:05.385026631 (564h38m40.737811739s) [seg_pos={0 0}, upload=496908]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 22 02:47:05.465175336 (564h38m40.817960434s) [upload=496908]: Done uploading segments... Sep 22 02:47:05.465196496 (564h38m40.817981604s) [upload=496908]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 689.945054ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [....X.XXXXXX..X.............................................] duration: 426.558318ms FAIL (2025-09-22 02:48:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 426.570612ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [........X.X.........X.......X...X.....X.XX..XX..X.........X.] duration: 405.881186ms FAIL (2025-09-22 02:47:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 405.900122ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 29 out of 60 is failed (threshold=3) [......XXX....XXX.XXXXX..X.XX.XX.XX......XX..X....XX.XXXX.XX.] duration: 511.023853ms FAIL (2025-09-22 02:47:26 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 22 02:46:35.399447578 (564h38m10.752232705s) [upload=496908]: Starting upload Sep 22 02:46:35.399541243 (564h38m10.752326372s) [upload=496908]: Done starting upload Sep 22 02:46:35.399826067 (564h38m10.752611196s) [upload=496908]: Uploading segments... Sep 22 02:46:35.399933509 (564h38m10.752718637s) [upload=496908]: Got next segment. Inline: false Sep 22 02:46:35.399984635 (564h38m10.752769773s) [upload=496908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:46:35.399990325 (564h38m10.752775454s) [upload=496908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:46:35.423429781 (564h38m10.776214909s) [seg_pos={0 0}, upload=496908]: Begin upload segment... Sep 22 02:46:35.423485115 (564h38m10.776270243s) [seg_pos={0 0}, upload=496908]: Done begin upload segment. Sep 22 02:46:35.423521153 (564h38m10.776306281s) [noise=true , address=77.90.31.16:4733 , piece_id=YAIQDUBVWNCJMUEP2GHG4T5KNR45SYLP76U52G45T77OLFW4FVJA, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.423581405 (564h38m10.776366544s) [noise=true , address=45.91.116.6:4975 , piece_id=VAMKLQBODTTJ5QYZWUFVJEGL4GBLI2XBCYRC72B4Q5EFIV64P4WA, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.423985655 (564h38m10.776770773s) [noise=true , address=45.91.116.10:4082 , piece_id=5OFGIHWR6EDNQPGLV45FT6VIBQYZZSO2CHF3OJ5BHHR2EMTC75VQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.424271741 (564h38m10.777056879s) [noise=true , address=45.91.116.13:4154 , piece_id=ZMN7EH26CQIUKFNAASDDIAHKC6TFS4ETYND6D3RRMJ2DDPMDYC3A, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.424406855 (564h38m10.777191983s) [noise=true , address=77.90.31.12:4590 , piece_id=SJFCO4ZPKKB6JZQHS3UAL4PYYCEISXBII34ZZZNJGBWXNTLJUGSQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.424804632 (564h38m10.77758977s) [noise=true , address=77.90.31.11:4555 , piece_id=OSVZWRJ6FLC7PPVC4WGNOONCB5EWBY5BCUKHPQXEQI4G3YHZ2PUA, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.424850919 (564h38m10.777636047s) [noise=true , address=145.79.227.11:4730 , piece_id=5AAYNMHQ6EQ3FSTPIZLDFX7QF6ZEEBBMINI7YHD2JMOLS3KTFXJQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.425223337 (564h38m10.778008465s) [noise=true , address=45.91.116.4:4937 , piece_id=YZPFI5VQF3KVTHGAMVL5S7TEPDH426VTUDEHS5TMFJPCQDL6R26A, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.425322223 (564h38m10.778107361s) [noise=true , address=145.79.227.12:4767 , piece_id=GRPGOOUDTQ2YMXQTHTO4RXYXBLH34WWGHMXNIMFJWYQLK6HCDESQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.425583363 (564h38m10.778368482s) [noise=true , address=145.79.227.15:4876 , piece_id=UXIV35AF3MNP2F7DCKUG5O4L7HHON34XNMITUSTZD5WRMCWIP4SQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.425861916 (564h38m10.778647044s) [noise=true , address=45.91.116.9:4261 , piece_id=6YF5DQF3OMEY6GGOCXEGMGWK6KUOBXHGPMYYZM4SJOIBSMOVC6VA, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.425930785 (564h38m10.778715903s) [noise=true , address=145.79.227.2:4114 , piece_id=H6RE4XBFFWNUCNBJVBN7XTMP3SAT26P4JTTYJDZ7RT7MDNE25YAQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.426261135 (564h38m10.779046262s) [noise=true , address=45.91.116.5:4298 , piece_id=KRWUXXNWND6FHOJT3Y2FEZNQDSVQN36HU3QEMURF2XPWEBWYR5XQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.426394915 (564h38m10.779180124s) [noise=true , address=45.91.116.14:4189 , piece_id=S2ZHXMRCRUIL24ZYEO245TX54GQ3EZEJYAJE6WM26PFMKQDE4EHQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.426617664 (564h38m10.779402792s) [noise=true , address=45.91.116.11:4117 , piece_id=DISYXYVCPUN7MHQVMOVWAU2CUBSGKLM7JOAETDROWCQNKQFJ57KA, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.426927275 (564h38m10.779712413s) [noise=true , address=77.90.31.21:4878 , piece_id=LKCT2HVGNP4IGHKFUAG2HJIS6GPC5TZHNOHF4XW5NMMQNCMNGUQA, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.526475325 (564h38m10.879260423s) [upload=496908]: Next returned nil segment Sep 22 02:46:35.526485063 (564h38m10.879270152s) [upload=496908]: Waiting for error group managing segments... Sep 22 02:46:35.534416647 (564h38m10.887201756s) [noise=true , address=45.91.116.14:4189 , piece_id=S2ZHXMRCRUIL24ZYEO245TX54GQ3EZEJYAJE6WM26PFMKQDE4EHQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.535104148 (564h38m10.887889246s) [noise=true , address=45.91.116.13:4154 , piece_id=ZMN7EH26CQIUKFNAASDDIAHKC6TFS4ETYND6D3RRMJ2DDPMDYC3A, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.535125628 (564h38m10.887910736s) [noise=true , address=45.91.116.10:4082 , piece_id=5OFGIHWR6EDNQPGLV45FT6VIBQYZZSO2CHF3OJ5BHHR2EMTC75VQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.535506463 (564h38m10.888291561s) [noise=true , address=45.91.116.11:4117 , piece_id=DISYXYVCPUN7MHQVMOVWAU2CUBSGKLM7JOAETDROWCQNKQFJ57KA, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.535724041 (564h38m10.888509149s) [noise=true , address=45.91.116.6:4975 , piece_id=VAMKLQBODTTJ5QYZWUFVJEGL4GBLI2XBCYRC72B4Q5EFIV64P4WA, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.535774516 (564h38m10.888559614s) [noise=true , address=45.91.116.5:4298 , piece_id=KRWUXXNWND6FHOJT3Y2FEZNQDSVQN36HU3QEMURF2XPWEBWYR5XQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.536404838 (564h38m10.889189936s) [noise=true , address=77.90.31.21:4878 , piece_id=LKCT2HVGNP4IGHKFUAG2HJIS6GPC5TZHNOHF4XW5NMMQNCMNGUQA, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.536447639 (564h38m10.889232747s) [noise=true , address=45.91.116.9:4261 , piece_id=6YF5DQF3OMEY6GGOCXEGMGWK6KUOBXHGPMYYZM4SJOIBSMOVC6VA, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.536797656 (564h38m10.889582754s) [noise=true , address=45.91.116.4:4937 , piece_id=YZPFI5VQF3KVTHGAMVL5S7TEPDH426VTUDEHS5TMFJPCQDL6R26A, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.537653271 (564h38m10.890438369s) [noise=true , address=77.90.31.16:4733 , piece_id=YAIQDUBVWNCJMUEP2GHG4T5KNR45SYLP76U52G45T77OLFW4FVJA, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.540822618 (564h38m10.893607737s) [noise=true , address=77.90.31.11:4555 , piece_id=OSVZWRJ6FLC7PPVC4WGNOONCB5EWBY5BCUKHPQXEQI4G3YHZ2PUA, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.543505283 (564h38m10.896290401s) [noise=true , address=77.90.31.12:4590 , piece_id=SJFCO4ZPKKB6JZQHS3UAL4PYYCEISXBII34ZZZNJGBWXNTLJUGSQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:47:05.384909711 (564h38m40.737694819s) [noise=true , address=145.79.227.11:4730 , piece_id=5AAYNMHQ6EQ3FSTPIZLDFX7QF6ZEEBBMINI7YHD2JMOLS3KTFXJQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:47:05.384967039 (564h38m40.737752147s) [noise=true , address=145.79.227.12:4767 , piece_id=GRPGOOUDTQ2YMXQTHTO4RXYXBLH34WWGHMXNIMFJWYQLK6HCDESQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: rpc: dial tcp 145.79.227.12:4767: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:47:05.384998918 (564h38m40.737784026s) [noise=true , address=145.79.227.15:4876 , piece_id=UXIV35AF3MNP2F7DCKUG5O4L7HHON34XNMITUSTZD5WRMCWIP4SQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: rpc: dial tcp 145.79.227.15:4876: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:47:05.385007795 (564h38m40.737792903s) [noise=true , address=145.79.227.2:4114 , piece_id=H6RE4XBFFWNUCNBJVBN7XTMP3SAT26P4JTTYJDZ7RT7MDNE25YAQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:47:05.385026631 (564h38m40.737811739s) [seg_pos={0 0}, upload=496908]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 22 02:47:05.465175336 (564h38m40.817960434s) [upload=496908]: Done uploading segments... Sep 22 02:47:05.465196496 (564h38m40.817981604s) [upload=496908]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 511.044232ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [.....X.XXXXXX..X............................................] duration: 414.860787ms FAIL (2025-09-22 02:47:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 414.886836ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.........X.X.........X.......X...X.....X.XX..XX..X.........X] duration: 30.001122304s FAIL (2025-09-22 02:47:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001139305s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 29 out of 60 is failed (threshold=3) [.......XXX....XXX.XXXXX..X.XX.XX.XX......XX..X....XX.XXXX.XX] duration: 30.081786466s FAIL (2025-09-22 02:47:05 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 22 02:46:35.399447578 (564h38m10.752232705s) [upload=496908]: Starting upload Sep 22 02:46:35.399541243 (564h38m10.752326372s) [upload=496908]: Done starting upload Sep 22 02:46:35.399826067 (564h38m10.752611196s) [upload=496908]: Uploading segments... Sep 22 02:46:35.399933509 (564h38m10.752718637s) [upload=496908]: Got next segment. Inline: false Sep 22 02:46:35.399984635 (564h38m10.752769773s) [upload=496908]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:46:35.399990325 (564h38m10.752775454s) [upload=496908]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:46:35.423429781 (564h38m10.776214909s) [seg_pos={0 0}, upload=496908]: Begin upload segment... Sep 22 02:46:35.423485115 (564h38m10.776270243s) [seg_pos={0 0}, upload=496908]: Done begin upload segment. Sep 22 02:46:35.423521153 (564h38m10.776306281s) [noise=true , address=77.90.31.16:4733 , piece_id=YAIQDUBVWNCJMUEP2GHG4T5KNR45SYLP76U52G45T77OLFW4FVJA, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.423581405 (564h38m10.776366544s) [noise=true , address=45.91.116.6:4975 , piece_id=VAMKLQBODTTJ5QYZWUFVJEGL4GBLI2XBCYRC72B4Q5EFIV64P4WA, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.423985655 (564h38m10.776770773s) [noise=true , address=45.91.116.10:4082 , piece_id=5OFGIHWR6EDNQPGLV45FT6VIBQYZZSO2CHF3OJ5BHHR2EMTC75VQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.424271741 (564h38m10.777056879s) [noise=true , address=45.91.116.13:4154 , piece_id=ZMN7EH26CQIUKFNAASDDIAHKC6TFS4ETYND6D3RRMJ2DDPMDYC3A, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.424406855 (564h38m10.777191983s) [noise=true , address=77.90.31.12:4590 , piece_id=SJFCO4ZPKKB6JZQHS3UAL4PYYCEISXBII34ZZZNJGBWXNTLJUGSQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.424804632 (564h38m10.77758977s) [noise=true , address=77.90.31.11:4555 , piece_id=OSVZWRJ6FLC7PPVC4WGNOONCB5EWBY5BCUKHPQXEQI4G3YHZ2PUA, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.424850919 (564h38m10.777636047s) [noise=true , address=145.79.227.11:4730 , piece_id=5AAYNMHQ6EQ3FSTPIZLDFX7QF6ZEEBBMINI7YHD2JMOLS3KTFXJQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.425223337 (564h38m10.778008465s) [noise=true , address=45.91.116.4:4937 , piece_id=YZPFI5VQF3KVTHGAMVL5S7TEPDH426VTUDEHS5TMFJPCQDL6R26A, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.425322223 (564h38m10.778107361s) [noise=true , address=145.79.227.12:4767 , piece_id=GRPGOOUDTQ2YMXQTHTO4RXYXBLH34WWGHMXNIMFJWYQLK6HCDESQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.425583363 (564h38m10.778368482s) [noise=true , address=145.79.227.15:4876 , piece_id=UXIV35AF3MNP2F7DCKUG5O4L7HHON34XNMITUSTZD5WRMCWIP4SQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.425861916 (564h38m10.778647044s) [noise=true , address=45.91.116.9:4261 , piece_id=6YF5DQF3OMEY6GGOCXEGMGWK6KUOBXHGPMYYZM4SJOIBSMOVC6VA, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.425930785 (564h38m10.778715903s) [noise=true , address=145.79.227.2:4114 , piece_id=H6RE4XBFFWNUCNBJVBN7XTMP3SAT26P4JTTYJDZ7RT7MDNE25YAQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.426261135 (564h38m10.779046262s) [noise=true , address=45.91.116.5:4298 , piece_id=KRWUXXNWND6FHOJT3Y2FEZNQDSVQN36HU3QEMURF2XPWEBWYR5XQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.426394915 (564h38m10.779180124s) [noise=true , address=45.91.116.14:4189 , piece_id=S2ZHXMRCRUIL24ZYEO245TX54GQ3EZEJYAJE6WM26PFMKQDE4EHQ, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.426617664 (564h38m10.779402792s) [noise=true , address=45.91.116.11:4117 , piece_id=DISYXYVCPUN7MHQVMOVWAU2CUBSGKLM7JOAETDROWCQNKQFJ57KA, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.426927275 (564h38m10.779712413s) [noise=true , address=77.90.31.21:4878 , piece_id=LKCT2HVGNP4IGHKFUAG2HJIS6GPC5TZHNOHF4XW5NMMQNCMNGUQA, seg_pos={0 0}, upload=496908]: Uploading piece... Sep 22 02:46:35.526475325 (564h38m10.879260423s) [upload=496908]: Next returned nil segment Sep 22 02:46:35.526485063 (564h38m10.879270152s) [upload=496908]: Waiting for error group managing segments... Sep 22 02:46:35.534416647 (564h38m10.887201756s) [noise=true , address=45.91.116.14:4189 , piece_id=S2ZHXMRCRUIL24ZYEO245TX54GQ3EZEJYAJE6WM26PFMKQDE4EHQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.535104148 (564h38m10.887889246s) [noise=true , address=45.91.116.13:4154 , piece_id=ZMN7EH26CQIUKFNAASDDIAHKC6TFS4ETYND6D3RRMJ2DDPMDYC3A, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.535125628 (564h38m10.887910736s) [noise=true , address=45.91.116.10:4082 , piece_id=5OFGIHWR6EDNQPGLV45FT6VIBQYZZSO2CHF3OJ5BHHR2EMTC75VQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.535506463 (564h38m10.888291561s) [noise=true , address=45.91.116.11:4117 , piece_id=DISYXYVCPUN7MHQVMOVWAU2CUBSGKLM7JOAETDROWCQNKQFJ57KA, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.535724041 (564h38m10.888509149s) [noise=true , address=45.91.116.6:4975 , piece_id=VAMKLQBODTTJ5QYZWUFVJEGL4GBLI2XBCYRC72B4Q5EFIV64P4WA, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.535774516 (564h38m10.888559614s) [noise=true , address=45.91.116.5:4298 , piece_id=KRWUXXNWND6FHOJT3Y2FEZNQDSVQN36HU3QEMURF2XPWEBWYR5XQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.536404838 (564h38m10.889189936s) [noise=true , address=77.90.31.21:4878 , piece_id=LKCT2HVGNP4IGHKFUAG2HJIS6GPC5TZHNOHF4XW5NMMQNCMNGUQA, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.536447639 (564h38m10.889232747s) [noise=true , address=45.91.116.9:4261 , piece_id=6YF5DQF3OMEY6GGOCXEGMGWK6KUOBXHGPMYYZM4SJOIBSMOVC6VA, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.536797656 (564h38m10.889582754s) [noise=true , address=45.91.116.4:4937 , piece_id=YZPFI5VQF3KVTHGAMVL5S7TEPDH426VTUDEHS5TMFJPCQDL6R26A, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.537653271 (564h38m10.890438369s) [noise=true , address=77.90.31.16:4733 , piece_id=YAIQDUBVWNCJMUEP2GHG4T5KNR45SYLP76U52G45T77OLFW4FVJA, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.540822618 (564h38m10.893607737s) [noise=true , address=77.90.31.11:4555 , piece_id=OSVZWRJ6FLC7PPVC4WGNOONCB5EWBY5BCUKHPQXEQI4G3YHZ2PUA, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:46:35.543505283 (564h38m10.896290401s) [noise=true , address=77.90.31.12:4590 , piece_id=SJFCO4ZPKKB6JZQHS3UAL4PYYCEISXBII34ZZZNJGBWXNTLJUGSQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: <nil> Sep 22 02:47:05.384909711 (564h38m40.737694819s) [noise=true , address=145.79.227.11:4730 , piece_id=5AAYNMHQ6EQ3FSTPIZLDFX7QF6ZEEBBMINI7YHD2JMOLS3KTFXJQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:47:05.384967039 (564h38m40.737752147s) [noise=true , address=145.79.227.12:4767 , piece_id=GRPGOOUDTQ2YMXQTHTO4RXYXBLH34WWGHMXNIMFJWYQLK6HCDESQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: rpc: dial tcp 145.79.227.12:4767: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:47:05.384998918 (564h38m40.737784026s) [noise=true , address=145.79.227.15:4876 , piece_id=UXIV35AF3MNP2F7DCKUG5O4L7HHON34XNMITUSTZD5WRMCWIP4SQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: rpc: dial tcp 145.79.227.15:4876: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:47:05.385007795 (564h38m40.737792903s) [noise=true , address=145.79.227.2:4114 , piece_id=H6RE4XBFFWNUCNBJVBN7XTMP3SAT26P4JTTYJDZ7RT7MDNE25YAQ, seg_pos={0 0}, upload=496908]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:145.79.227.2:4114): protocol: rpc: dial tcp 145.79.227.2:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:47:05.385026631 (564h38m40.737811739s) [seg_pos={0 0}, upload=496908]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 22 02:47:05.465175336 (564h38m40.817960434s) [upload=496908]: Done uploading segments... Sep 22 02:47:05.465196496 (564h38m40.817981604s) [upload=496908]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.081807794s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [......X.XXXXXX..X...........................................] duration: 425.858458ms FAIL (2025-09-22 02:46:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 425.879989ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 28 out of 60 is failed (threshold=3) [........XXX....XXX.XXXXX..X.XX.XX.XX......XX..X....XX.XXXX.X] duration: 30.02006553s FAIL (2025-09-22 02:46:30 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Sep 22 02:46:00.401056894 (564h37m35.753841993s) [upload=496898]: Starting upload Sep 22 02:46:00.401152154 (564h37m35.753937252s) [upload=496898]: Done starting upload Sep 22 02:46:00.401261029 (564h37m35.754046127s) [upload=496898]: Uploading segments... Sep 22 02:46:00.401365745 (564h37m35.754150843s) [upload=496898]: Got next segment. Inline: false Sep 22 02:46:00.401404637 (564h37m35.754189746s) [upload=496898]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:46:00.401409066 (564h37m35.754194164s) [upload=496898]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:46:00.422408343 (564h37m35.77519344s) [seg_pos={0 0}, upload=496898]: Begin upload segment... Sep 22 02:46:00.422484135 (564h37m35.775269243s) [seg_pos={0 0}, upload=496898]: Done begin upload segment. Sep 22 02:46:00.422488343 (564h37m35.775273441s) [noise=true , address=45.91.116.10:4081 , piece_id=NWCCRNBUMFCAKPXUHUBE3E5UHKDV2ILLCFQZO4VV5MKTTHCKIUYA, seg_pos={0 0}, upload=496898]: Uploading piece... Sep 22 02:46:00.422503090 (564h37m35.775288198s) [noise=true , address=45.91.116.7:4011 , piece_id=XM7Y53GN66NEGDM3R4NPZSJX6PCYUYHLTY6UERJDXPRFMSOT3ISA, seg_pos={0 0}, upload=496898]: Uploading piece... Sep 22 02:46:00.422818683 (564h37m35.775603791s) [noise=true , address=45.91.116.4:4939 , piece_id=YSIJ5WKOVEYMPPX5HS5U45EMHAXYOXECKVULH6TCQNUMUSTLG3WA, seg_pos={0 0}, upload=496898]: Uploading piece... Sep 22 02:46:00.423112474 (564h37m35.775897582s) [noise=true , address=77.90.31.11:4553 , piece_id=K7OWTWW6WKOSMYYGK4R35RS6B6N65JPNICA2ROAFKOMT65I3UFSA, seg_pos={0 0}, upload=496898]: Uploading piece... Sep 22 02:46:00.423379645 (564h37m35.776164753s) [noise=true , address=145.79.227.6:4259 , piece_id=7YU347AC2NF5576MC6XAIEHISP5PJKRUIX667OVGRTMOYWAOYKWA, seg_pos={0 0}, upload=496898]: Uploading piece... Sep 22 02:46:00.423650774 (564h37m35.776435883s) [noise=true , address=77.90.31.14:4661 , piece_id=3IZ5ADIY5BTEUT75HS6FNW3LALBVTNRRU6ZQM57ZR45PMOJAJZLQ, seg_pos={0 0}, upload=496898]: Uploading piece... Sep 22 02:46:00.423890875 (564h37m35.776675973s) [noise=true , address=145.79.227.14:4837 , piece_id=NN6XBVVQEMCRNYFWETP5B5VOP3RTYVURRIYFGYTNSFYJNWOFJUAA, seg_pos={0 0}, upload=496898]: Uploading piece... Sep 22 02:46:00.424182171 (564h37m35.776967269s) [noise=true , address=145.79.227.18:4005 , piece_id=JILRKMKWJLVIG6QPYBKJUHP54OABTVNWOC6K77CSG7LX53XWZ7EA, seg_pos={0 0}, upload=496898]: Uploading piece... Sep 22 02:46:00.424422663 (564h37m35.777207771s) [noise=true , address=45.91.116.8:4047 , piece_id=2UIEGBGYRRTTKRUKUWZYXMGAX3VBD7MXSBZ2EC3TPIMJI66IUNTQ, seg_pos={0 0}, upload=496898]: Uploading piece... Sep 22 02:46:00.424690716 (564h37m35.777475814s) [noise=true , address=145.79.227.13:4801 , piece_id=QNBHTXKWWOANAAZVLOEHRF65YQP5YKRNCC4ZK74M75DN76S2EEYA, seg_pos={0 0}, upload=496898]: Uploading piece... Sep 22 02:46:00.426331816 (564h37m35.779116924s) [noise=true , address=45.91.116.12:4226 , piece_id=DCPSTK6S46C2I5NEYWNPPCNG4E5MUK4CQWYHY4JA3EFATRL3CBDA, seg_pos={0 0}, upload=496898]: Uploading piece... Sep 22 02:46:00.427155200 (564h37m35.779940298s) [noise=true , address=77.90.31.12:4592 , piece_id=WM3UCEBMBF2Y3BTWFERHDMY3LN5FLB7MHNC6DM4SA7DJSTLIVX5A, seg_pos={0 0}, upload=496898]: Uploading piece... Sep 22 02:46:00.427857889 (564h37m35.780642997s) [noise=true , address=45.91.116.13:4153 , piece_id=ZBKNYI6W2CSPGMM4VMEVH6H2MDE7UCZFYLZ3PSRKI6EPDTAJHGIA, seg_pos={0 0}, upload=496898]: Uploading piece... Sep 22 02:46:00.428192898 (564h37m35.780978006s) [noise=true , address=145.79.227.6:4257 , piece_id=A46EJHW77IHMIIVDZX5EJQQZCIN2WS4HOIYQXGE43RVIGKIXVQSQ, seg_pos={0 0}, upload=496898]: Uploading piece... Sep 22 02:46:00.428565026 (564h37m35.781350125s) [noise=true , address=77.90.31.17:4772 , piece_id=LCLPSN3MJZQDZBZKPSZDPCM24CNN4ZK54AMWW4HZUNU26POIWC4Q, seg_pos={0 0}, upload=496898]: Uploading piece... Sep 22 02:46:00.428900165 (564h37m35.781685263s) [noise=true , address=77.90.31.13:4627 , piece_id=TSBOHH4JOXFLQT6M4ZTY4R4JMD6YLBP7MIF6H3HQJ5YGR6DUPUCQ, seg_pos={0 0}, upload=496898]: Uploading piece... Sep 22 02:46:00.501327030 (564h37m35.854112138s) [upload=496898]: Next returned nil segment Sep 22 02:46:00.501358028 (564h37m35.854143127s) [upload=496898]: Waiting for error group managing segments... Sep 22 02:46:00.509814778 (564h37m35.862599876s) [noise=true , address=45.91.116.8:4047 , piece_id=2UIEGBGYRRTTKRUKUWZYXMGAX3VBD7MXSBZ2EC3TPIMJI66IUNTQ, seg_pos={0 0}, upload=496898]: Done uploading piece. err: <nil> Sep 22 02:46:00.510249585 (564h37m35.863034682s) [noise=true , address=77.90.31.14:4661 , piece_id=3IZ5ADIY5BTEUT75HS6FNW3LALBVTNRRU6ZQM57ZR45PMOJAJZLQ, seg_pos={0 0}, upload=496898]: Done uploading piece. err: <nil> Sep 22 02:46:00.510518329 (564h37m35.863303437s) [noise=true , address=45.91.116.4:4939 , piece_id=YSIJ5WKOVEYMPPX5HS5U45EMHAXYOXECKVULH6TCQNUMUSTLG3WA, seg_pos={0 0}, upload=496898]: Done uploading piece. err: <nil> Sep 22 02:46:00.510659222 (564h37m35.86344433s) [noise=true , address=45.91.116.10:4081 , piece_id=NWCCRNBUMFCAKPXUHUBE3E5UHKDV2ILLCFQZO4VV5MKTTHCKIUYA, seg_pos={0 0}, upload=496898]: Done uploading piece. err: <nil> Sep 22 02:46:00.511049164 (564h37m35.863834262s) [noise=true , address=45.91.116.13:4153 , piece_id=ZBKNYI6W2CSPGMM4VMEVH6H2MDE7UCZFYLZ3PSRKI6EPDTAJHGIA, seg_pos={0 0}, upload=496898]: Done uploading piece. err: <nil> Sep 22 02:46:00.511064814 (564h37m35.863849922s) [noise=true , address=45.91.116.12:4226 , piece_id=DCPSTK6S46C2I5NEYWNPPCNG4E5MUK4CQWYHY4JA3EFATRL3CBDA, seg_pos={0 0}, upload=496898]: Done uploading piece. err: <nil> Sep 22 02:46:00.511447001 (564h37m35.864232099s) [noise=true , address=77.90.31.12:4592 , piece_id=WM3UCEBMBF2Y3BTWFERHDMY3LN5FLB7MHNC6DM4SA7DJSTLIVX5A, seg_pos={0 0}, upload=496898]: Done uploading piece. err: <nil> Sep 22 02:46:00.511566816 (564h37m35.864351914s) [noise=true , address=45.91.116.7:4011 , piece_id=XM7Y53GN66NEGDM3R4NPZSJX6PCYUYHLTY6UERJDXPRFMSOT3ISA, seg_pos={0 0}, upload=496898]: Done uploading piece. err: <nil> Sep 22 02:46:00.511827345 (564h37m35.864612453s) [noise=true , address=77.90.31.11:4553 , piece_id=K7OWTWW6WKOSMYYGK4R35RS6B6N65JPNICA2ROAFKOMT65I3UFSA, seg_pos={0 0}, upload=496898]: Done uploading piece. err: <nil> Sep 22 02:46:00.513383565 (564h37m35.866168673s) [noise=true , address=77.90.31.13:4627 , piece_id=TSBOHH4JOXFLQT6M4ZTY4R4JMD6YLBP7MIF6H3HQJ5YGR6DUPUCQ, seg_pos={0 0}, upload=496898]: Done uploading piece. err: <nil> Sep 22 02:46:00.516883173 (564h37m35.869668271s) [noise=true , address=77.90.31.17:4772 , piece_id=LCLPSN3MJZQDZBZKPSZDPCM24CNN4ZK54AMWW4HZUNU26POIWC4Q, seg_pos={0 0}, upload=496898]: Done uploading piece. err: <nil> Sep 22 02:46:30.383587688 (564h38m5.736372796s) [noise=true , address=145.79.227.6:4257 , piece_id=A46EJHW77IHMIIVDZX5EJQQZCIN2WS4HOIYQXGE43RVIGKIXVQSQ, seg_pos={0 0}, upload=496898]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: rpc: dial tcp 145.79.227.6:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:46:30.383624608 (564h38m5.736409705s) [noise=true , address=145.79.227.14:4837 , piece_id=NN6XBVVQEMCRNYFWETP5B5VOP3RTYVURRIYFGYTNSFYJNWOFJUAA, seg_pos={0 0}, upload=496898]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: rpc: dial tcp 145.79.227.14:4837: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:46:30.383676936 (564h38m5.736462034s) [noise=true , address=145.79.227.6:4259 , piece_id=7YU347AC2NF5576MC6XAIEHISP5PJKRUIX667OVGRTMOYWAOYKWA, seg_pos={0 0}, upload=496898]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:145.79.227.6:4259): protocol: context deadline exceeded; context deadline exceeded Sep 22 02:46:30.383686103 (564h38m5.736471201s) [noise=true , address=145.79.227.13:4801 , piece_id=QNBHTXKWWOANAAZVLOEHRF65YQP5YKRNCC4ZK74M75DN76S2EEYA, seg_pos={0 0}, upload=496898]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: rpc: dial tcp 145.79.227.13:4801: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:46:30.383721569 (564h38m5.736506668s) [noise=true , address=145.79.227.18:4005 , piece_id=JILRKMKWJLVIG6QPYBKJUHP54OABTVNWOC6K77CSG7LX53XWZ7EA, seg_pos={0 0}, upload=496898]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:46:30.383746356 (564h38m5.736531464s) [seg_pos={0 0}, upload=496898]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Sep 22 02:46:30.401305447 (564h38m5.754090555s) [upload=496898]: Done uploading segments... Sep 22 02:46:30.401319954 (564h38m5.754105062s) [upload=496898]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 30.020086601s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [.......X.XXXXXX..X..........................................] duration: 763.398375ms FAIL (2025-09-22 02:46:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 763.42249ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [..........X.X.........X.......X...X.....X.XX..XX..X.........] duration: 433.86004ms FAIL (2025-09-22 02:46:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 433.877813ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [...........X.X.........X.......X...X.....X.XX..XX..X........] duration: 636.002464ms FAIL (2025-09-22 02:45:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 636.023654ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [........X.XXXXXX..X.........................................] duration: 374.708997ms FAIL (2025-09-22 02:45:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 374.728895ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 27 out of 60 is failed (threshold=3) [.........XXX....XXX.XXXXX..X.XX.XX.XX......XX..X....XX.XXXX.] duration: 572.861827ms FAIL (2025-09-22 02:45:03 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== Sep 22 02:43:54.254110815 (564h35m29.606895943s) [upload=496869]: Starting upload Sep 22 02:43:54.254192959 (564h35m29.606978098s) [upload=496869]: Done starting upload Sep 22 02:43:54.254254685 (564h35m29.607039813s) [upload=496869]: Uploading segments... Sep 22 02:43:54.254602178 (564h35m29.607387306s) [upload=496869]: Got next segment. Inline: false Sep 22 02:43:54.254651090 (564h35m29.607436217s) [upload=496869]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:43:54.254656840 (564h35m29.607441969s) [upload=496869]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:43:54.341799679 (564h35m29.694584807s) [seg_pos={0 0}, upload=496869]: Begin upload segment... Sep 22 02:43:54.341839634 (564h35m29.694624762s) [seg_pos={0 0}, upload=496869]: Done begin upload segment. Sep 22 02:43:54.341869741 (564h35m29.694654879s) [noise=true , address=77.90.31.19:4843 , piece_id=Z7QA2HBQUITKHIX7YRYJHGVXI2VTRKCXW6VRAXFNTLGQMOT2OY5A, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.341890680 (564h35m29.694675818s) [noise=true , address=145.79.227.12:4765 , piece_id=OCG7RT3FEZTVKD4YJD3IS4BPLS6Q25HBY3IE7BSA3CBXMFD5MCRA, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.342317642 (564h35m29.69510277s) [noise=true , address=45.91.116.13:4155 , piece_id=3BYU2MGOZE7YHTEZ6HNZGCBD7GTXP2H6ALNFGFI7SMB37JOOBC3A, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.342352467 (564h35m29.695137595s) [noise=true , address=45.91.116.14:4191 , piece_id=3D2BPQKSRXKQLBLYUUBZYD5A3ASX4BDXFPFNB4CJQJU7QE4KG67A, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.342726759 (564h35m29.695511897s) [noise=true , address=145.79.227.3:4151 , piece_id=KMSYJ3VNSMXMKDHVP4PTKBOJ4OZQGZKBV3UG4YOX7NBTPUMSYPPQ, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.342839250 (564h35m29.695624378s) [noise=true , address=77.90.31.19:4842 , piece_id=MCJ5LBB7M4L6DTMJYTROIVKLGFHO7J62RNN6LVITGE3UV72NRWMA, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.343106723 (564h35m29.695891851s) [noise=true , address=145.79.227.11:4729 , piece_id=Q4PQXSN4DTM7KLSHFKUHMD6HC6CVOLXLUEHJK7N3LKVSWRU55AQA, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.343228581 (564h35m29.696013709s) [noise=true , address=145.79.227.5:4223 , piece_id=FUMP7EU6I4OBAYNFANBKXTKQQYEVVBFGVM2OQCBJODSEBNXQPPWA, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.343540216 (564h35m29.696325344s) [noise=true , address=145.79.227.16:4909 , piece_id=JW2LHIAUBDDTGXROSWIONI7MRS7NGENSFJCER5T743NCJURBCB7Q, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.343610598 (564h35m29.696395725s) [noise=true , address=145.79.227.17:4970 , piece_id=YKOE5NIB2JUBGZ2IYZAWZDCPVMSL2YM6QTHZIAZ4W4QLATAWF44A, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.343974691 (564h35m29.69675982s) [noise=true , address=45.91.116.6:4973 , piece_id=EM3DF6NLGCS7GFHHNZEBXPI7FNLKQYUPYIO6P74OFUEVZXFXKMVA, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.344009858 (564h35m29.696794985s) [noise=true , address=45.91.116.4:4940 , piece_id=Y3BMPIFGNJKK5MC5BHHWYYSNRRXAEFJMDRD5VJRPDOTIVCBI24GA, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.344348192 (564h35m29.69713332s) [noise=true , address=45.91.116.11:4119 , piece_id=BU6XYEU7D7SKXKKFH3AYYF6ZCM43BWYMAGOHU6XDVTTZZRZJ3ZKA, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.344745327 (564h35m29.697530455s) [noise=true , address=77.90.31.18:4807 , piece_id=KBWKPJ4CGKBNZSCGDM6PW75RGR3BQZXJYIDVCBP3RMWWLBGQHVSA, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.345106646 (564h35m29.697891773s) [noise=true , address=145.79.227.18:4007 , piece_id=6DVTSYOSIUHPGPD5N666F3FV2LGNAXVBXKIEFZAAA7GGI6US4ZBQ, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.345451983 (564h35m29.698237121s) [noise=true , address=45.91.116.4:4938 , piece_id=5CHZFXEWRK6XAURB4GAJSMWZEVQ76L673BX4UHMBI575KJBSDHLA, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.453417379 (564h35m29.806202507s) [upload=496869]: Next returned nil segment Sep 22 02:43:54.453446493 (564h35m29.806231622s) [upload=496869]: Waiting for error group managing segments... Sep 22 02:43:54.461278531 (564h35m29.814063659s) [noise=true , address=45.91.116.11:4119 , piece_id=BU6XYEU7D7SKXKKFH3AYYF6ZCM43BWYMAGOHU6XDVTTZZRZJ3ZKA, seg_pos={0 0}, upload=496869]: Done uploading piece. err: <nil> Sep 22 02:43:54.462099562 (564h35m29.81488469s) [noise=true , address=45.91.116.6:4973 , piece_id=EM3DF6NLGCS7GFHHNZEBXPI7FNLKQYUPYIO6P74OFUEVZXFXKMVA, seg_pos={0 0}, upload=496869]: Done uploading piece. err: <nil> Sep 22 02:43:54.462308774 (564h35m29.815093902s) [noise=true , address=45.91.116.4:4940 , piece_id=Y3BMPIFGNJKK5MC5BHHWYYSNRRXAEFJMDRD5VJRPDOTIVCBI24GA, seg_pos={0 0}, upload=496869]: Done uploading piece. err: <nil> Sep 22 02:43:54.462822568 (564h35m29.815607707s) [noise=true , address=45.91.116.13:4155 , piece_id=3BYU2MGOZE7YHTEZ6HNZGCBD7GTXP2H6ALNFGFI7SMB37JOOBC3A, seg_pos={0 0}, upload=496869]: Done uploading piece. err: <nil> Sep 22 02:43:54.463003738 (564h35m29.815788867s) [noise=true , address=45.91.116.4:4938 , piece_id=5CHZFXEWRK6XAURB4GAJSMWZEVQ76L673BX4UHMBI575KJBSDHLA, seg_pos={0 0}, upload=496869]: Done uploading piece. err: <nil> Sep 22 02:43:54.463441088 (564h35m29.816226217s) [noise=true , address=77.90.31.18:4807 , piece_id=KBWKPJ4CGKBNZSCGDM6PW75RGR3BQZXJYIDVCBP3RMWWLBGQHVSA, seg_pos={0 0}, upload=496869]: Done uploading piece. err: <nil> Sep 22 02:43:54.463606990 (564h35m29.816392118s) [noise=true , address=45.91.116.14:4191 , piece_id=3D2BPQKSRXKQLBLYUUBZYD5A3ASX4BDXFPFNB4CJQJU7QE4KG67A, seg_pos={0 0}, upload=496869]: Done uploading piece. err: <nil> Sep 22 02:43:54.464107480 (564h35m29.816892607s) [noise=true , address=77.90.31.19:4842 , piece_id=MCJ5LBB7M4L6DTMJYTROIVKLGFHO7J62RNN6LVITGE3UV72NRWMA, seg_pos={0 0}, upload=496869]: Done uploading piece. err: <nil> Sep 22 02:43:54.464479287 (564h35m29.817264415s) [noise=true , address=77.90.31.19:4843 , piece_id=Z7QA2HBQUITKHIX7YRYJHGVXI2VTRKCXW6VRAXFNTLGQMOT2OY5A, seg_pos={0 0}, upload=496869]: Done uploading piece. err: <nil> Sep 22 02:43:56.509526195 (564h35m31.862311323s) [noise=true , address=145.79.227.16:4909 , piece_id=JW2LHIAUBDDTGXROSWIONI7MRS7NGENSFJCER5T743NCJURBCB7Q, seg_pos={0 0}, upload=496869]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: rpc: dial tcp 145.79.227.16:4909: connect: no route to host; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:44:24.239132106 (564h35m59.591917204s) [noise=true , address=145.79.227.3:4151 , piece_id=KMSYJ3VNSMXMKDHVP4PTKBOJ4OZQGZKBV3UG4YOX7NBTPUMSYPPQ, seg_pos={0 0}, upload=496869]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:44:24.239175587 (564h35m59.591960695s) [noise=true , address=145.79.227.11:4729 , piece_id=Q4PQXSN4DTM7KLSHFKUHMD6HC6CVOLXLUEHJK7N3LKVSWRU55AQA, seg_pos={0 0}, upload=496869]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: rpc: dial tcp 145.79.227.11:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:44:24.239291475 (564h35m59.592076613s) [noise=true , address=145.79.227.17:4970 , piece_id=YKOE5NIB2JUBGZ2IYZAWZDCPVMSL2YM6QTHZIAZ4W4QLATAWF44A, seg_pos={0 0}, upload=496869]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: rpc: dial tcp 145.79.227.17:4970: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:44:24.239360654 (564h35m59.592145793s) [noise=true , address=145.79.227.12:4765 , piece_id=OCG7RT3FEZTVKD4YJD3IS4BPLS6Q25HBY3IE7BSA3CBXMFD5MCRA, seg_pos={0 0}, upload=496869]: Done uploading piece. err: ecclient: upload failed (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV, address:145.79.227.12:4765): protocol: rpc: dial tcp 145.79.227.12:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:44:24.239371845 (564h35m59.592156943s) [noise=true , address=145.79.227.5:4223 , piece_id=FUMP7EU6I4OBAYNFANBKXTKQQYEVVBFGVM2OQCBJODSEBNXQPPWA, seg_pos={0 0}, upload=496869]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: rpc: dial tcp 145.79.227.5:4223: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:44:24.239427370 (564h35m59.592212468s) [noise=true , address=145.79.227.18:4007 , piece_id=6DVTSYOSIUHPGPD5N666F3FV2LGNAXVBXKIEFZAAA7GGI6US4ZBQ, seg_pos={0 0}, upload=496869]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: rpc: dial tcp 145.79.227.18:4007: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:44:24.239489566 (564h35m59.592274674s) [seg_pos={0 0}, upload=496869]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Sep 22 02:44:24.252481988 (564h35m59.605267115s) [upload=496869]: Done uploading segments... Sep 22 02:44:24.252538404 (564h35m59.605323532s) [upload=496869]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 572.905619ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [............X.X.........X.......X...X.....X.XX..XX..X.......] duration: 432.168737ms FAIL (2025-09-22 02:44:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 432.190898ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [.........X.XXXXXX..X........................................] duration: 396.818519ms FAIL (2025-09-22 02:44:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 396.9261ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 27 out of 60 is failed (threshold=3) [..........XXX....XXX.XXXXX..X.XX.XX.XX......XX..X....XX.XXXX] duration: 30.015242302s FAIL (2025-09-22 02:44:24 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== Sep 22 02:43:54.254110815 (564h35m29.606895943s) [upload=496869]: Starting upload Sep 22 02:43:54.254192959 (564h35m29.606978098s) [upload=496869]: Done starting upload Sep 22 02:43:54.254254685 (564h35m29.607039813s) [upload=496869]: Uploading segments... Sep 22 02:43:54.254602178 (564h35m29.607387306s) [upload=496869]: Got next segment. Inline: false Sep 22 02:43:54.254651090 (564h35m29.607436217s) [upload=496869]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:43:54.254656840 (564h35m29.607441969s) [upload=496869]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:43:54.341799679 (564h35m29.694584807s) [seg_pos={0 0}, upload=496869]: Begin upload segment... Sep 22 02:43:54.341839634 (564h35m29.694624762s) [seg_pos={0 0}, upload=496869]: Done begin upload segment. Sep 22 02:43:54.341869741 (564h35m29.694654879s) [noise=true , address=77.90.31.19:4843 , piece_id=Z7QA2HBQUITKHIX7YRYJHGVXI2VTRKCXW6VRAXFNTLGQMOT2OY5A, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.341890680 (564h35m29.694675818s) [noise=true , address=145.79.227.12:4765 , piece_id=OCG7RT3FEZTVKD4YJD3IS4BPLS6Q25HBY3IE7BSA3CBXMFD5MCRA, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.342317642 (564h35m29.69510277s) [noise=true , address=45.91.116.13:4155 , piece_id=3BYU2MGOZE7YHTEZ6HNZGCBD7GTXP2H6ALNFGFI7SMB37JOOBC3A, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.342352467 (564h35m29.695137595s) [noise=true , address=45.91.116.14:4191 , piece_id=3D2BPQKSRXKQLBLYUUBZYD5A3ASX4BDXFPFNB4CJQJU7QE4KG67A, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.342726759 (564h35m29.695511897s) [noise=true , address=145.79.227.3:4151 , piece_id=KMSYJ3VNSMXMKDHVP4PTKBOJ4OZQGZKBV3UG4YOX7NBTPUMSYPPQ, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.342839250 (564h35m29.695624378s) [noise=true , address=77.90.31.19:4842 , piece_id=MCJ5LBB7M4L6DTMJYTROIVKLGFHO7J62RNN6LVITGE3UV72NRWMA, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.343106723 (564h35m29.695891851s) [noise=true , address=145.79.227.11:4729 , piece_id=Q4PQXSN4DTM7KLSHFKUHMD6HC6CVOLXLUEHJK7N3LKVSWRU55AQA, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.343228581 (564h35m29.696013709s) [noise=true , address=145.79.227.5:4223 , piece_id=FUMP7EU6I4OBAYNFANBKXTKQQYEVVBFGVM2OQCBJODSEBNXQPPWA, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.343540216 (564h35m29.696325344s) [noise=true , address=145.79.227.16:4909 , piece_id=JW2LHIAUBDDTGXROSWIONI7MRS7NGENSFJCER5T743NCJURBCB7Q, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.343610598 (564h35m29.696395725s) [noise=true , address=145.79.227.17:4970 , piece_id=YKOE5NIB2JUBGZ2IYZAWZDCPVMSL2YM6QTHZIAZ4W4QLATAWF44A, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.343974691 (564h35m29.69675982s) [noise=true , address=45.91.116.6:4973 , piece_id=EM3DF6NLGCS7GFHHNZEBXPI7FNLKQYUPYIO6P74OFUEVZXFXKMVA, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.344009858 (564h35m29.696794985s) [noise=true , address=45.91.116.4:4940 , piece_id=Y3BMPIFGNJKK5MC5BHHWYYSNRRXAEFJMDRD5VJRPDOTIVCBI24GA, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.344348192 (564h35m29.69713332s) [noise=true , address=45.91.116.11:4119 , piece_id=BU6XYEU7D7SKXKKFH3AYYF6ZCM43BWYMAGOHU6XDVTTZZRZJ3ZKA, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.344745327 (564h35m29.697530455s) [noise=true , address=77.90.31.18:4807 , piece_id=KBWKPJ4CGKBNZSCGDM6PW75RGR3BQZXJYIDVCBP3RMWWLBGQHVSA, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.345106646 (564h35m29.697891773s) [noise=true , address=145.79.227.18:4007 , piece_id=6DVTSYOSIUHPGPD5N666F3FV2LGNAXVBXKIEFZAAA7GGI6US4ZBQ, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.345451983 (564h35m29.698237121s) [noise=true , address=45.91.116.4:4938 , piece_id=5CHZFXEWRK6XAURB4GAJSMWZEVQ76L673BX4UHMBI575KJBSDHLA, seg_pos={0 0}, upload=496869]: Uploading piece... Sep 22 02:43:54.453417379 (564h35m29.806202507s) [upload=496869]: Next returned nil segment Sep 22 02:43:54.453446493 (564h35m29.806231622s) [upload=496869]: Waiting for error group managing segments... Sep 22 02:43:54.461278531 (564h35m29.814063659s) [noise=true , address=45.91.116.11:4119 , piece_id=BU6XYEU7D7SKXKKFH3AYYF6ZCM43BWYMAGOHU6XDVTTZZRZJ3ZKA, seg_pos={0 0}, upload=496869]: Done uploading piece. err: <nil> Sep 22 02:43:54.462099562 (564h35m29.81488469s) [noise=true , address=45.91.116.6:4973 , piece_id=EM3DF6NLGCS7GFHHNZEBXPI7FNLKQYUPYIO6P74OFUEVZXFXKMVA, seg_pos={0 0}, upload=496869]: Done uploading piece. err: <nil> Sep 22 02:43:54.462308774 (564h35m29.815093902s) [noise=true , address=45.91.116.4:4940 , piece_id=Y3BMPIFGNJKK5MC5BHHWYYSNRRXAEFJMDRD5VJRPDOTIVCBI24GA, seg_pos={0 0}, upload=496869]: Done uploading piece. err: <nil> Sep 22 02:43:54.462822568 (564h35m29.815607707s) [noise=true , address=45.91.116.13:4155 , piece_id=3BYU2MGOZE7YHTEZ6HNZGCBD7GTXP2H6ALNFGFI7SMB37JOOBC3A, seg_pos={0 0}, upload=496869]: Done uploading piece. err: <nil> Sep 22 02:43:54.463003738 (564h35m29.815788867s) [noise=true , address=45.91.116.4:4938 , piece_id=5CHZFXEWRK6XAURB4GAJSMWZEVQ76L673BX4UHMBI575KJBSDHLA, seg_pos={0 0}, upload=496869]: Done uploading piece. err: <nil> Sep 22 02:43:54.463441088 (564h35m29.816226217s) [noise=true , address=77.90.31.18:4807 , piece_id=KBWKPJ4CGKBNZSCGDM6PW75RGR3BQZXJYIDVCBP3RMWWLBGQHVSA, seg_pos={0 0}, upload=496869]: Done uploading piece. err: <nil> Sep 22 02:43:54.463606990 (564h35m29.816392118s) [noise=true , address=45.91.116.14:4191 , piece_id=3D2BPQKSRXKQLBLYUUBZYD5A3ASX4BDXFPFNB4CJQJU7QE4KG67A, seg_pos={0 0}, upload=496869]: Done uploading piece. err: <nil> Sep 22 02:43:54.464107480 (564h35m29.816892607s) [noise=true , address=77.90.31.19:4842 , piece_id=MCJ5LBB7M4L6DTMJYTROIVKLGFHO7J62RNN6LVITGE3UV72NRWMA, seg_pos={0 0}, upload=496869]: Done uploading piece. err: <nil> Sep 22 02:43:54.464479287 (564h35m29.817264415s) [noise=true , address=77.90.31.19:4843 , piece_id=Z7QA2HBQUITKHIX7YRYJHGVXI2VTRKCXW6VRAXFNTLGQMOT2OY5A, seg_pos={0 0}, upload=496869]: Done uploading piece. err: <nil> Sep 22 02:43:56.509526195 (564h35m31.862311323s) [noise=true , address=145.79.227.16:4909 , piece_id=JW2LHIAUBDDTGXROSWIONI7MRS7NGENSFJCER5T743NCJURBCB7Q, seg_pos={0 0}, upload=496869]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: rpc: dial tcp 145.79.227.16:4909: connect: no route to host; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:44:24.239132106 (564h35m59.591917204s) [noise=true , address=145.79.227.3:4151 , piece_id=KMSYJ3VNSMXMKDHVP4PTKBOJ4OZQGZKBV3UG4YOX7NBTPUMSYPPQ, seg_pos={0 0}, upload=496869]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:44:24.239175587 (564h35m59.591960695s) [noise=true , address=145.79.227.11:4729 , piece_id=Q4PQXSN4DTM7KLSHFKUHMD6HC6CVOLXLUEHJK7N3LKVSWRU55AQA, seg_pos={0 0}, upload=496869]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:145.79.227.11:4729): protocol: rpc: dial tcp 145.79.227.11:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:44:24.239291475 (564h35m59.592076613s) [noise=true , address=145.79.227.17:4970 , piece_id=YKOE5NIB2JUBGZ2IYZAWZDCPVMSL2YM6QTHZIAZ4W4QLATAWF44A, seg_pos={0 0}, upload=496869]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: rpc: dial tcp 145.79.227.17:4970: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:44:24.239360654 (564h35m59.592145793s) [noise=true , address=145.79.227.12:4765 , piece_id=OCG7RT3FEZTVKD4YJD3IS4BPLS6Q25HBY3IE7BSA3CBXMFD5MCRA, seg_pos={0 0}, upload=496869]: Done uploading piece. err: ecclient: upload failed (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV, address:145.79.227.12:4765): protocol: rpc: dial tcp 145.79.227.12:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:44:24.239371845 (564h35m59.592156943s) [noise=true , address=145.79.227.5:4223 , piece_id=FUMP7EU6I4OBAYNFANBKXTKQQYEVVBFGVM2OQCBJODSEBNXQPPWA, seg_pos={0 0}, upload=496869]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: rpc: dial tcp 145.79.227.5:4223: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:44:24.239427370 (564h35m59.592212468s) [noise=true , address=145.79.227.18:4007 , piece_id=6DVTSYOSIUHPGPD5N666F3FV2LGNAXVBXKIEFZAAA7GGI6US4ZBQ, seg_pos={0 0}, upload=496869]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: rpc: dial tcp 145.79.227.18:4007: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:44:24.239489566 (564h35m59.592274674s) [seg_pos={0 0}, upload=496869]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Sep 22 02:44:24.252481988 (564h35m59.605267115s) [upload=496869]: Done uploading segments... Sep 22 02:44:24.252538404 (564h35m59.605323532s) [upload=496869]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 30.015269052s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 26 out of 60 is failed (threshold=3) [...........XXX....XXX.XXXXX..X.XX.XX.XX......XX..X....XX.XXX] duration: 30.014235083s FAIL (2025-09-22 02:43:50 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Sep 22 02:43:20.586877069 (564h34m55.939662178s) [upload=496862]: Starting upload Sep 22 02:43:20.586925641 (564h34m55.939710749s) [upload=496862]: Done starting upload Sep 22 02:43:20.587029366 (564h34m55.939814463s) [upload=496862]: Uploading segments... Sep 22 02:43:20.587138390 (564h34m55.939923488s) [upload=496862]: Got next segment. Inline: false Sep 22 02:43:20.587167574 (564h34m55.939952682s) [upload=496862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 02:43:20.587171211 (564h34m55.939956319s) [upload=496862]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 02:43:20.611619932 (564h34m55.96440503s) [seg_pos={0 0}, upload=496862]: Begin upload segment... Sep 22 02:43:20.611654387 (564h34m55.964439485s) [seg_pos={0 0}, upload=496862]: Done begin upload segment. Sep 22 02:43:20.611680335 (564h34m55.964465443s) [noise=true , address=45.91.116.11:4119 , piece_id=46ZU23Q3GB3TUJCDY6CGITUH7EPNNJL2MN2AQIKMYZY35AJ5RINA, seg_pos={0 0}, upload=496862]: Uploading piece... Sep 22 02:43:20.611688811 (564h34m55.96447391s) [noise=true , address=145.79.227.3:4150 , piece_id=QPULP56C2ID7Q6AELGPFT5J2BTZHXU7URIQNF2T3OXAVZKAY2NKQ, seg_pos={0 0}, upload=496862]: Uploading piece... Sep 22 02:43:20.611981490 (564h34m55.964766598s) [noise=true , address=45.91.116.4:4937 , piece_id=3MKS3JR4GFONL4XUF5U6OXGRVC7ZN4UWJXKPBGXPCGL3H5AOAYQQ, seg_pos={0 0}, upload=496862]: Uploading piece... Sep 22 02:43:20.611998272 (564h34m55.96478338s) [noise=true , address=145.79.227.16:4909 , piece_id=XNEGZCZRHRP4BRLLWRZCUAU6BOFE6OFDPZH7SD5OSUMYEWOEJT5A, seg_pos={0 0}, upload=496862]: Uploading piece... Sep 22 02:43:20.612200722 (564h34m55.96498583s) [noise=true , address=77.90.31.16:4733 , piece_id=HWBSTM5HXIJGUTOTNWNTDWNBYX2VI3UXQ7KYQRHQ37HODYW54POA, seg_pos={0 0}, upload=496862]: Uploading piece... Sep 22 02:43:20.612226250 (564h34m55.965011347s) [noise=true , address=45.91.116.9:4261 , piece_id=C2TX3ILAOVWVAUKX7APXGOSAQ3ONUXA7FAA7JRC7DOBZDPB2FNMA, seg_pos={0 0}, upload=496862]: Uploading piece... Sep 22 02:43:20.612428979 (564h34m55.965214078s) [noise=true , address=45.91.116.13:4154 , piece_id=WB5623N2I4DRNGBP7P6W3WSIEPHG2NQA4AZNDAFJU6EPECKQAGCQ, seg_pos={0 0}, upload=496862]: Uploading piece... Sep 22 02:43:20.612438778 (564h34m55.965223886s) [noise=true , address=45.91.116.6:4973 , piece_id=AXOTR43U3ROOKTI26EF3KBM4J566U7SXPF2VXZEWAXI6L2MEWNBA, seg_pos={0 0}, upload=496862]: Uploading piece... Sep 22 02:43:20.612660194 (564h34m55.965445302s) [noise=true , address=145.79.227.7:4294 , piece_id=43VAQEGY2E22IRKO433ZANOTVGE2AW7V24VMY56COFISIPDUBBLA, seg_pos={0 0}, upload=496862]: Uploading piece... Sep 22 02:43:20.612678108 (564h34m55.965463216s) [noise=true , address=45.91.116.12:4226 , piece_id=E52A7N7AOEJIGYWMHQEUEKCLRMFS3CXN67ZW4OAAERBYU3I4RGDQ, seg_pos={0 0}, upload=496862]: Uploading piece... Sep 22 02:43:20.612872944 (564h34m55.965658052s) [noise=true , address=145.79.227.4:4187 , piece_id=OBLTR46VZMAQBPHEIZP5YDRIQOUOUP3NOPXPG34AU34JUOJGNFAA, seg_pos={0 0}, upload=496862]: Uploading piece... Sep 22 02:43:20.612890537 (564h34m55.965675645s) [noise=true , address=77.90.31.15:4698 , piece_id=3ADZRVP54WTJ7SQMCOTTAZ5DRQ7XENW6PEWEVV5UID3IU7KHVYDA, seg_pos={0 0}, upload=496862]: Uploading piece... Sep 22 02:43:20.613093678 (564h34m55.965878786s) [noise=true , address=77.90.31.10:4519 , piece_id=R5MYI4PLT6RNNDR3V3HPOLYKMM5FUL6FTU7IS63RCKCSBLQCEG4A, seg_pos={0 0}, upload=496862]: Uploading piece... Sep 22 02:43:20.613345209 (564h34m55.966130307s) [noise=true , address=45.91.116.5:4298 , piece_id=ZXJBDD2ESI436BPLPYCOSKNZHXF7BYZ4SYGWK6S7BY7HFD7NA4WQ, seg_pos={0 0}, upload=496862]: Uploading piece... Sep 22 02:43:20.613591472 (564h34m55.96637658s) [noise=true , address=145.79.227.4:4186 , piece_id=UKTM5A2ZNMEM4T33HL3CD6EAA2OJ2LQCM25B6PFFZXROPVWTHBXQ, seg_pos={0 0}, upload=496862]: Uploading piece... Sep 22 02:43:20.613801345 (564h34m55.966586453s) [noise=true , address=77.90.31.21:4878 , piece_id=BFAGYWUFAB6C4ZRA6AHTB2XVGZHWPAMSQFMJ3QSSNCGKTZYRW23Q, seg_pos={0 0}, upload=496862]: Uploading piece... Sep 22 02:43:20.679149246 (564h34m56.031934344s) [upload=496862]: Next returned nil segment Sep 22 02:43:20.679162431 (564h34m56.031947529s) [upload=496862]: Waiting for error group managing segments... Sep 22 02:43:20.687597299 (564h34m56.040382398s) [noise=true , address=45.91.116.6:4973 , piece_id=AXOTR43U3ROOKTI26EF3KBM4J566U7SXPF2VXZEWAXI6L2MEWNBA, seg_pos={0 0}, upload=496862]: Done uploading piece. err: <nil> Sep 22 02:43:20.687799389 (564h34m56.040584497s) [noise=true , address=45.91.116.13:4154 , piece_id=WB5623N2I4DRNGBP7P6W3WSIEPHG2NQA4AZNDAFJU6EPECKQAGCQ, seg_pos={0 0}, upload=496862]: Done uploading piece. err: <nil> Sep 22 02:43:20.687965000 (564h34m56.040750108s) [noise=true , address=45.91.116.5:4298 , piece_id=ZXJBDD2ESI436BPLPYCOSKNZHXF7BYZ4SYGWK6S7BY7HFD7NA4WQ, seg_pos={0 0}, upload=496862]: Done uploading piece. err: <nil> Sep 22 02:43:20.688173541 (564h34m56.040958639s) [noise=true , address=45.91.116.4:4937 , piece_id=3MKS3JR4GFONL4XUF5U6OXGRVC7ZN4UWJXKPBGXPCGL3H5AOAYQQ, seg_pos={0 0}, upload=496862]: Done uploading piece. err: <nil> Sep 22 02:43:20.689034006 (564h34m56.041819114s) [noise=true , address=45.91.116.12:4226 , piece_id=E52A7N7AOEJIGYWMHQEUEKCLRMFS3CXN67ZW4OAAERBYU3I4RGDQ, seg_pos={0 0}, upload=496862]: Done uploading piece. err: <nil> Sep 22 02:43:20.689403800 (564h34m56.042188897s) [noise=true , address=45.91.116.11:4119 , piece_id=46ZU23Q3GB3TUJCDY6CGITUH7EPNNJL2MN2AQIKMYZY35AJ5RINA, seg_pos={0 0}, upload=496862]: Done uploading piece. err: <nil> Sep 22 02:43:20.690310240 (564h34m56.043095339s) [noise=true , address=45.91.116.9:4261 , piece_id=C2TX3ILAOVWVAUKX7APXGOSAQ3ONUXA7FAA7JRC7DOBZDPB2FNMA, seg_pos={0 0}, upload=496862]: Done uploading piece. err: <nil> Sep 22 02:43:20.690523881 (564h34m56.043308979s) [noise=true , address=77.90.31.16:4733 , piece_id=HWBSTM5HXIJGUTOTNWNTDWNBYX2VI3UXQ7KYQRHQ37HODYW54POA, seg_pos={0 0}, upload=496862]: Done uploading piece. err: <nil> Sep 22 02:43:20.690813215 (564h34m56.043598323s) [noise=true , address=77.90.31.10:4519 , piece_id=R5MYI4PLT6RNNDR3V3HPOLYKMM5FUL6FTU7IS63RCKCSBLQCEG4A, seg_pos={0 0}, upload=496862]: Done uploading piece. err: <nil> Sep 22 02:43:20.691380549 (564h34m56.044165657s) [noise=true , address=77.90.31.21:4878 , piece_id=BFAGYWUFAB6C4ZRA6AHTB2XVGZHWPAMSQFMJ3QSSNCGKTZYRW23Q, seg_pos={0 0}, upload=496862]: Done uploading piece. err: <nil> Sep 22 02:43:20.691737099 (564h34m56.044522187s) [noise=true , address=77.90.31.15:4698 , piece_id=3ADZRVP54WTJ7SQMCOTTAZ5DRQ7XENW6PEWEVV5UID3IU7KHVYDA, seg_pos={0 0}, upload=496862]: Done uploading piece. err: <nil> Sep 22 02:43:50.573172743 (564h35m25.925957841s) [noise=true , address=145.79.227.4:4187 , piece_id=OBLTR46VZMAQBPHEIZP5YDRIQOUOUP3NOPXPG34AU34JUOJGNFAA, seg_pos={0 0}, upload=496862]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: rpc: dial tcp 145.79.227.4:4187: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:43:50.573310391 (564h35m25.926095499s) [noise=true , address=145.79.227.3:4150 , piece_id=QPULP56C2ID7Q6AELGPFT5J2BTZHXU7URIQNF2T3OXAVZKAY2NKQ, seg_pos={0 0}, upload=496862]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: rpc: dial tcp 145.79.227.3:4150: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:43:50.573348212 (564h35m25.92613331s) [noise=true , address=145.79.227.7:4294 , piece_id=43VAQEGY2E22IRKO433ZANOTVGE2AW7V24VMY56COFISIPDUBBLA, seg_pos={0 0}, upload=496862]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: rpc: dial tcp 145.79.227.7:4294: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:43:50.573358271 (564h35m25.926143379s) [noise=true , address=145.79.227.16:4909 , piece_id=XNEGZCZRHRP4BRLLWRZCUAU6BOFE6OFDPZH7SD5OSUMYEWOEJT5A, seg_pos={0 0}, upload=496862]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: rpc: dial tcp 145.79.227.16:4909: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:43:50.573401762 (564h35m25.92618687s) [noise=true , address=145.79.227.4:4186 , piece_id=UKTM5A2ZNMEM4T33HL3CD6EAA2OJ2LQCM25B6PFFZXROPVWTHBXQ, seg_pos={0 0}, upload=496862]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:43:50.573423162 (564h35m25.926208271s) [seg_pos={0 0}, upload=496862]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Sep 22 02:43:50.586389625 (564h35m25.939174733s) [upload=496862]: Done uploading segments... Sep 22 02:43:50.586403431 (564h35m25.939188529s) [upload=496862]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 30.014245713s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [..........X.XXXXXX..X.......................................] duration: 499.54863ms FAIL (2025-09-22 02:43:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== m30.954857157s) [seg_pos={0 0}, upload=496461]: Begin upload segment... Sep 22 02:15:55.602116061 (564h7m30.954901189s) [seg_pos={0 0}, upload=496461]: Done begin upload segment. Sep 22 02:15:55.602137471 (564h7m30.954922599s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602154613 (564h7m30.954939742s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602716609 (564h7m30.955501736s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.602736295 (564h7m30.955521423s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603134873 (564h7m30.955920001s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.603640462 (564h7m30.95642559s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604036745 (564h7m30.956821874s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604397323 (564h7m30.95718245s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.604828131 (564h7m30.957613268s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605250674 (564h7m30.958035802s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.605663548 (564h7m30.958448676s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606022221 (564h7m30.958807349s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606387297 (564h7m30.959172425s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.606869060 (564h7m30.959654198s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607319626 (564h7m30.960104755s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.607717662 (564h7m30.960502801s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608211139 (564h7m30.960996268s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.608652857 (564h7m30.961437986s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Uploading piece... Sep 22 02:15:55.704831022 (564h7m31.05761613s) [upload=496461]: Next returned nil segment Sep 22 02:15:55.704846542 (564h7m31.05763165s) [upload=496461]: Waiting for error group managing segments... Sep 22 02:15:55.712709156 (564h7m31.065494285s) [noise=true , address=145.79.227.24:4585 , piece_id=22SO44JH35XXWTOWZE5ZFWGOJ3BSOCUQU4FBPVNQXOMSUKMIYCUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.713081926 (564h7m31.065867054s) [noise=true , address=145.79.227.49:4340 , piece_id=IWZX454IBRQDZX2JXYMSA22AQ43QMZXTWK5UPFEW4V3N3N7GRUGA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.716351481 (564h7m31.06913661s) [noise=true , address=145.79.227.51:4421 , piece_id=HLQZRSFQIG7MP2Q2IK5FYFPCHSSRZAV7HKQX76OFMZBODRUZGZLA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717069920 (564h7m31.069855048s) [noise=true , address=77.90.31.19:4848 , piece_id=RVWFPTS4Q665OF7M3BOWO3AT7HRUDWN6GLDWVSRFJVZHXVA6GI5A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.717303427 (564h7m31.070088556s) [noise=true , address=77.90.31.11:4566 , piece_id=HNEAKRRKHSEZPZIBBSAP2CWIZK572QXGNDON7HWIFFY7227FWILA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725190529 (564h7m31.077975657s) [noise=true , address=145.79.227.39:4019 , piece_id=GT6GJEGLQXJFPHDRBLXUOEBLBB557IZJQQTIF7PWNSXTDORY3K2Q, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.725273014 (564h7m31.078058142s) [noise=true , address=145.79.227.46:4622 , piece_id=2NPEFNHQCXKLTSVFECS7V5WB37KD43JDP5XG3WCLBN4USPPX3NZA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732220611 (564h7m31.085005749s) [noise=true , address=145.79.227.48:4333 , piece_id=ZK4ZZWYUP4BBFZ27YEOTAZ3TBBOFOD2AG6YJDYGZKKDG3CFVUEUA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.732337590 (564h7m31.085122719s) [noise=true , address=145.79.227.33:4901 , piece_id=HKQVMOTQYVYMEAKGSWA4H6QCQX3ND4HC4HNWU2H3UQP2KDESMLTA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.734847580 (564h7m31.087632718s) [noise=true , address=145.79.227.23:4561 , piece_id=GLOGFOAPL3S2J52MIWATNSLAJMKURD4LNTUMEBI3UTGWLZMXU6RQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:15:55.738226892 (564h7m31.09101203s) [noise=true , address=145.79.227.38:4989 , piece_id=VDT3IWTOZEWRJ5PVM5ZEIBYXA6GJ4VMDPWCXWCSZEKF63TV6TC2A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: <nil> Sep 22 02:16:55.564886089 (564h8m30.917671218s) [noise=true , address=145.79.227.12:4790 , piece_id=UR6MYMBXBUAKFOJ2DLM276I37C7Q6WL2GPEOPWJEKOGNWGGYVEMA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1AowWwVvxzmnW5qwbqbMBVbvNoigffjAN51LQp8e6XA9CZkeXL, address:145.79.227.12:4790): protocol: rpc: dial tcp 145.79.227.12:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564944549 (564h8m30.917729677s) [noise=true , address=145.79.227.12:4769 , piece_id=HBMWIEKRPMRTRUFADPYGO6N7MAS2WD4OQMSIDIM7GLBN7QHI2KWA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.564994583 (564h8m30.917779711s) [noise=true , address=145.79.227.15:4896 , piece_id=IMRIZ6K2I7EOQVVYB2IS5IUNCPVYNIMEYUEV5HEJ6GLR7CD5RIHA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1XD8SwxzT9F6zcfBtCL6dCtBm3hyPMXgo5ooJ8oM2UL1wdnT7f, address:145.79.227.15:4896): protocol: rpc: dial tcp 145.79.227.15:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565058042 (564h8m30.91784317s) [noise=true , address=145.79.227.8:4349 , piece_id=22ZIRI6DICL7VIVMR2ASWUYA636BB6HUOBGTKLFPKWVCXVB3WUQA, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:1zywsXJnw5gfpUu7mC8p7UE7ev5HexPu5nSpUH1x2pzar99T97, address:145.79.227.8:4349): protocol: rpc: dial tcp 145.79.227.8:4349: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565089361 (564h8m30.917874489s) [noise=true , address=145.79.227.14:4847 , piece_id=3ODTMU7M6VN3UJ6MN2MVAQO64BFVHMACY7FSEXFPOEJXQ7DADKNQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i, address:145.79.227.14:4847): protocol: rpc: dial tcp 145.79.227.14:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565111382 (564h8m30.91789651s) [noise=true , address=145.79.227.2:4127 , piece_id=MSJ6AR3RALXWWBL55L6LBBO26WJBPBFUOBV6HHNWKNLJKB5O2OPQ, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12Pxos2xcjHwcYyQnXeRL3PL72G9pXaAnBs8XnkVFkxegDRPrqp, address:145.79.227.2:4127): protocol: rpc: dial tcp 145.79.227.2:4127: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565129266 (564h8m30.917914394s) [noise=true , address=145.79.227.19:4095 , piece_id=D24Y6HEC4YSP5EZEL764TLAHKAAH6MF22PA5CFFJURCV6VFBTY3A, seg_pos={0 0}, upload=496461]: Done uploading piece. err: ecclient: upload failed (node:12gs9LRE3oUp1jupCw5uDvRtkNcahbq2d4VTYQsdKr6atk6vGJx, address:145.79.227.19:4095): protocol: rpc: dial tcp 145.79.227.19:4095: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 02:16:55.565148231 (564h8m30.917933359s) [seg_pos={0 0}, upload=496461]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Sep 22 02:16:55.580701268 (564h8m30.933486366s) [upload=496461]: Done uploading segments... Sep 22 02:16:55.580714373 (564h8m30.93349947s) [upload=496461]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 499.572986ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.............X.X.........X.......X...X.....X.XX..XX..X......] duration: 727.543479ms FAIL (2025-09-22 02:43:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 727.564658ms edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)