Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................X.....X] duration: 30.017423401s FAIL (2025-09-11 21:37:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== 4.773825809s) [upload=281332]: Starting upload Sep 11 21:37:09.421099020 (319h28m44.773884128s) [upload=281332]: Done starting upload Sep 11 21:37:09.421287414 (319h28m44.774072512s) [upload=281332]: Uploading segments... Sep 11 21:37:09.421327388 (319h28m44.774112496s) [upload=281332]: Got next segment. Inline: false Sep 11 21:37:09.421351864 (319h28m44.774136972s) [upload=281332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 21:37:09.421355561 (319h28m44.774140659s) [upload=281332]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 21:37:09.445226291 (319h28m44.798011389s) [seg_pos={0 0}, upload=281332]: Begin upload segment... Sep 11 21:37:09.445261377 (319h28m44.798046485s) [seg_pos={0 0}, upload=281332]: Done begin upload segment. Sep 11 21:37:09.445279691 (319h28m44.798064799s) [noise=true , address=45.91.116.11:4117 , piece_id=5FCPSHWBPL6VYF4H3W2HRSEXAPUVL4DPKERLUINVBC7JVPXLYQTQ, seg_pos={0 0}, upload=281332]: Uploading piece... Sep 11 21:37:09.445289319 (319h28m44.798074417s) [noise=true , address=77.90.31.14:4661 , piece_id=RYXUDK2ZC5JH3KFAF646DSSVT25S4PVLOSMJZLTELQLQA3HKVMNQ, seg_pos={0 0}, upload=281332]: Uploading piece... Sep 11 21:37:09.445345004 (319h28m44.798130112s) [noise=true , address=77.90.31.11:4554 , piece_id=SXUJLXHZRZXQQHXHJJZDDVTHUS5NDB6HI4PGTF3LDCLWLUAXPEJA, seg_pos={0 0}, upload=281332]: Uploading piece... Sep 11 21:37:09.445638133 (319h28m44.798423262s) [noise=true , address=145.79.227.16:4911 , piece_id=4DISYMF3773NPO75KCBOGSOLJY2PWTJ3L2DLAPKCHMZZ2ZNXGLOQ, seg_pos={0 0}, upload=281332]: Uploading piece... Sep 11 21:37:09.445939669 (319h28m44.798724767s) [noise=true , address=45.91.116.6:4975 , piece_id=HKC67JKAXDFASQ6DUNKVDFVZXDZ3PMT2WFNB3PVFLKLQ55QJC63A, seg_pos={0 0}, upload=281332]: Uploading piece... Sep 11 21:37:09.446226948 (319h28m44.799012046s) [noise=true , address=45.91.116.10:4083 , piece_id=TBOSPB4D5IY254SNUUEHDC3EY2VWQR53ODJCODZM5BMBY3B3TYGQ, seg_pos={0 0}, upload=281332]: Uploading piece... Sep 11 21:37:09.446508125 (319h28m44.799293233s) [noise=true , address=77.90.31.18:4806 , piece_id=BXCJSZKPMYX6HZQG77NKD7AZ2VKO26VROXUQIBK7HA2AGXL4USFQ, seg_pos={0 0}, upload=281332]: Uploading piece... Sep 11 21:37:09.446740561 (319h28m44.799525669s) [noise=true , address=45.91.116.8:4045 , piece_id=57HBU7HFWFGS7ZLXKUSPIOEULD4PO4LXLNWJGDVO6B35MBKX6HJA, seg_pos={0 0}, upload=281332]: Uploading piece... Sep 11 21:37:09.446966835 (319h28m44.799751933s) [noise=true , address=145.79.227.13:4801 , piece_id=7DQ72DQD7P62HD4FR6ZCMHOC6P5GG27FPUIV6HH3ZUR32JCS6ULQ, seg_pos={0 0}, upload=281332]: Uploading piece... Sep 11 21:37:09.447278560 (319h28m44.800063659s) [noise=true , address=45.91.116.11:4118 , piece_id=O2IQWZYMMPM5AWUVUHRHDS4DEBHRMP4WXEQ4UQP3XND4BO56CJ3Q, seg_pos={0 0}, upload=281332]: Uploading piece... Sep 11 21:37:09.447522007 (319h28m44.800307115s) [noise=true , address=45.91.116.12:4227 , piece_id=WT2ZOEMDL32PIXAFFR5FNPZGAPINLPORY6ERVLLXD3YC5IJWNOTQ, seg_pos={0 0}, upload=281332]: Uploading piece... Sep 11 21:37:09.447811470 (319h28m44.800596567s) [noise=true , address=77.90.31.16:4734 , piece_id=4DRIGRXTMI2KG5QJDHQVUQXTG72VLUCXNXNS5THCDQMHTDPXLMRQ, seg_pos={0 0}, upload=281332]: Uploading piece... Sep 11 21:37:09.448128595 (319h28m44.800913693s) [noise=true , address=45.91.116.4:4938 , piece_id=PVL754IFT7PPOW3LWXUEDYMWR34YMIUGZNV75Y5HITJBSX764MZA, seg_pos={0 0}, upload=281332]: Uploading piece... Sep 11 21:37:09.448384665 (319h28m44.801169762s) [noise=true , address=145.79.227.7:4293 , piece_id=BGYJBYFDAQNLLJF5T6F5UDF7EYUPUVMSC6UIMJE4ZP5EPHOOHZLA, seg_pos={0 0}, upload=281332]: Uploading piece... Sep 11 21:37:09.448651665 (319h28m44.801436773s) [noise=true , address=145.79.227.18:4007 , piece_id=WDE4NKOZZT6QTQQIFUKIARULNXOPFHEQCIRQXCRHAGJ3KYM2QJ4Q, seg_pos={0 0}, upload=281332]: Uploading piece... Sep 11 21:37:09.449983584 (319h28m44.802768692s) [noise=true , address=145.79.227.6:4258 , piece_id=CQA7IT2OQJBEVB5BVXTLHDJ5XRKFLIVFKRS3NSYG7YYRCI3WQR6A, seg_pos={0 0}, upload=281332]: Uploading piece... Sep 11 21:37:09.533113998 (319h28m44.885899116s) [upload=281332]: Next returned nil segment Sep 11 21:37:09.533128676 (319h28m44.885913784s) [upload=281332]: Waiting for error group managing segments... Sep 11 21:37:09.568123259 (319h28m44.920908367s) [noise=true , address=145.79.227.6:4258 , piece_id=CQA7IT2OQJBEVB5BVXTLHDJ5XRKFLIVFKRS3NSYG7YYRCI3WQR6A, seg_pos={0 0}, upload=281332]: Done uploading piece. err: <nil> Sep 11 21:37:09.568153555 (319h28m44.920938663s) [noise=true , address=145.79.227.16:4911 , piece_id=4DISYMF3773NPO75KCBOGSOLJY2PWTJ3L2DLAPKCHMZZ2ZNXGLOQ, seg_pos={0 0}, upload=281332]: Done uploading piece. err: <nil> Sep 11 21:37:09.571954676 (319h28m44.924739774s) [noise=true , address=145.79.227.7:4293 , piece_id=BGYJBYFDAQNLLJF5T6F5UDF7EYUPUVMSC6UIMJE4ZP5EPHOOHZLA, seg_pos={0 0}, upload=281332]: Done uploading piece. err: <nil> Sep 11 21:37:09.575213798 (319h28m44.927998896s) [noise=true , address=145.79.227.18:4007 , piece_id=WDE4NKOZZT6QTQQIFUKIARULNXOPFHEQCIRQXCRHAGJ3KYM2QJ4Q, seg_pos={0 0}, upload=281332]: Done uploading piece. err: <nil> Sep 11 21:37:09.813855839 (319h28m45.166640976s) [noise=true , address=145.79.227.13:4801 , piece_id=7DQ72DQD7P62HD4FR6ZCMHOC6P5GG27FPUIV6HH3ZUR32JCS6ULQ, seg_pos={0 0}, upload=281332]: Done uploading piece. err: <nil> Sep 11 21:37:33.728395490 (319h29m9.081180619s) [noise=true , address=45.91.116.4:4938 , piece_id=PVL754IFT7PPOW3LWXUEDYMWR34YMIUGZNV75Y5HITJBSX764MZA, seg_pos={0 0}, upload=281332]: Done uploading piece. err: <nil> Sep 11 21:37:36.061791094 (319h29m11.414576223s) [noise=true , address=77.90.31.11:4554 , piece_id=SXUJLXHZRZXQQHXHJJZDDVTHUS5NDB6HI4PGTF3LDCLWLUAXPEJA, seg_pos={0 0}, upload=281332]: Done uploading piece. err: <nil> Sep 11 21:37:36.872535262 (319h29m12.22532037s) [noise=true , address=45.91.116.11:4117 , piece_id=5FCPSHWBPL6VYF4H3W2HRSEXAPUVL4DPKERLUINVBC7JVPXLYQTQ, seg_pos={0 0}, upload=281332]: Done uploading piece. err: <nil> Sep 11 21:37:37.845867471 (319h29m13.1986526s) [noise=true , address=77.90.31.16:4734 , piece_id=4DRIGRXTMI2KG5QJDHQVUQXTG72VLUCXNXNS5THCDQMHTDPXLMRQ, seg_pos={0 0}, upload=281332]: Done uploading piece. err: <nil> Sep 11 21:37:39.410403452 (319h29m14.763188541s) [noise=true , address=45.91.116.10:4083 , piece_id=TBOSPB4D5IY254SNUUEHDC3EY2VWQR53ODJCODZM5BMBY3B3TYGQ, seg_pos={0 0}, upload=281332]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: rpc: dial tcp 45.91.116.10:4083: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 21:37:39.410601494 (319h29m14.763386622s) [noise=true , address=45.91.116.8:4045 , piece_id=57HBU7HFWFGS7ZLXKUSPIOEULD4PO4LXLNWJGDVO6B35MBKX6HJA, seg_pos={0 0}, upload=281332]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: rpc: dial tcp 45.91.116.8:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 21:37:39.410676635 (319h29m14.763461763s) [noise=true , address=45.91.116.11:4118 , piece_id=O2IQWZYMMPM5AWUVUHRHDS4DEBHRMP4WXEQ4UQP3XND4BO56CJ3Q, seg_pos={0 0}, upload=281332]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: rpc: dial tcp 45.91.116.11:4118: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 21:37:39.410763157 (319h29m14.763548256s) [noise=true , address=77.90.31.18:4806 , piece_id=BXCJSZKPMYX6HZQG77NKD7AZ2VKO26VROXUQIBK7HA2AGXL4USFQ, seg_pos={0 0}, upload=281332]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: rpc: dial tcp 77.90.31.18:4806: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 21:37:39.410803733 (319h29m14.763588831s) [noise=true , address=77.90.31.14:4661 , piece_id=RYXUDK2ZC5JH3KFAF646DSSVT25S4PVLOSMJZLTELQLQA3HKVMNQ, seg_pos={0 0}, upload=281332]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 5.161.89.252:48858->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 21:37:39.410841214 (319h29m14.763626311s) [noise=true , address=45.91.116.6:4975 , piece_id=HKC67JKAXDFASQ6DUNKVDFVZXDZ3PMT2WFNB3PVFLKLQ55QJC63A, seg_pos={0 0}, upload=281332]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: write tcp 5.161.89.252:14114->45.91.116.6:4975: use of closed network connection; write tcp 5.161.89.252:14114->45.91.116.6:4975: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14114->45.91.116.6:4975: use of closed network connection Sep 11 21:37:39.410868996 (319h29m14.763654124s) [noise=true , address=45.91.116.12:4227 , piece_id=WT2ZOEMDL32PIXAFFR5FNPZGAPINLPORY6ERVLLXD3YC5IJWNOTQ, seg_pos={0 0}, upload=281332]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: read tcp 5.161.89.252:60484->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 21:37:39.410913058 (319h29m14.763698187s) [seg_pos={0 0}, upload=281332]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Sep 11 21:37:39.426472130 (319h29m14.779257238s) [upload=281332]: Done uploading segments... Sep 11 21:37:39.426497006 (319h29m14.779282104s) [upload=281332]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 30.017438629s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.00077055s FAIL (2025-09-11 21:37:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000788645s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 524.185846ms FAIL (2025-09-11 21:36:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 11 21:31:49.763568967 (319h23m25.116354095s) [upload=281259]: Starting upload Sep 11 21:31:49.763661109 (319h23m25.116446238s) [upload=281259]: Done starting upload Sep 11 21:31:49.763735078 (319h23m25.116520176s) [upload=281259]: Uploading segments... Sep 11 21:31:49.764595973 (319h23m25.117381101s) [upload=281259]: Got next segment. Inline: false Sep 11 21:31:49.764753939 (319h23m25.117539078s) [upload=281259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 21:31:49.764785568 (319h23m25.117570697s) [upload=281259]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 21:31:49.787573491 (319h23m25.140358588s) [seg_pos={0 0}, upload=281259]: Begin upload segment... Sep 11 21:31:49.787609137 (319h23m25.140394245s) [seg_pos={0 0}, upload=281259]: Done begin upload segment. Sep 11 21:31:49.787629265 (319h23m25.140414373s) [noise=true , address=77.90.31.16:4733 , piece_id=GVK4ZCJSUVQR75L6FVJZTOS2UMESB4FHAUSFD6DNXEWXARVQHW3Q, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.787712080 (319h23m25.140497208s) [noise=true , address=45.91.116.7:4010 , piece_id=FRVOFAYXTXWU6QNB6BKDA2KATXZ5DQRZGVVKRT2GHPV6QJJEMEUQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.787978440 (319h23m25.140763548s) [noise=true , address=145.79.227.14:4839 , piece_id=T4ECJ4ZF3LZ6AMY3Z3NTPK6ZS7VTY47MOYJLGQ6UOH33YOXVVTCQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788203001 (319h23m25.140988129s) [noise=true , address=77.90.31.19:4843 , piece_id=DEDOJTOEGXD6SDMVHPBWI4QMPLDKFKMPBRITPAS7XEL3XCKO527A, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788230202 (319h23m25.14101531s) [noise=true , address=45.91.116.13:4154 , piece_id=F435GIGXLNAEVQS224DCGREY4IWR7CAM7ROULRNT426AHV2NCPNA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788479650 (319h23m25.141264748s) [noise=true , address=45.91.116.10:4081 , piece_id=2Q27ACDQXVTCR3ZGI6743H6LYAXIUJT5YSTPJPWN7JNK3HP7DOKQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788551514 (319h23m25.141336622s) [noise=true , address=145.79.227.4:4186 , piece_id=65THZFZVPL53JHLVJV44IG3ARATIFSYNPCCMPOGUEBEF7RTVQFAA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788762580 (319h23m25.141547679s) [noise=true , address=77.90.31.15:4699 , piece_id=G2KJHXUQFRWTH6NVQJBARPOUJPAE25VQLTNXVGPDCUPEYNKZNXLA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788773381 (319h23m25.141558489s) [noise=true , address=45.91.116.7:4011 , piece_id=HTA2IF3ZPB7LI5SZFW2W3OE4HIS2YSAML4LW34YPLMGWUDMIK4HA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788993453 (319h23m25.141778552s) [noise=true , address=45.91.116.9:4261 , piece_id=XDJUN3E66MV6C4BDVF24MXCHTYYIOECE73OFT6IWGVFKXBKQ2UTQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789001810 (319h23m25.141786907s) [noise=true , address=45.91.116.8:4047 , piece_id=2F447NN2YRRB4OPGYTW6C2QFQZLSGSHZI5MTWBOAFOPHMCISUWZA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789249133 (319h23m25.142034241s) [noise=true , address=45.91.116.4:4940 , piece_id=DBKGZXES6E2FRQM24NWNO6KQP5RV3JUCFJQXORLIGOGVUGVKC43A, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789648823 (319h23m25.142433931s) [noise=true , address=145.79.227.19:4078 , piece_id=PR5W4WT5SSJ5CV6RG7VT4I2CFINQJZH4JZH3CAPGRO6HKIBJONTQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789898982 (319h23m25.14268409s) [noise=true , address=45.91.116.5:4299 , piece_id=FQ7ADLUGRVJCXJ574PU7K2QV2VLALTF5TQYSSLZHWM52HTDWFHFA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.791044811 (319h23m25.143829909s) [noise=true , address=77.90.31.15:4697 , piece_id=HPZK5SQXBV77RBRY35HEH67AEIT4M2GNP4ANYG67Y7QT2KA7EIPA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.791467644 (319h23m25.144252752s) [noise=true , address=45.91.116.12:4226 , piece_id=S4OOZMBHUIGDDRNL2CLRXKOXJOWVRT4GAEWSKJ4ANK4TRBW7ZNXA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:50.065153534 (319h23m25.417938642s) [upload=281259]: Next returned nil segment Sep 11 21:31:50.065168852 (319h23m25.41795396s) [upload=281259]: Waiting for error group managing segments... Sep 11 21:31:50.127796859 (319h23m25.480581947s) [noise=true , address=145.79.227.4:4186 , piece_id=65THZFZVPL53JHLVJV44IG3ARATIFSYNPCCMPOGUEBEF7RTVQFAA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:31:50.179702554 (319h23m25.532487653s) [noise=true , address=145.79.227.19:4078 , piece_id=PR5W4WT5SSJ5CV6RG7VT4I2CFINQJZH4JZH3CAPGRO6HKIBJONTQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:31:50.603089075 (319h23m25.955874173s) [noise=true , address=145.79.227.14:4839 , piece_id=T4ECJ4ZF3LZ6AMY3Z3NTPK6ZS7VTY47MOYJLGQ6UOH33YOXVVTCQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:10.017998214 (319h23m45.370783342s) [noise=true , address=45.91.116.10:4081 , piece_id=2Q27ACDQXVTCR3ZGI6743H6LYAXIUJT5YSTPJPWN7JNK3HP7DOKQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:10.398533553 (319h23m45.751318661s) [noise=true , address=77.90.31.16:4733 , piece_id=GVK4ZCJSUVQR75L6FVJZTOS2UMESB4FHAUSFD6DNXEWXARVQHW3Q, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:12.360859104 (319h23m47.713644212s) [noise=true , address=45.91.116.8:4047 , piece_id=2F447NN2YRRB4OPGYTW6C2QFQZLSGSHZI5MTWBOAFOPHMCISUWZA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:12.777328662 (319h23m48.13011379s) [noise=true , address=45.91.116.4:4940 , piece_id=DBKGZXES6E2FRQM24NWNO6KQP5RV3JUCFJQXORLIGOGVUGVKC43A, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:13.106146678 (319h23m48.458931807s) [noise=true , address=77.90.31.15:4699 , piece_id=G2KJHXUQFRWTH6NVQJBARPOUJPAE25VQLTNXVGPDCUPEYNKZNXLA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:13.820440179 (319h23m49.173225307s) [noise=true , address=45.91.116.12:4226 , piece_id=S4OOZMBHUIGDDRNL2CLRXKOXJOWVRT4GAEWSKJ4ANK4TRBW7ZNXA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:14.097983724 (319h23m49.450768851s) [noise=true , address=45.91.116.7:4010 , piece_id=FRVOFAYXTXWU6QNB6BKDA2KATXZ5DQRZGVVKRT2GHPV6QJJEMEUQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:14.674987152 (319h23m50.027772249s) [noise=true , address=45.91.116.7:4011 , piece_id=HTA2IF3ZPB7LI5SZFW2W3OE4HIS2YSAML4LW34YPLMGWUDMIK4HA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:18.383992111 (319h23m53.736777209s) [noise=true , address=45.91.116.9:4261 , piece_id=XDJUN3E66MV6C4BDVF24MXCHTYYIOECE73OFT6IWGVFKXBKQ2UTQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:19.746724617 (319h23m55.099509725s) [noise=true , address=77.90.31.19:4843 , piece_id=DEDOJTOEGXD6SDMVHPBWI4QMPLDKFKMPBRITPAS7XEL3XCKO527A, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 5.161.89.252:49350->77.90.31.19:4843: use of closed network connection; write tcp 5.161.89.252:49350->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:49350->77.90.31.19:4843: use of closed network connection Sep 11 21:32:19.746752309 (319h23m55.099537417s) [noise=true , address=45.91.116.13:4154 , piece_id=F435GIGXLNAEVQS224DCGREY4IWR7CAM7ROULRNT426AHV2NCPNA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: write tcp 5.161.89.252:9106->45.91.116.13:4154: use of closed network connection; write tcp 5.161.89.252:9106->45.91.116.13:4154: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:9106->45.91.116.13:4154: use of closed network connection Sep 11 21:32:19.746775172 (319h23m55.09956028s) [noise=true , address=77.90.31.15:4697 , piece_id=HPZK5SQXBV77RBRY35HEH67AEIT4M2GNP4ANYG67Y7QT2KA7EIPA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:9194->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 21:32:19.746798015 (319h23m55.099583123s) [noise=true , address=45.91.116.5:4299 , piece_id=FQ7ADLUGRVJCXJ574PU7K2QV2VLALTF5TQYSSLZHWM52HTDWFHFA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: read tcp 5.161.89.252:9906->45.91.116.5:4299: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 21:32:19.746826989 (319h23m55.099612098s) [seg_pos={0 0}, upload=281259]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 11 21:32:19.767533767 (319h23m55.120318895s) [upload=281259]: Done uploading segments... Sep 11 21:32:19.767554436 (319h23m55.120339564s) [upload=281259]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 524.226382ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 828.059605ms FAIL (2025-09-11 21:35:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 11 21:31:49.763568967 (319h23m25.116354095s) [upload=281259]: Starting upload Sep 11 21:31:49.763661109 (319h23m25.116446238s) [upload=281259]: Done starting upload Sep 11 21:31:49.763735078 (319h23m25.116520176s) [upload=281259]: Uploading segments... Sep 11 21:31:49.764595973 (319h23m25.117381101s) [upload=281259]: Got next segment. Inline: false Sep 11 21:31:49.764753939 (319h23m25.117539078s) [upload=281259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 21:31:49.764785568 (319h23m25.117570697s) [upload=281259]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 21:31:49.787573491 (319h23m25.140358588s) [seg_pos={0 0}, upload=281259]: Begin upload segment... Sep 11 21:31:49.787609137 (319h23m25.140394245s) [seg_pos={0 0}, upload=281259]: Done begin upload segment. Sep 11 21:31:49.787629265 (319h23m25.140414373s) [noise=true , address=77.90.31.16:4733 , piece_id=GVK4ZCJSUVQR75L6FVJZTOS2UMESB4FHAUSFD6DNXEWXARVQHW3Q, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.787712080 (319h23m25.140497208s) [noise=true , address=45.91.116.7:4010 , piece_id=FRVOFAYXTXWU6QNB6BKDA2KATXZ5DQRZGVVKRT2GHPV6QJJEMEUQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.787978440 (319h23m25.140763548s) [noise=true , address=145.79.227.14:4839 , piece_id=T4ECJ4ZF3LZ6AMY3Z3NTPK6ZS7VTY47MOYJLGQ6UOH33YOXVVTCQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788203001 (319h23m25.140988129s) [noise=true , address=77.90.31.19:4843 , piece_id=DEDOJTOEGXD6SDMVHPBWI4QMPLDKFKMPBRITPAS7XEL3XCKO527A, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788230202 (319h23m25.14101531s) [noise=true , address=45.91.116.13:4154 , piece_id=F435GIGXLNAEVQS224DCGREY4IWR7CAM7ROULRNT426AHV2NCPNA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788479650 (319h23m25.141264748s) [noise=true , address=45.91.116.10:4081 , piece_id=2Q27ACDQXVTCR3ZGI6743H6LYAXIUJT5YSTPJPWN7JNK3HP7DOKQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788551514 (319h23m25.141336622s) [noise=true , address=145.79.227.4:4186 , piece_id=65THZFZVPL53JHLVJV44IG3ARATIFSYNPCCMPOGUEBEF7RTVQFAA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788762580 (319h23m25.141547679s) [noise=true , address=77.90.31.15:4699 , piece_id=G2KJHXUQFRWTH6NVQJBARPOUJPAE25VQLTNXVGPDCUPEYNKZNXLA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788773381 (319h23m25.141558489s) [noise=true , address=45.91.116.7:4011 , piece_id=HTA2IF3ZPB7LI5SZFW2W3OE4HIS2YSAML4LW34YPLMGWUDMIK4HA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788993453 (319h23m25.141778552s) [noise=true , address=45.91.116.9:4261 , piece_id=XDJUN3E66MV6C4BDVF24MXCHTYYIOECE73OFT6IWGVFKXBKQ2UTQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789001810 (319h23m25.141786907s) [noise=true , address=45.91.116.8:4047 , piece_id=2F447NN2YRRB4OPGYTW6C2QFQZLSGSHZI5MTWBOAFOPHMCISUWZA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789249133 (319h23m25.142034241s) [noise=true , address=45.91.116.4:4940 , piece_id=DBKGZXES6E2FRQM24NWNO6KQP5RV3JUCFJQXORLIGOGVUGVKC43A, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789648823 (319h23m25.142433931s) [noise=true , address=145.79.227.19:4078 , piece_id=PR5W4WT5SSJ5CV6RG7VT4I2CFINQJZH4JZH3CAPGRO6HKIBJONTQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789898982 (319h23m25.14268409s) [noise=true , address=45.91.116.5:4299 , piece_id=FQ7ADLUGRVJCXJ574PU7K2QV2VLALTF5TQYSSLZHWM52HTDWFHFA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.791044811 (319h23m25.143829909s) [noise=true , address=77.90.31.15:4697 , piece_id=HPZK5SQXBV77RBRY35HEH67AEIT4M2GNP4ANYG67Y7QT2KA7EIPA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.791467644 (319h23m25.144252752s) [noise=true , address=45.91.116.12:4226 , piece_id=S4OOZMBHUIGDDRNL2CLRXKOXJOWVRT4GAEWSKJ4ANK4TRBW7ZNXA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:50.065153534 (319h23m25.417938642s) [upload=281259]: Next returned nil segment Sep 11 21:31:50.065168852 (319h23m25.41795396s) [upload=281259]: Waiting for error group managing segments... Sep 11 21:31:50.127796859 (319h23m25.480581947s) [noise=true , address=145.79.227.4:4186 , piece_id=65THZFZVPL53JHLVJV44IG3ARATIFSYNPCCMPOGUEBEF7RTVQFAA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:31:50.179702554 (319h23m25.532487653s) [noise=true , address=145.79.227.19:4078 , piece_id=PR5W4WT5SSJ5CV6RG7VT4I2CFINQJZH4JZH3CAPGRO6HKIBJONTQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:31:50.603089075 (319h23m25.955874173s) [noise=true , address=145.79.227.14:4839 , piece_id=T4ECJ4ZF3LZ6AMY3Z3NTPK6ZS7VTY47MOYJLGQ6UOH33YOXVVTCQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:10.017998214 (319h23m45.370783342s) [noise=true , address=45.91.116.10:4081 , piece_id=2Q27ACDQXVTCR3ZGI6743H6LYAXIUJT5YSTPJPWN7JNK3HP7DOKQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:10.398533553 (319h23m45.751318661s) [noise=true , address=77.90.31.16:4733 , piece_id=GVK4ZCJSUVQR75L6FVJZTOS2UMESB4FHAUSFD6DNXEWXARVQHW3Q, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:12.360859104 (319h23m47.713644212s) [noise=true , address=45.91.116.8:4047 , piece_id=2F447NN2YRRB4OPGYTW6C2QFQZLSGSHZI5MTWBOAFOPHMCISUWZA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:12.777328662 (319h23m48.13011379s) [noise=true , address=45.91.116.4:4940 , piece_id=DBKGZXES6E2FRQM24NWNO6KQP5RV3JUCFJQXORLIGOGVUGVKC43A, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:13.106146678 (319h23m48.458931807s) [noise=true , address=77.90.31.15:4699 , piece_id=G2KJHXUQFRWTH6NVQJBARPOUJPAE25VQLTNXVGPDCUPEYNKZNXLA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:13.820440179 (319h23m49.173225307s) [noise=true , address=45.91.116.12:4226 , piece_id=S4OOZMBHUIGDDRNL2CLRXKOXJOWVRT4GAEWSKJ4ANK4TRBW7ZNXA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:14.097983724 (319h23m49.450768851s) [noise=true , address=45.91.116.7:4010 , piece_id=FRVOFAYXTXWU6QNB6BKDA2KATXZ5DQRZGVVKRT2GHPV6QJJEMEUQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:14.674987152 (319h23m50.027772249s) [noise=true , address=45.91.116.7:4011 , piece_id=HTA2IF3ZPB7LI5SZFW2W3OE4HIS2YSAML4LW34YPLMGWUDMIK4HA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:18.383992111 (319h23m53.736777209s) [noise=true , address=45.91.116.9:4261 , piece_id=XDJUN3E66MV6C4BDVF24MXCHTYYIOECE73OFT6IWGVFKXBKQ2UTQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:19.746724617 (319h23m55.099509725s) [noise=true , address=77.90.31.19:4843 , piece_id=DEDOJTOEGXD6SDMVHPBWI4QMPLDKFKMPBRITPAS7XEL3XCKO527A, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 5.161.89.252:49350->77.90.31.19:4843: use of closed network connection; write tcp 5.161.89.252:49350->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:49350->77.90.31.19:4843: use of closed network connection Sep 11 21:32:19.746752309 (319h23m55.099537417s) [noise=true , address=45.91.116.13:4154 , piece_id=F435GIGXLNAEVQS224DCGREY4IWR7CAM7ROULRNT426AHV2NCPNA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: write tcp 5.161.89.252:9106->45.91.116.13:4154: use of closed network connection; write tcp 5.161.89.252:9106->45.91.116.13:4154: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:9106->45.91.116.13:4154: use of closed network connection Sep 11 21:32:19.746775172 (319h23m55.09956028s) [noise=true , address=77.90.31.15:4697 , piece_id=HPZK5SQXBV77RBRY35HEH67AEIT4M2GNP4ANYG67Y7QT2KA7EIPA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:9194->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 21:32:19.746798015 (319h23m55.099583123s) [noise=true , address=45.91.116.5:4299 , piece_id=FQ7ADLUGRVJCXJ574PU7K2QV2VLALTF5TQYSSLZHWM52HTDWFHFA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: read tcp 5.161.89.252:9906->45.91.116.5:4299: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 21:32:19.746826989 (319h23m55.099612098s) [seg_pos={0 0}, upload=281259]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 11 21:32:19.767533767 (319h23m55.120318895s) [upload=281259]: Done uploading segments... Sep 11 21:32:19.767554436 (319h23m55.120339564s) [upload=281259]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 828.082066ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 434.985106ms FAIL (2025-09-11 21:35:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 11 21:31:49.763568967 (319h23m25.116354095s) [upload=281259]: Starting upload Sep 11 21:31:49.763661109 (319h23m25.116446238s) [upload=281259]: Done starting upload Sep 11 21:31:49.763735078 (319h23m25.116520176s) [upload=281259]: Uploading segments... Sep 11 21:31:49.764595973 (319h23m25.117381101s) [upload=281259]: Got next segment. Inline: false Sep 11 21:31:49.764753939 (319h23m25.117539078s) [upload=281259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 21:31:49.764785568 (319h23m25.117570697s) [upload=281259]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 21:31:49.787573491 (319h23m25.140358588s) [seg_pos={0 0}, upload=281259]: Begin upload segment... Sep 11 21:31:49.787609137 (319h23m25.140394245s) [seg_pos={0 0}, upload=281259]: Done begin upload segment. Sep 11 21:31:49.787629265 (319h23m25.140414373s) [noise=true , address=77.90.31.16:4733 , piece_id=GVK4ZCJSUVQR75L6FVJZTOS2UMESB4FHAUSFD6DNXEWXARVQHW3Q, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.787712080 (319h23m25.140497208s) [noise=true , address=45.91.116.7:4010 , piece_id=FRVOFAYXTXWU6QNB6BKDA2KATXZ5DQRZGVVKRT2GHPV6QJJEMEUQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.787978440 (319h23m25.140763548s) [noise=true , address=145.79.227.14:4839 , piece_id=T4ECJ4ZF3LZ6AMY3Z3NTPK6ZS7VTY47MOYJLGQ6UOH33YOXVVTCQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788203001 (319h23m25.140988129s) [noise=true , address=77.90.31.19:4843 , piece_id=DEDOJTOEGXD6SDMVHPBWI4QMPLDKFKMPBRITPAS7XEL3XCKO527A, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788230202 (319h23m25.14101531s) [noise=true , address=45.91.116.13:4154 , piece_id=F435GIGXLNAEVQS224DCGREY4IWR7CAM7ROULRNT426AHV2NCPNA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788479650 (319h23m25.141264748s) [noise=true , address=45.91.116.10:4081 , piece_id=2Q27ACDQXVTCR3ZGI6743H6LYAXIUJT5YSTPJPWN7JNK3HP7DOKQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788551514 (319h23m25.141336622s) [noise=true , address=145.79.227.4:4186 , piece_id=65THZFZVPL53JHLVJV44IG3ARATIFSYNPCCMPOGUEBEF7RTVQFAA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788762580 (319h23m25.141547679s) [noise=true , address=77.90.31.15:4699 , piece_id=G2KJHXUQFRWTH6NVQJBARPOUJPAE25VQLTNXVGPDCUPEYNKZNXLA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788773381 (319h23m25.141558489s) [noise=true , address=45.91.116.7:4011 , piece_id=HTA2IF3ZPB7LI5SZFW2W3OE4HIS2YSAML4LW34YPLMGWUDMIK4HA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788993453 (319h23m25.141778552s) [noise=true , address=45.91.116.9:4261 , piece_id=XDJUN3E66MV6C4BDVF24MXCHTYYIOECE73OFT6IWGVFKXBKQ2UTQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789001810 (319h23m25.141786907s) [noise=true , address=45.91.116.8:4047 , piece_id=2F447NN2YRRB4OPGYTW6C2QFQZLSGSHZI5MTWBOAFOPHMCISUWZA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789249133 (319h23m25.142034241s) [noise=true , address=45.91.116.4:4940 , piece_id=DBKGZXES6E2FRQM24NWNO6KQP5RV3JUCFJQXORLIGOGVUGVKC43A, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789648823 (319h23m25.142433931s) [noise=true , address=145.79.227.19:4078 , piece_id=PR5W4WT5SSJ5CV6RG7VT4I2CFINQJZH4JZH3CAPGRO6HKIBJONTQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789898982 (319h23m25.14268409s) [noise=true , address=45.91.116.5:4299 , piece_id=FQ7ADLUGRVJCXJ574PU7K2QV2VLALTF5TQYSSLZHWM52HTDWFHFA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.791044811 (319h23m25.143829909s) [noise=true , address=77.90.31.15:4697 , piece_id=HPZK5SQXBV77RBRY35HEH67AEIT4M2GNP4ANYG67Y7QT2KA7EIPA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.791467644 (319h23m25.144252752s) [noise=true , address=45.91.116.12:4226 , piece_id=S4OOZMBHUIGDDRNL2CLRXKOXJOWVRT4GAEWSKJ4ANK4TRBW7ZNXA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:50.065153534 (319h23m25.417938642s) [upload=281259]: Next returned nil segment Sep 11 21:31:50.065168852 (319h23m25.41795396s) [upload=281259]: Waiting for error group managing segments... Sep 11 21:31:50.127796859 (319h23m25.480581947s) [noise=true , address=145.79.227.4:4186 , piece_id=65THZFZVPL53JHLVJV44IG3ARATIFSYNPCCMPOGUEBEF7RTVQFAA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:31:50.179702554 (319h23m25.532487653s) [noise=true , address=145.79.227.19:4078 , piece_id=PR5W4WT5SSJ5CV6RG7VT4I2CFINQJZH4JZH3CAPGRO6HKIBJONTQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:31:50.603089075 (319h23m25.955874173s) [noise=true , address=145.79.227.14:4839 , piece_id=T4ECJ4ZF3LZ6AMY3Z3NTPK6ZS7VTY47MOYJLGQ6UOH33YOXVVTCQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:10.017998214 (319h23m45.370783342s) [noise=true , address=45.91.116.10:4081 , piece_id=2Q27ACDQXVTCR3ZGI6743H6LYAXIUJT5YSTPJPWN7JNK3HP7DOKQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:10.398533553 (319h23m45.751318661s) [noise=true , address=77.90.31.16:4733 , piece_id=GVK4ZCJSUVQR75L6FVJZTOS2UMESB4FHAUSFD6DNXEWXARVQHW3Q, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:12.360859104 (319h23m47.713644212s) [noise=true , address=45.91.116.8:4047 , piece_id=2F447NN2YRRB4OPGYTW6C2QFQZLSGSHZI5MTWBOAFOPHMCISUWZA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:12.777328662 (319h23m48.13011379s) [noise=true , address=45.91.116.4:4940 , piece_id=DBKGZXES6E2FRQM24NWNO6KQP5RV3JUCFJQXORLIGOGVUGVKC43A, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:13.106146678 (319h23m48.458931807s) [noise=true , address=77.90.31.15:4699 , piece_id=G2KJHXUQFRWTH6NVQJBARPOUJPAE25VQLTNXVGPDCUPEYNKZNXLA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:13.820440179 (319h23m49.173225307s) [noise=true , address=45.91.116.12:4226 , piece_id=S4OOZMBHUIGDDRNL2CLRXKOXJOWVRT4GAEWSKJ4ANK4TRBW7ZNXA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:14.097983724 (319h23m49.450768851s) [noise=true , address=45.91.116.7:4010 , piece_id=FRVOFAYXTXWU6QNB6BKDA2KATXZ5DQRZGVVKRT2GHPV6QJJEMEUQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:14.674987152 (319h23m50.027772249s) [noise=true , address=45.91.116.7:4011 , piece_id=HTA2IF3ZPB7LI5SZFW2W3OE4HIS2YSAML4LW34YPLMGWUDMIK4HA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:18.383992111 (319h23m53.736777209s) [noise=true , address=45.91.116.9:4261 , piece_id=XDJUN3E66MV6C4BDVF24MXCHTYYIOECE73OFT6IWGVFKXBKQ2UTQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:19.746724617 (319h23m55.099509725s) [noise=true , address=77.90.31.19:4843 , piece_id=DEDOJTOEGXD6SDMVHPBWI4QMPLDKFKMPBRITPAS7XEL3XCKO527A, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 5.161.89.252:49350->77.90.31.19:4843: use of closed network connection; write tcp 5.161.89.252:49350->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:49350->77.90.31.19:4843: use of closed network connection Sep 11 21:32:19.746752309 (319h23m55.099537417s) [noise=true , address=45.91.116.13:4154 , piece_id=F435GIGXLNAEVQS224DCGREY4IWR7CAM7ROULRNT426AHV2NCPNA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: write tcp 5.161.89.252:9106->45.91.116.13:4154: use of closed network connection; write tcp 5.161.89.252:9106->45.91.116.13:4154: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:9106->45.91.116.13:4154: use of closed network connection Sep 11 21:32:19.746775172 (319h23m55.09956028s) [noise=true , address=77.90.31.15:4697 , piece_id=HPZK5SQXBV77RBRY35HEH67AEIT4M2GNP4ANYG67Y7QT2KA7EIPA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:9194->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 21:32:19.746798015 (319h23m55.099583123s) [noise=true , address=45.91.116.5:4299 , piece_id=FQ7ADLUGRVJCXJ574PU7K2QV2VLALTF5TQYSSLZHWM52HTDWFHFA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: read tcp 5.161.89.252:9906->45.91.116.5:4299: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 21:32:19.746826989 (319h23m55.099612098s) [seg_pos={0 0}, upload=281259]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 11 21:32:19.767533767 (319h23m55.120318895s) [upload=281259]: Done uploading segments... Sep 11 21:32:19.767554436 (319h23m55.120339564s) [upload=281259]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 435.013279ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.277867013s FAIL (2025-09-11 21:34:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 11 21:31:49.763568967 (319h23m25.116354095s) [upload=281259]: Starting upload Sep 11 21:31:49.763661109 (319h23m25.116446238s) [upload=281259]: Done starting upload Sep 11 21:31:49.763735078 (319h23m25.116520176s) [upload=281259]: Uploading segments... Sep 11 21:31:49.764595973 (319h23m25.117381101s) [upload=281259]: Got next segment. Inline: false Sep 11 21:31:49.764753939 (319h23m25.117539078s) [upload=281259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 21:31:49.764785568 (319h23m25.117570697s) [upload=281259]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 21:31:49.787573491 (319h23m25.140358588s) [seg_pos={0 0}, upload=281259]: Begin upload segment... Sep 11 21:31:49.787609137 (319h23m25.140394245s) [seg_pos={0 0}, upload=281259]: Done begin upload segment. Sep 11 21:31:49.787629265 (319h23m25.140414373s) [noise=true , address=77.90.31.16:4733 , piece_id=GVK4ZCJSUVQR75L6FVJZTOS2UMESB4FHAUSFD6DNXEWXARVQHW3Q, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.787712080 (319h23m25.140497208s) [noise=true , address=45.91.116.7:4010 , piece_id=FRVOFAYXTXWU6QNB6BKDA2KATXZ5DQRZGVVKRT2GHPV6QJJEMEUQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.787978440 (319h23m25.140763548s) [noise=true , address=145.79.227.14:4839 , piece_id=T4ECJ4ZF3LZ6AMY3Z3NTPK6ZS7VTY47MOYJLGQ6UOH33YOXVVTCQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788203001 (319h23m25.140988129s) [noise=true , address=77.90.31.19:4843 , piece_id=DEDOJTOEGXD6SDMVHPBWI4QMPLDKFKMPBRITPAS7XEL3XCKO527A, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788230202 (319h23m25.14101531s) [noise=true , address=45.91.116.13:4154 , piece_id=F435GIGXLNAEVQS224DCGREY4IWR7CAM7ROULRNT426AHV2NCPNA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788479650 (319h23m25.141264748s) [noise=true , address=45.91.116.10:4081 , piece_id=2Q27ACDQXVTCR3ZGI6743H6LYAXIUJT5YSTPJPWN7JNK3HP7DOKQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788551514 (319h23m25.141336622s) [noise=true , address=145.79.227.4:4186 , piece_id=65THZFZVPL53JHLVJV44IG3ARATIFSYNPCCMPOGUEBEF7RTVQFAA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788762580 (319h23m25.141547679s) [noise=true , address=77.90.31.15:4699 , piece_id=G2KJHXUQFRWTH6NVQJBARPOUJPAE25VQLTNXVGPDCUPEYNKZNXLA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788773381 (319h23m25.141558489s) [noise=true , address=45.91.116.7:4011 , piece_id=HTA2IF3ZPB7LI5SZFW2W3OE4HIS2YSAML4LW34YPLMGWUDMIK4HA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788993453 (319h23m25.141778552s) [noise=true , address=45.91.116.9:4261 , piece_id=XDJUN3E66MV6C4BDVF24MXCHTYYIOECE73OFT6IWGVFKXBKQ2UTQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789001810 (319h23m25.141786907s) [noise=true , address=45.91.116.8:4047 , piece_id=2F447NN2YRRB4OPGYTW6C2QFQZLSGSHZI5MTWBOAFOPHMCISUWZA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789249133 (319h23m25.142034241s) [noise=true , address=45.91.116.4:4940 , piece_id=DBKGZXES6E2FRQM24NWNO6KQP5RV3JUCFJQXORLIGOGVUGVKC43A, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789648823 (319h23m25.142433931s) [noise=true , address=145.79.227.19:4078 , piece_id=PR5W4WT5SSJ5CV6RG7VT4I2CFINQJZH4JZH3CAPGRO6HKIBJONTQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789898982 (319h23m25.14268409s) [noise=true , address=45.91.116.5:4299 , piece_id=FQ7ADLUGRVJCXJ574PU7K2QV2VLALTF5TQYSSLZHWM52HTDWFHFA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.791044811 (319h23m25.143829909s) [noise=true , address=77.90.31.15:4697 , piece_id=HPZK5SQXBV77RBRY35HEH67AEIT4M2GNP4ANYG67Y7QT2KA7EIPA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.791467644 (319h23m25.144252752s) [noise=true , address=45.91.116.12:4226 , piece_id=S4OOZMBHUIGDDRNL2CLRXKOXJOWVRT4GAEWSKJ4ANK4TRBW7ZNXA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:50.065153534 (319h23m25.417938642s) [upload=281259]: Next returned nil segment Sep 11 21:31:50.065168852 (319h23m25.41795396s) [upload=281259]: Waiting for error group managing segments... Sep 11 21:31:50.127796859 (319h23m25.480581947s) [noise=true , address=145.79.227.4:4186 , piece_id=65THZFZVPL53JHLVJV44IG3ARATIFSYNPCCMPOGUEBEF7RTVQFAA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:31:50.179702554 (319h23m25.532487653s) [noise=true , address=145.79.227.19:4078 , piece_id=PR5W4WT5SSJ5CV6RG7VT4I2CFINQJZH4JZH3CAPGRO6HKIBJONTQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:31:50.603089075 (319h23m25.955874173s) [noise=true , address=145.79.227.14:4839 , piece_id=T4ECJ4ZF3LZ6AMY3Z3NTPK6ZS7VTY47MOYJLGQ6UOH33YOXVVTCQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:10.017998214 (319h23m45.370783342s) [noise=true , address=45.91.116.10:4081 , piece_id=2Q27ACDQXVTCR3ZGI6743H6LYAXIUJT5YSTPJPWN7JNK3HP7DOKQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:10.398533553 (319h23m45.751318661s) [noise=true , address=77.90.31.16:4733 , piece_id=GVK4ZCJSUVQR75L6FVJZTOS2UMESB4FHAUSFD6DNXEWXARVQHW3Q, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:12.360859104 (319h23m47.713644212s) [noise=true , address=45.91.116.8:4047 , piece_id=2F447NN2YRRB4OPGYTW6C2QFQZLSGSHZI5MTWBOAFOPHMCISUWZA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:12.777328662 (319h23m48.13011379s) [noise=true , address=45.91.116.4:4940 , piece_id=DBKGZXES6E2FRQM24NWNO6KQP5RV3JUCFJQXORLIGOGVUGVKC43A, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:13.106146678 (319h23m48.458931807s) [noise=true , address=77.90.31.15:4699 , piece_id=G2KJHXUQFRWTH6NVQJBARPOUJPAE25VQLTNXVGPDCUPEYNKZNXLA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:13.820440179 (319h23m49.173225307s) [noise=true , address=45.91.116.12:4226 , piece_id=S4OOZMBHUIGDDRNL2CLRXKOXJOWVRT4GAEWSKJ4ANK4TRBW7ZNXA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:14.097983724 (319h23m49.450768851s) [noise=true , address=45.91.116.7:4010 , piece_id=FRVOFAYXTXWU6QNB6BKDA2KATXZ5DQRZGVVKRT2GHPV6QJJEMEUQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:14.674987152 (319h23m50.027772249s) [noise=true , address=45.91.116.7:4011 , piece_id=HTA2IF3ZPB7LI5SZFW2W3OE4HIS2YSAML4LW34YPLMGWUDMIK4HA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:18.383992111 (319h23m53.736777209s) [noise=true , address=45.91.116.9:4261 , piece_id=XDJUN3E66MV6C4BDVF24MXCHTYYIOECE73OFT6IWGVFKXBKQ2UTQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:19.746724617 (319h23m55.099509725s) [noise=true , address=77.90.31.19:4843 , piece_id=DEDOJTOEGXD6SDMVHPBWI4QMPLDKFKMPBRITPAS7XEL3XCKO527A, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 5.161.89.252:49350->77.90.31.19:4843: use of closed network connection; write tcp 5.161.89.252:49350->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:49350->77.90.31.19:4843: use of closed network connection Sep 11 21:32:19.746752309 (319h23m55.099537417s) [noise=true , address=45.91.116.13:4154 , piece_id=F435GIGXLNAEVQS224DCGREY4IWR7CAM7ROULRNT426AHV2NCPNA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: write tcp 5.161.89.252:9106->45.91.116.13:4154: use of closed network connection; write tcp 5.161.89.252:9106->45.91.116.13:4154: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:9106->45.91.116.13:4154: use of closed network connection Sep 11 21:32:19.746775172 (319h23m55.09956028s) [noise=true , address=77.90.31.15:4697 , piece_id=HPZK5SQXBV77RBRY35HEH67AEIT4M2GNP4ANYG67Y7QT2KA7EIPA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:9194->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 21:32:19.746798015 (319h23m55.099583123s) [noise=true , address=45.91.116.5:4299 , piece_id=FQ7ADLUGRVJCXJ574PU7K2QV2VLALTF5TQYSSLZHWM52HTDWFHFA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: read tcp 5.161.89.252:9906->45.91.116.5:4299: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 21:32:19.746826989 (319h23m55.099612098s) [seg_pos={0 0}, upload=281259]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 11 21:32:19.767533767 (319h23m55.120318895s) [upload=281259]: Done uploading segments... Sep 11 21:32:19.767554436 (319h23m55.120339564s) [upload=281259]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.277887963s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 1.213359377s FAIL (2025-09-11 21:32:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 11 21:31:49.763568967 (319h23m25.116354095s) [upload=281259]: Starting upload Sep 11 21:31:49.763661109 (319h23m25.116446238s) [upload=281259]: Done starting upload Sep 11 21:31:49.763735078 (319h23m25.116520176s) [upload=281259]: Uploading segments... Sep 11 21:31:49.764595973 (319h23m25.117381101s) [upload=281259]: Got next segment. Inline: false Sep 11 21:31:49.764753939 (319h23m25.117539078s) [upload=281259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 21:31:49.764785568 (319h23m25.117570697s) [upload=281259]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 21:31:49.787573491 (319h23m25.140358588s) [seg_pos={0 0}, upload=281259]: Begin upload segment... Sep 11 21:31:49.787609137 (319h23m25.140394245s) [seg_pos={0 0}, upload=281259]: Done begin upload segment. Sep 11 21:31:49.787629265 (319h23m25.140414373s) [noise=true , address=77.90.31.16:4733 , piece_id=GVK4ZCJSUVQR75L6FVJZTOS2UMESB4FHAUSFD6DNXEWXARVQHW3Q, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.787712080 (319h23m25.140497208s) [noise=true , address=45.91.116.7:4010 , piece_id=FRVOFAYXTXWU6QNB6BKDA2KATXZ5DQRZGVVKRT2GHPV6QJJEMEUQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.787978440 (319h23m25.140763548s) [noise=true , address=145.79.227.14:4839 , piece_id=T4ECJ4ZF3LZ6AMY3Z3NTPK6ZS7VTY47MOYJLGQ6UOH33YOXVVTCQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788203001 (319h23m25.140988129s) [noise=true , address=77.90.31.19:4843 , piece_id=DEDOJTOEGXD6SDMVHPBWI4QMPLDKFKMPBRITPAS7XEL3XCKO527A, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788230202 (319h23m25.14101531s) [noise=true , address=45.91.116.13:4154 , piece_id=F435GIGXLNAEVQS224DCGREY4IWR7CAM7ROULRNT426AHV2NCPNA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788479650 (319h23m25.141264748s) [noise=true , address=45.91.116.10:4081 , piece_id=2Q27ACDQXVTCR3ZGI6743H6LYAXIUJT5YSTPJPWN7JNK3HP7DOKQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788551514 (319h23m25.141336622s) [noise=true , address=145.79.227.4:4186 , piece_id=65THZFZVPL53JHLVJV44IG3ARATIFSYNPCCMPOGUEBEF7RTVQFAA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788762580 (319h23m25.141547679s) [noise=true , address=77.90.31.15:4699 , piece_id=G2KJHXUQFRWTH6NVQJBARPOUJPAE25VQLTNXVGPDCUPEYNKZNXLA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788773381 (319h23m25.141558489s) [noise=true , address=45.91.116.7:4011 , piece_id=HTA2IF3ZPB7LI5SZFW2W3OE4HIS2YSAML4LW34YPLMGWUDMIK4HA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788993453 (319h23m25.141778552s) [noise=true , address=45.91.116.9:4261 , piece_id=XDJUN3E66MV6C4BDVF24MXCHTYYIOECE73OFT6IWGVFKXBKQ2UTQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789001810 (319h23m25.141786907s) [noise=true , address=45.91.116.8:4047 , piece_id=2F447NN2YRRB4OPGYTW6C2QFQZLSGSHZI5MTWBOAFOPHMCISUWZA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789249133 (319h23m25.142034241s) [noise=true , address=45.91.116.4:4940 , piece_id=DBKGZXES6E2FRQM24NWNO6KQP5RV3JUCFJQXORLIGOGVUGVKC43A, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789648823 (319h23m25.142433931s) [noise=true , address=145.79.227.19:4078 , piece_id=PR5W4WT5SSJ5CV6RG7VT4I2CFINQJZH4JZH3CAPGRO6HKIBJONTQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789898982 (319h23m25.14268409s) [noise=true , address=45.91.116.5:4299 , piece_id=FQ7ADLUGRVJCXJ574PU7K2QV2VLALTF5TQYSSLZHWM52HTDWFHFA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.791044811 (319h23m25.143829909s) [noise=true , address=77.90.31.15:4697 , piece_id=HPZK5SQXBV77RBRY35HEH67AEIT4M2GNP4ANYG67Y7QT2KA7EIPA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.791467644 (319h23m25.144252752s) [noise=true , address=45.91.116.12:4226 , piece_id=S4OOZMBHUIGDDRNL2CLRXKOXJOWVRT4GAEWSKJ4ANK4TRBW7ZNXA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:50.065153534 (319h23m25.417938642s) [upload=281259]: Next returned nil segment Sep 11 21:31:50.065168852 (319h23m25.41795396s) [upload=281259]: Waiting for error group managing segments... Sep 11 21:31:50.127796859 (319h23m25.480581947s) [noise=true , address=145.79.227.4:4186 , piece_id=65THZFZVPL53JHLVJV44IG3ARATIFSYNPCCMPOGUEBEF7RTVQFAA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:31:50.179702554 (319h23m25.532487653s) [noise=true , address=145.79.227.19:4078 , piece_id=PR5W4WT5SSJ5CV6RG7VT4I2CFINQJZH4JZH3CAPGRO6HKIBJONTQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:31:50.603089075 (319h23m25.955874173s) [noise=true , address=145.79.227.14:4839 , piece_id=T4ECJ4ZF3LZ6AMY3Z3NTPK6ZS7VTY47MOYJLGQ6UOH33YOXVVTCQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:10.017998214 (319h23m45.370783342s) [noise=true , address=45.91.116.10:4081 , piece_id=2Q27ACDQXVTCR3ZGI6743H6LYAXIUJT5YSTPJPWN7JNK3HP7DOKQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:10.398533553 (319h23m45.751318661s) [noise=true , address=77.90.31.16:4733 , piece_id=GVK4ZCJSUVQR75L6FVJZTOS2UMESB4FHAUSFD6DNXEWXARVQHW3Q, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:12.360859104 (319h23m47.713644212s) [noise=true , address=45.91.116.8:4047 , piece_id=2F447NN2YRRB4OPGYTW6C2QFQZLSGSHZI5MTWBOAFOPHMCISUWZA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:12.777328662 (319h23m48.13011379s) [noise=true , address=45.91.116.4:4940 , piece_id=DBKGZXES6E2FRQM24NWNO6KQP5RV3JUCFJQXORLIGOGVUGVKC43A, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:13.106146678 (319h23m48.458931807s) [noise=true , address=77.90.31.15:4699 , piece_id=G2KJHXUQFRWTH6NVQJBARPOUJPAE25VQLTNXVGPDCUPEYNKZNXLA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:13.820440179 (319h23m49.173225307s) [noise=true , address=45.91.116.12:4226 , piece_id=S4OOZMBHUIGDDRNL2CLRXKOXJOWVRT4GAEWSKJ4ANK4TRBW7ZNXA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:14.097983724 (319h23m49.450768851s) [noise=true , address=45.91.116.7:4010 , piece_id=FRVOFAYXTXWU6QNB6BKDA2KATXZ5DQRZGVVKRT2GHPV6QJJEMEUQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:14.674987152 (319h23m50.027772249s) [noise=true , address=45.91.116.7:4011 , piece_id=HTA2IF3ZPB7LI5SZFW2W3OE4HIS2YSAML4LW34YPLMGWUDMIK4HA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:18.383992111 (319h23m53.736777209s) [noise=true , address=45.91.116.9:4261 , piece_id=XDJUN3E66MV6C4BDVF24MXCHTYYIOECE73OFT6IWGVFKXBKQ2UTQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:19.746724617 (319h23m55.099509725s) [noise=true , address=77.90.31.19:4843 , piece_id=DEDOJTOEGXD6SDMVHPBWI4QMPLDKFKMPBRITPAS7XEL3XCKO527A, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 5.161.89.252:49350->77.90.31.19:4843: use of closed network connection; write tcp 5.161.89.252:49350->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:49350->77.90.31.19:4843: use of closed network connection Sep 11 21:32:19.746752309 (319h23m55.099537417s) [noise=true , address=45.91.116.13:4154 , piece_id=F435GIGXLNAEVQS224DCGREY4IWR7CAM7ROULRNT426AHV2NCPNA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: write tcp 5.161.89.252:9106->45.91.116.13:4154: use of closed network connection; write tcp 5.161.89.252:9106->45.91.116.13:4154: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:9106->45.91.116.13:4154: use of closed network connection Sep 11 21:32:19.746775172 (319h23m55.09956028s) [noise=true , address=77.90.31.15:4697 , piece_id=HPZK5SQXBV77RBRY35HEH67AEIT4M2GNP4ANYG67Y7QT2KA7EIPA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:9194->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 21:32:19.746798015 (319h23m55.099583123s) [noise=true , address=45.91.116.5:4299 , piece_id=FQ7ADLUGRVJCXJ574PU7K2QV2VLALTF5TQYSSLZHWM52HTDWFHFA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: read tcp 5.161.89.252:9906->45.91.116.5:4299: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 21:32:19.746826989 (319h23m55.099612098s) [seg_pos={0 0}, upload=281259]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 11 21:32:19.767533767 (319h23m55.120318895s) [upload=281259]: Done uploading segments... Sep 11 21:32:19.767554436 (319h23m55.120339564s) [upload=281259]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 1.213390706s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.022460222s FAIL (2025-09-11 21:32:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 11 21:31:49.763568967 (319h23m25.116354095s) [upload=281259]: Starting upload Sep 11 21:31:49.763661109 (319h23m25.116446238s) [upload=281259]: Done starting upload Sep 11 21:31:49.763735078 (319h23m25.116520176s) [upload=281259]: Uploading segments... Sep 11 21:31:49.764595973 (319h23m25.117381101s) [upload=281259]: Got next segment. Inline: false Sep 11 21:31:49.764753939 (319h23m25.117539078s) [upload=281259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 21:31:49.764785568 (319h23m25.117570697s) [upload=281259]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 21:31:49.787573491 (319h23m25.140358588s) [seg_pos={0 0}, upload=281259]: Begin upload segment... Sep 11 21:31:49.787609137 (319h23m25.140394245s) [seg_pos={0 0}, upload=281259]: Done begin upload segment. Sep 11 21:31:49.787629265 (319h23m25.140414373s) [noise=true , address=77.90.31.16:4733 , piece_id=GVK4ZCJSUVQR75L6FVJZTOS2UMESB4FHAUSFD6DNXEWXARVQHW3Q, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.787712080 (319h23m25.140497208s) [noise=true , address=45.91.116.7:4010 , piece_id=FRVOFAYXTXWU6QNB6BKDA2KATXZ5DQRZGVVKRT2GHPV6QJJEMEUQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.787978440 (319h23m25.140763548s) [noise=true , address=145.79.227.14:4839 , piece_id=T4ECJ4ZF3LZ6AMY3Z3NTPK6ZS7VTY47MOYJLGQ6UOH33YOXVVTCQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788203001 (319h23m25.140988129s) [noise=true , address=77.90.31.19:4843 , piece_id=DEDOJTOEGXD6SDMVHPBWI4QMPLDKFKMPBRITPAS7XEL3XCKO527A, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788230202 (319h23m25.14101531s) [noise=true , address=45.91.116.13:4154 , piece_id=F435GIGXLNAEVQS224DCGREY4IWR7CAM7ROULRNT426AHV2NCPNA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788479650 (319h23m25.141264748s) [noise=true , address=45.91.116.10:4081 , piece_id=2Q27ACDQXVTCR3ZGI6743H6LYAXIUJT5YSTPJPWN7JNK3HP7DOKQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788551514 (319h23m25.141336622s) [noise=true , address=145.79.227.4:4186 , piece_id=65THZFZVPL53JHLVJV44IG3ARATIFSYNPCCMPOGUEBEF7RTVQFAA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788762580 (319h23m25.141547679s) [noise=true , address=77.90.31.15:4699 , piece_id=G2KJHXUQFRWTH6NVQJBARPOUJPAE25VQLTNXVGPDCUPEYNKZNXLA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788773381 (319h23m25.141558489s) [noise=true , address=45.91.116.7:4011 , piece_id=HTA2IF3ZPB7LI5SZFW2W3OE4HIS2YSAML4LW34YPLMGWUDMIK4HA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.788993453 (319h23m25.141778552s) [noise=true , address=45.91.116.9:4261 , piece_id=XDJUN3E66MV6C4BDVF24MXCHTYYIOECE73OFT6IWGVFKXBKQ2UTQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789001810 (319h23m25.141786907s) [noise=true , address=45.91.116.8:4047 , piece_id=2F447NN2YRRB4OPGYTW6C2QFQZLSGSHZI5MTWBOAFOPHMCISUWZA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789249133 (319h23m25.142034241s) [noise=true , address=45.91.116.4:4940 , piece_id=DBKGZXES6E2FRQM24NWNO6KQP5RV3JUCFJQXORLIGOGVUGVKC43A, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789648823 (319h23m25.142433931s) [noise=true , address=145.79.227.19:4078 , piece_id=PR5W4WT5SSJ5CV6RG7VT4I2CFINQJZH4JZH3CAPGRO6HKIBJONTQ, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.789898982 (319h23m25.14268409s) [noise=true , address=45.91.116.5:4299 , piece_id=FQ7ADLUGRVJCXJ574PU7K2QV2VLALTF5TQYSSLZHWM52HTDWFHFA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.791044811 (319h23m25.143829909s) [noise=true , address=77.90.31.15:4697 , piece_id=HPZK5SQXBV77RBRY35HEH67AEIT4M2GNP4ANYG67Y7QT2KA7EIPA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:49.791467644 (319h23m25.144252752s) [noise=true , address=45.91.116.12:4226 , piece_id=S4OOZMBHUIGDDRNL2CLRXKOXJOWVRT4GAEWSKJ4ANK4TRBW7ZNXA, seg_pos={0 0}, upload=281259]: Uploading piece... Sep 11 21:31:50.065153534 (319h23m25.417938642s) [upload=281259]: Next returned nil segment Sep 11 21:31:50.065168852 (319h23m25.41795396s) [upload=281259]: Waiting for error group managing segments... Sep 11 21:31:50.127796859 (319h23m25.480581947s) [noise=true , address=145.79.227.4:4186 , piece_id=65THZFZVPL53JHLVJV44IG3ARATIFSYNPCCMPOGUEBEF7RTVQFAA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:31:50.179702554 (319h23m25.532487653s) [noise=true , address=145.79.227.19:4078 , piece_id=PR5W4WT5SSJ5CV6RG7VT4I2CFINQJZH4JZH3CAPGRO6HKIBJONTQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:31:50.603089075 (319h23m25.955874173s) [noise=true , address=145.79.227.14:4839 , piece_id=T4ECJ4ZF3LZ6AMY3Z3NTPK6ZS7VTY47MOYJLGQ6UOH33YOXVVTCQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:10.017998214 (319h23m45.370783342s) [noise=true , address=45.91.116.10:4081 , piece_id=2Q27ACDQXVTCR3ZGI6743H6LYAXIUJT5YSTPJPWN7JNK3HP7DOKQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:10.398533553 (319h23m45.751318661s) [noise=true , address=77.90.31.16:4733 , piece_id=GVK4ZCJSUVQR75L6FVJZTOS2UMESB4FHAUSFD6DNXEWXARVQHW3Q, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:12.360859104 (319h23m47.713644212s) [noise=true , address=45.91.116.8:4047 , piece_id=2F447NN2YRRB4OPGYTW6C2QFQZLSGSHZI5MTWBOAFOPHMCISUWZA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:12.777328662 (319h23m48.13011379s) [noise=true , address=45.91.116.4:4940 , piece_id=DBKGZXES6E2FRQM24NWNO6KQP5RV3JUCFJQXORLIGOGVUGVKC43A, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:13.106146678 (319h23m48.458931807s) [noise=true , address=77.90.31.15:4699 , piece_id=G2KJHXUQFRWTH6NVQJBARPOUJPAE25VQLTNXVGPDCUPEYNKZNXLA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:13.820440179 (319h23m49.173225307s) [noise=true , address=45.91.116.12:4226 , piece_id=S4OOZMBHUIGDDRNL2CLRXKOXJOWVRT4GAEWSKJ4ANK4TRBW7ZNXA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:14.097983724 (319h23m49.450768851s) [noise=true , address=45.91.116.7:4010 , piece_id=FRVOFAYXTXWU6QNB6BKDA2KATXZ5DQRZGVVKRT2GHPV6QJJEMEUQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:14.674987152 (319h23m50.027772249s) [noise=true , address=45.91.116.7:4011 , piece_id=HTA2IF3ZPB7LI5SZFW2W3OE4HIS2YSAML4LW34YPLMGWUDMIK4HA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:18.383992111 (319h23m53.736777209s) [noise=true , address=45.91.116.9:4261 , piece_id=XDJUN3E66MV6C4BDVF24MXCHTYYIOECE73OFT6IWGVFKXBKQ2UTQ, seg_pos={0 0}, upload=281259]: Done uploading piece. err: <nil> Sep 11 21:32:19.746724617 (319h23m55.099509725s) [noise=true , address=77.90.31.19:4843 , piece_id=DEDOJTOEGXD6SDMVHPBWI4QMPLDKFKMPBRITPAS7XEL3XCKO527A, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 5.161.89.252:49350->77.90.31.19:4843: use of closed network connection; write tcp 5.161.89.252:49350->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:49350->77.90.31.19:4843: use of closed network connection Sep 11 21:32:19.746752309 (319h23m55.099537417s) [noise=true , address=45.91.116.13:4154 , piece_id=F435GIGXLNAEVQS224DCGREY4IWR7CAM7ROULRNT426AHV2NCPNA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: write tcp 5.161.89.252:9106->45.91.116.13:4154: use of closed network connection; write tcp 5.161.89.252:9106->45.91.116.13:4154: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:9106->45.91.116.13:4154: use of closed network connection Sep 11 21:32:19.746775172 (319h23m55.09956028s) [noise=true , address=77.90.31.15:4697 , piece_id=HPZK5SQXBV77RBRY35HEH67AEIT4M2GNP4ANYG67Y7QT2KA7EIPA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:9194->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 21:32:19.746798015 (319h23m55.099583123s) [noise=true , address=45.91.116.5:4299 , piece_id=FQ7ADLUGRVJCXJ574PU7K2QV2VLALTF5TQYSSLZHWM52HTDWFHFA, seg_pos={0 0}, upload=281259]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: read tcp 5.161.89.252:9906->45.91.116.5:4299: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 21:32:19.746826989 (319h23m55.099612098s) [seg_pos={0 0}, upload=281259]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 11 21:32:19.767533767 (319h23m55.120318895s) [upload=281259]: Done uploading segments... Sep 11 21:32:19.767554436 (319h23m55.120339564s) [upload=281259]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.022567102s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 466.195037ms FAIL (2025-09-11 21:16:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 466.228489ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 785.595524ms FAIL (2025-09-11 21:15:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 785.614229ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 701.105399ms FAIL (2025-09-11 21:13:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 701.129284ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 435.968212ms FAIL (2025-09-11 21:13:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 435.990083ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 624.961204ms FAIL (2025-09-11 21:12:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 624.979027ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 763.620199ms FAIL (2025-09-11 21:11:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 763.641509ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 425.843359ms FAIL (2025-09-11 21:11:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 425.860422ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 517.117466ms FAIL (2025-09-11 21:10:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 517.135339ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 725.983036ms FAIL (2025-09-11 21:10:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 726.003976ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 437.754915ms FAIL (2025-09-11 21:09:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 437.779802ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 460.629211ms FAIL (2025-09-11 21:08:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 460.673785ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 382.501291ms FAIL (2025-09-11 21:08:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 382.531687ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 814.887321ms FAIL (2025-09-11 21:07:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 814.911377ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 456.694475ms FAIL (2025-09-11 21:06:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 456.712258ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 421.726206ms FAIL (2025-09-11 21:05:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 421.748438ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 1.006362235s FAIL (2025-09-11 21:05:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.006384006s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 499.030062ms FAIL (2025-09-11 21:04:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 499.069285ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 639.383126ms FAIL (2025-09-11 21:03:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 639.405388ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 444.240859ms FAIL (2025-09-11 21:02:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 444.264625ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.196133962s FAIL (2025-09-11 21:02:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.196157546s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 701.684274ms FAIL (2025-09-11 21:01:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 701.715102ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 634.267685ms FAIL (2025-09-11 21:01:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 634.287563ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 882.043888ms FAIL (2025-09-11 21:00:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 882.058325ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 451.32629ms FAIL (2025-09-11 20:59:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 451.348171ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 729.753255ms FAIL (2025-09-11 20:59:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 729.797347ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 730.746166ms FAIL (2025-09-11 20:58:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 730.767486ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 459.192271ms FAIL (2025-09-11 20:58:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 459.215273ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 495.348586ms FAIL (2025-09-11 20:57:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 495.399662ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 419.120155ms FAIL (2025-09-11 20:56:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 419.137476ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 532.763458ms FAIL (2025-09-11 20:56:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 532.782285ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 508.00845ms FAIL (2025-09-11 20:55:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 508.029622ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 451.136573ms FAIL (2025-09-11 20:55:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 451.155691ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 627.20529ms FAIL (2025-09-11 20:53:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 627.371274ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 902.920513ms FAIL (2025-09-11 20:53:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 902.943235ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 661.325654ms FAIL (2025-09-11 20:52:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 661.342876ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 436.715409ms FAIL (2025-09-11 20:52:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 436.735517ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 447.313ms FAIL (2025-09-11 20:51:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 447.330803ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 428.39457ms FAIL (2025-09-11 20:50:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 428.430657ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 527.864199ms FAIL (2025-09-11 20:50:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 527.914602ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 597.614644ms FAIL (2025-09-11 20:49:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 597.829841ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 911.722402ms FAIL (2025-09-11 20:48:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 911.743302ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 776.794344ms FAIL (2025-09-11 20:48:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 776.970927ms edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)