Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [X.........X......X..........................................] duration: 2.656792251s FAIL (2025-11-28 23:28:11 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.656812058s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.565936823s FAIL (2025-11-28 23:27:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.565961179s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X.........X......X.........................................] duration: 2.559250573s FAIL (2025-11-28 23:27:11 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.559276351s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.530236356s FAIL (2025-11-28 23:26:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.530254821s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X.........X......X........................................] duration: 2.719678393s FAIL (2025-11-28 23:26:24 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.71969827s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X.........X......X.......................................] duration: 2.74295787s FAIL (2025-11-28 23:25:53 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.742984068s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.166160544s FAIL (2025-11-28 23:25:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.166184719s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X.........X......X......................................] duration: 2.791857356s FAIL (2025-11-28 23:24:48 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.791879678s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.553568464s FAIL (2025-11-28 23:24:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.553591317s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.595744691s FAIL (2025-11-28 23:24:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.595779496s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X.........X......X.....................................] duration: 2.626896905s FAIL (2025-11-28 23:23:43 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.626920501s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.606205674s FAIL (2025-11-28 23:23:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.606232645s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X.........X......X....................................] duration: 2.583902285s FAIL (2025-11-28 23:22:30 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.583917273s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.545440394s FAIL (2025-11-28 23:22:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.545468708s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X.........X......X...................................] duration: 2.73470536s FAIL (2025-11-28 23:21:46 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.734724626s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.152365254s FAIL (2025-11-28 23:21:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.152391454s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X.........X......X..................................] duration: 2.670299718s FAIL (2025-11-28 23:21:11 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.670320346s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X.........X......X.................................] duration: 2.803427749s FAIL (2025-11-28 23:20:26 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.803451834s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.198534509s FAIL (2025-11-28 23:20:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.198553215s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........X.........X......X................................] duration: 2.652251689s FAIL (2025-11-28 23:19:59 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.652275072s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........X.........X......X...............................] duration: 2.662150357s FAIL (2025-11-28 23:19:42 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.662169934s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.632396906s FAIL (2025-11-28 23:19:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.632415459s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [............X.........X......X..............................] duration: 2.999871579s FAIL (2025-11-28 23:18:43 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.999896345s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.642511301s FAIL (2025-11-28 23:18:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.642532842s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.64959159s FAIL (2025-11-28 23:17:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.649617127s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X.........X......X.............................] duration: 2.680170497s FAIL (2025-11-28 23:17:42 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.680191055s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X.........X......X............................] duration: 2.829876606s FAIL (2025-11-28 23:17:15 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.829895962s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.153701303s FAIL (2025-11-28 23:17:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.153725789s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 687.723649ms FAIL (2025-11-28 23:17:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 687.746613ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.231048989s FAIL (2025-11-28 23:16:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.231071411s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 504.052452ms FAIL (2025-11-28 23:16:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 504.071849ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............X.........X......X...........................] duration: 2.605332085s FAIL (2025-11-28 23:16:13 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.60535621s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.556461778s FAIL (2025-11-28 23:16:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.556482747s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 511.493254ms FAIL (2025-11-28 23:15:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 511.518472ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [................X.........X......X..........................] duration: 2.637026414s FAIL (2025-11-28 23:15:44 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.637052192s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.24068496s FAIL (2025-11-28 23:15:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.240712802s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................X.........X......X.........................] duration: 2.626580498s FAIL (2025-11-28 23:15:26 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.626606317s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 469.011556ms FAIL (2025-11-28 23:14:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 469.035311ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.568352405s FAIL (2025-11-28 23:14:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.568371921s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................X.........X......X........................] duration: 2.582064236s FAIL (2025-11-28 23:14:25 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.582088662s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.169958438s FAIL (2025-11-28 23:13:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.169979678s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 500.085665ms FAIL (2025-11-28 23:13:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 500.101905ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................X.........X......X.......................] duration: 2.848468277s FAIL (2025-11-28 23:13:34 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.848487433s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.585926236s FAIL (2025-11-28 23:13:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.585947175s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................X.........X......X......................] duration: 2.712683471s FAIL (2025-11-28 23:12:47 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.712702346s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 485.444397ms FAIL (2025-11-28 23:12:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 485.463062ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 472.768189ms FAIL (2025-11-28 23:12:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 472.985657ms edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................X.........X......X.....................] duration: 2.762302781s FAIL (2025-11-28 23:12:05 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.762318912s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.611906178s FAIL (2025-11-28 23:12:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.611925283s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 403.653937ms FAIL (2025-11-28 23:11:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 403.669556ms edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)