Orbiter History

Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 111747 reports (Page 227 of 2235)

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 457.507608ms FAIL (2025-11-28 23:04:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 457.526734ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.237111027s FAIL (2025-11-28 23:04:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.237134951s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [................................X.........X......X..........] duration: 3.065706798s FAIL (2025-11-28 23:03:57 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.065722999s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 3.370724122s FAIL (2025-11-28 23:03:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.370756493s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 438.263358ms FAIL (2025-11-28 23:03:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 438.281582ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 550.634095ms FAIL (2025-11-28 23:03:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 550.65261ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................................X.........X......X.........] duration: 3.055350127s FAIL (2025-11-28 23:03:22 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.055370364s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.508726071s FAIL (2025-11-28 23:03:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.508747872s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 486.369646ms FAIL (2025-11-28 23:02:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 486.390956ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 320.800941ms FAIL (2025-11-28 23:02:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 320.941555ms edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................................X.........X......X........] duration: 2.844313916s FAIL (2025-11-28 23:02:52 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.844333923s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.670874457s FAIL (2025-11-28 23:02:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.670896659s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................................X.........X......X.......] duration: 4.029628047s FAIL (2025-11-28 23:02:25 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.029649128s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 3.279974445s FAIL (2025-11-28 23:02:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.279998391s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 381.212792ms FAIL (2025-11-28 23:02:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 381.226769ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 488.448952ms FAIL (2025-11-28 23:02:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 488.469941ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.85259393s FAIL (2025-11-28 23:01:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.85261532s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 526.958806ms FAIL (2025-11-28 23:01:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 526.978163ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................................X.........X......X......] duration: 3.095441717s FAIL (2025-11-28 23:01:22 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.095467586s core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 344.135576ms FAIL (2025-11-28 23:01:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 344.151998ms edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.986322144s FAIL (2025-11-28 23:00:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.986340828s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................................X.........X......X.....] duration: 3.63594083s FAIL (2025-11-28 23:00:55 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.635963913s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 4.23802276s FAIL (2025-11-28 23:00:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.238043128s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 367.141068ms FAIL (2025-11-28 23:00:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 367.28609ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 466.092836ms FAIL (2025-11-28 23:00:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 466.112814ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 379.003128ms FAIL (2025-11-28 23:00:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 379.022986ms edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.026339762s FAIL (2025-11-28 23:00:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.026361462s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................................X.........X......X....] duration: 2.588224678s FAIL (2025-11-28 22:59:46 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.588250686s core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 363.245673ms FAIL (2025-11-28 22:59:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 363.264628ms edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.614298143s FAIL (2025-11-28 22:59:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.614323881s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 524.078825ms FAIL (2025-11-28 22:59:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 524.097462ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m3.793050008s FAIL (2025-11-28 22:59:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.333604686 (779h45m7.034549581s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334038239 (779h45m7.034983134s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334478604 (779h45m7.035423489s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.334902039 (779h45m7.035846923s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335378582 (779h45m7.036323477s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.335794502 (779h45m7.036739387s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336219879 (779h45m7.037164774s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.336703296 (779h45m7.037648201s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337090612 (779h45m7.038035497s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.337503015 (779h45m7.03844791s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Uploading piece... Nov 28 22:58:40.782003596 (779h45m7.482948491s) [upload=686083]: Next returned nil segment Nov 28 22:58:40.782024205 (779h45m7.4829691s) [upload=686083]: Waiting for error group managing segments... Nov 28 22:58:40.968853459 (779h45m7.669798354s) [noise=true , address=185.167.204.205:4009 , piece_id=BJD24GMUQVWLTTAXPMHBRZXT665RDACHQRWNVKB4HHKOQRS3YU3A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969034238 (779h45m7.669979122s) [noise=true , address=185.167.204.205:4002 , piece_id=GBLKBRVRWUJF3B2G2T3NWHSDW3ZBTKIPA5AGDE6MX3FDPFZESITQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969225757 (779h45m7.670170652s) [noise=true , address=185.167.204.205:4029 , piece_id=BTJKS7EZI2F7E7KSWJ25IAS5VOL6VI6HWMBLAGTULWEAOFSQKXCA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.969825742 (779h45m7.670770627s) [noise=true , address=185.167.204.206:4069 , piece_id=QHOI5OUTEQWIFDVYXHTV4VZBN4EWMT2HT5FV642LP2ZJVGTF242A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.970117920 (779h45m7.671062805s) [noise=true , address=81.171.14.70:4041 , piece_id=YLTIQRVI7WGEPUD52NN4UTWPKFJJK6VKBEC3VQY2CVTZKABHYIFA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.971205448 (779h45m7.672150334s) [noise=true , address=185.167.204.206:4058 , piece_id=ANQXN4JHSWZLY6CTVM3CMUR6LHC27UE4OJVXSTNW7O2WPEZADXQQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.973311928 (779h45m7.674256813s) [noise=true , address=89.149.201.147:4006 , piece_id=BDLPZN4YICYLXU5ZGKCL6SNTSHV73SIFEHJ5EYIEOVWXIQRWGYEA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975029258 (779h45m7.675974153s) [noise=true , address=185.167.204.205:4026 , piece_id=XG45SBLVIZS4IQR46V3M23PFCJ6YK5KAWT527KNZEG57MHLWLDLA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.975667334 (779h45m7.676612229s) [noise=true , address=185.167.204.206:4048 , piece_id=GJSEMMLHBOGB3UIPU576ODIFDUCJIZNTXQCMOQ3CI33DJ6IRG5AQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.978678009 (779h45m7.679622895s) [noise=true , address=185.167.204.206:4050 , piece_id=NQKQRUGTFYQYC7BNNRNYX4CLIFBN3NCKPAQY3FZBLZY6I7ZUESNA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.984808924 (779h45m7.685753819s) [noise=true , address=185.167.204.206:4068 , piece_id=KGFSHPP4HBZK6E5SVIC462TDHL6Q7TNEPJOX7VP25JEBUQMYMR6A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.985104939 (779h45m7.686049834s) [noise=true , address=185.167.204.205:4022 , piece_id=5KF2EPH2ES2CKJFTNKJ2R4NYI7U3OD4DDMYAZSMBRKHFUBENTZKQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:40.987514928 (779h45m7.688459823s) [noise=true , address=185.167.204.205:4005 , piece_id=HIVUROV3ZIVICBQ7ZXGJFVLDB57L2HEIL3XKZ4OVQYLSEJM6C4QQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.000829422 (779h45m7.701774307s) [noise=true , address=185.167.204.206:4067 , piece_id=GKKNX7LRROSJEUQYDPMDYLBL3RCJV6QXTVWAZRJIHN5FFFVOVAHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.003293562 (779h45m7.704238467s) [noise=true , address=185.167.204.206:4071 , piece_id=VZTSQUJWTVXGLXXK3FCFDQ6DKPKN6YHEZJ5SGUUE6YC4HYVXA2JA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.008807219 (779h45m7.709752104s) [noise=true , address=89.149.201.147:4013 , piece_id=QXZCHLFFBS75E5AID3KLVGZIJC6EE5TL3OOXXYAS2GHAYR47GWRA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.011329949 (779h45m7.712274845s) [noise=true , address=185.167.204.205:4012 , piece_id=ZY4KSBPPAPVTN5K6NXFFYE3XJMUOOGX2RCKRI2CS7ZLPZQRY75VA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.012215108 (779h45m7.713160003s) [noise=true , address=185.167.204.206:4044 , piece_id=E4PPZWCOTXEO2PMUA7SEAJEDH37KSJLYMGCD65EZV74VCZELQJIA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014091136 (779h45m7.715036031s) [noise=true , address=185.167.204.206:4041 , piece_id=6YZGKJ4PEBYEBSZC3AYOFHBQD75Y4TTX6DOANQ77VMWIW6HOAJEQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.014974904 (779h45m7.715919799s) [noise=true , address=185.167.204.205:4028 , piece_id=YPC2VUYP6OU2K2CBO4RBVZCN62VTUTGLBARKZ7EVOO3O33KISFZA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.022602245 (779h45m7.72354714s) [noise=true , address=185.167.204.205:4017 , piece_id=CNGWFNDW6XFWX6U7W4QQVWW224WXZXNRLHUE2LYH4DHXH63K7DCQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.024682966 (779h45m7.725627861s) [noise=true , address=89.149.201.147:4018 , piece_id=IZNUTX4GD3VLILISM3AIDIJEDW33WKBK6KJM32CKZGZLDE4IUPQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.029699522 (779h45m7.730644407s) [noise=true , address=81.171.14.70:4042 , piece_id=BNPUBM2IKBNBBSHKHD6QQYZDVD2GGCIYGVSEOO3WZAE3P36Y4GFQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.054942019 (779h45m7.755886904s) [noise=true , address=185.167.204.206:4053 , piece_id=RNFCQME54W3K4IFVB4LGCZSSHDC7WABDPBJMM7A3KYLDSEQZBUQA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.109618094 (779h45m7.810562989s) [noise=true , address=89.149.201.147:4016 , piece_id=BEUWAIFX7IVS6E2IADFEA3ROJBY5TP372VRS37CK2W7QWHV4GM3Q, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481890353 (779h45m8.182835268s) [noise=true , address=185.167.204.206:4047 , piece_id=JZZRQH4OA7ATQX7SRCVOM26PQHGXQVZHPY7TZV7PRW4CMZUQKG5A, seg_pos={0 0}, upload=686083]: Done uploading piece. err: <nil> Nov 28 22:58:41.481926521 (779h45m8.182871436s) [seg_pos={0 0}, upload=686083]: Segment reached optimal threshold of 26 pieces. Nov 28 22:58:41.482063928 (779h45m8.183008834s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482073757 (779h45m8.183018672s) [noise=true , address=89.149.201.147:4002 , piece_id=ZN4MDDCO42UEDD6VSZ5CSCIX4TFB5HQQX4TVDZBO2QKBEZTCKEHA, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482189363 (779h45m8.183134258s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9): protocol: expected piece hash; context canceled; EOF Nov 28 22:58:41.482206996 (779h45m8.183151891s) [noise=true , address=89.149.201.147:4010 , piece_id=OVXNP7E72364TYPL7HLAC6EJRC4FO6IXJLJ6UPVN5H5UWIGXTPGQ, seg_pos={0 0}, upload=686083]: Long tail cancellation due to optimal threshold Nov 28 22:58:41.482247863 (779h45m8.183192758s) [seg_pos={0 0}, upload=686083]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 28 22:58:41.482341579 (779h45m8.183286474s) [upload=686083]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 28 22:58:41.482348242 (779h45m8.183293127s) [upload=686083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 28 22:59:38.930514200 (779h46m5.631459086s) [upload=686083]: Done uploading segments... Nov 28 22:59:38.930532254 (779h46m5.631477149s) [upload=686083]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m3.793070537s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 482.434948ms FAIL (2025-11-28 22:59:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 482.45764ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 328.135453ms FAIL (2025-11-28 22:59:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 328.156413ms edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................................X.........X......X...] duration: 5.740802228s FAIL (2025-11-28 22:59:06 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.74084068s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................................X.........X......X..] duration: 4.349401727s FAIL (2025-11-28 22:58:45 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.349428547s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 499.89345ms FAIL (2025-11-28 22:58:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 499.915091ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 360.49751ms FAIL (2025-11-28 22:58:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 360.519181ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 478.493827ms FAIL (2025-11-28 22:57:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 478.516981ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................................X.........X......X.] duration: 2.555248076s FAIL (2025-11-28 22:57:35 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.555265789s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........................................X.........X......X] duration: 46.477937133s FAIL (2025-11-28 22:57:32 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 46.477960146s core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 338.332022ms FAIL (2025-11-28 22:57:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 338.349225ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 355.401708ms FAIL (2025-11-28 22:56:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 355.422748ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 492.443662ms FAIL (2025-11-28 22:56:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 492.466986ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X.........X......] duration: 2.606638699s FAIL (2025-11-28 22:56:15 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 2.606664026s core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 397.512451ms FAIL (2025-11-28 22:56:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 397.535524ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 360.933073ms FAIL (2025-11-28 22:55:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 360.955014ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 756.589064ms FAIL (2025-11-28 22:55:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 756.606216ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................................X.........X.....] duration: 4.131729765s FAIL (2025-11-28 22:55:06 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.131785331s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 497.927551ms FAIL (2025-11-28 22:54:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 497.94343ms core uplink us-select-1 us1-placement-20

1
...
225
226
227
228
229
...
2235