Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.746664431s
FAIL (2025-11-08 02:56:35 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.746682043s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
8 out of 60 is failed (threshold=3) [..X...X.........X........X..........X.......X......X.......X] duration:
43.702867703s
FAIL (2025-11-08 02:55:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=246132]: Uploading piece...
Nov 8 02:55:14.081443951 (279h41m40.782388877s) [noise=true , address=185.167.204.206:4072 , piece_id=H6ICCDXB6VBYMBRDXHO5VAYFP6JQF6HKCEH6JSBBX2F5S3RSEXPA, seg_pos={0 0}, upload=246132]: Uploading piece...
Nov 8 02:55:14.082161017 (279h41m40.783105952s) [noise=true , address=185.167.204.205:4005 , piece_id=VNT33BUFF6CQZELI5L7CYXMZAISKUGWHXJSWHEBOTDX5CQXN62AQ, seg_pos={0 0}, upload=246132]: Uploading piece...
Nov 8 02:55:14.083139493 (279h41m40.784084419s) [noise=true , address=89.149.201.147:4005 , piece_id=A2CEPWHQ5KLQUNLZLSX2R7JLIZUOGZVT54ONK4O6FWQJPYWXLQ5Q, seg_pos={0 0}, upload=246132]: Uploading piece...
Nov 8 02:55:14.083895893 (279h41m40.784840808s) [noise=true , address=89.149.201.147:4002 , piece_id=NZ7HT2XC4FX2R4VG45SRT6J4GTQSAIIJV5DUKOWBDXVQ7YHW27RQ, seg_pos={0 0}, upload=246132]: Uploading piece...
Nov 8 02:55:14.084808876 (279h41m40.785753801s) [noise=true , address=185.167.204.205:4031 , piece_id=SRTTAKM4WE76PUOPB2HRDPDCZMPVTTS7WFXCNLAZLAYYOTJQTDHA, seg_pos={0 0}, upload=246132]: Uploading piece...
Nov 8 02:55:14.085840983 (279h41m40.786785898s) [noise=true , address=89.149.201.147:4003 , piece_id=7WOP3NT7SBU6BRDE4PEC57GFLYUTNHUNQAUEDSGAW4J7UIY5ABCA, seg_pos={0 0}, upload=246132]: Uploading piece...
Nov 8 02:55:14.086693152 (279h41m40.787638158s) [noise=true , address=81.171.14.70:4034 , piece_id=H3FRHPGPUMFXDCP2LXCCNEJDOPU2PSQ7HAUGHSI542MBH6O67MNA, seg_pos={0 0}, upload=246132]: Uploading piece...
Nov 8 02:55:14.087724007 (279h41m40.788668932s) [noise=true , address=81.171.14.70:4036 , piece_id=SO6B4PSLYRZSBIADJUGMGYNZP24KTWFUPQYXHG42V5BVWGNTWHWA, seg_pos={0 0}, upload=246132]: Uploading piece...
Nov 8 02:55:14.088488391 (279h41m40.789433305s) [noise=true , address=81.171.14.70:4032 , piece_id=D5ENMOUIZFP2MZ2QXAOINGRUMDYNZ7PQKBY5XCEMTZ2RDHD6FVGA, seg_pos={0 0}, upload=246132]: Uploading piece...
Nov 8 02:55:14.089694785 (279h41m40.79063971s) [noise=true , address=185.167.204.206:4062 , piece_id=73WGCZWRFPJ7LQ4W7VHX7MDEI2MW4C3XCOAMQ3D47724GAFB5AUA, seg_pos={0 0}, upload=246132]: Uploading piece...
Nov 8 02:55:14.599552412 (279h41m41.300497327s) [upload=246132]: Next returned nil segment
Nov 8 02:55:14.599568102 (279h41m41.300513016s) [upload=246132]: Waiting for error group managing segments...
Nov 8 02:55:14.804612355 (279h41m41.50555726s) [noise=true , address=89.149.201.147:4022 , piece_id=DNS7FLN52CDZP2ZTUALF3F5ZTAWZUMOHJFFJCUFVVNFJRAWKNDMQ, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:14.817166193 (279h41m41.518111107s) [noise=true , address=185.167.204.205:4006 , piece_id=JRSCURMEB7AGIB4LHETCRG364K46WP6NC3QYCVD45U7DVPPBGATQ, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:14.821476953 (279h41m41.522421867s) [noise=true , address=185.167.204.206:4057 , piece_id=MXRFJSFN7FP2CPWV32V4CWWHCPFN5FS3J24D64FAEG4JL7CX2R2Q, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:14.878236263 (279h41m41.579181188s) [noise=true , address=89.149.201.147:4003 , piece_id=7WOP3NT7SBU6BRDE4PEC57GFLYUTNHUNQAUEDSGAW4J7UIY5ABCA, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:15.138235011 (279h41m41.839179896s) [noise=true , address=89.149.201.147:4006 , piece_id=KEAVKXUKVEDJCGQRMZTPCAAAOV22PBAYU5QRYTLSVD5E7F7B427Q, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:15.145495315 (279h41m41.8464402s) [noise=true , address=89.149.201.147:4008 , piece_id=6PFHI3XWRGZMARYYQB4LNL6J46OBRCCC6MUU5TJXQCDZNKIU5IDQ, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:15.235958002 (279h41m41.936902897s) [noise=true , address=185.167.204.205:4019 , piece_id=WUHFQNSID2J7LPBJQATCIZFGILWYF2H2O6AFCAMX52RJ5H3T77YQ, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:15.238465467 (279h41m41.939410352s) [noise=true , address=81.171.14.70:4037 , piece_id=OC4HKKVBDM667N6TVSOWMW5PZYLMLU4DTENJZBGO5FQIGMN5OYTQ, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:15.249982038 (279h41m41.950926943s) [noise=true , address=81.171.14.70:4034 , piece_id=H3FRHPGPUMFXDCP2LXCCNEJDOPU2PSQ7HAUGHSI542MBH6O67MNA, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:15.275385168 (279h41m41.976330053s) [noise=true , address=81.171.14.70:4045 , piece_id=DYNQ2VZLR7MGK5DHR73OTUBDI6BLHRPTERYWATH5FSMETN2QDWIA, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:15.288334088 (279h41m41.989278992s) [noise=true , address=185.167.204.205:4030 , piece_id=AA2KG6MBY2QJPPXAPSLQ7FMJHXHCJGEYM5OQY7AASHOEB3G7WBIQ, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:15.343605365 (279h41m42.04455027s) [noise=true , address=185.167.204.205:4018 , piece_id=KDDPNGEWWPNP3XZLUTBN4POMWVXF5SZITXE634HJHHRMSXFS6EGA, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:15.379669662 (279h41m42.080614567s) [noise=true , address=89.149.201.147:4018 , piece_id=HGR3OZFCC2VJWFOO3IDZ2EZ3AMX77QNYDLDGTL74SV75W6UDL36Q, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:15.413034071 (279h41m42.113978995s) [noise=true , address=81.171.14.70:4029 , piece_id=IRXWF3JLZCHMXDFDGUTVA7IIBKIZ7DKTF62Y2JCFNA2WFGCV4C2Q, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:15.450625944 (279h41m42.151570858s) [noise=true , address=185.167.204.205:4014 , piece_id=XAHULMZEL6SJLIGGKYPWHFQ6G42RUXN6EIPSVEKWM4HIHGLYRR7A, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:15.460789516 (279h41m42.161734431s) [noise=true , address=185.167.204.206:4041 , piece_id=KLBLNTCRZ227IEXAGVS5JYLQJUWYXDQ4NSTQGTJ6LAPCOS3MHX7Q, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:15.528970671 (279h41m42.229915586s) [noise=true , address=185.167.204.205:4022 , piece_id=FDT5VVM362JTG5NRH6OV6Q42LLVQADVNNOPO3AF5IA3LYEPAQJWA, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:15.665654553 (279h41m42.366599469s) [noise=true , address=81.171.14.70:4039 , piece_id=HMHSTPEVGPE734MQPPF2HR2MGGUZSLERE3YNSYEZXQM3EYI3UIFQ, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:15.723761813 (279h41m42.424706708s) [noise=true , address=89.149.201.147:4002 , piece_id=NZ7HT2XC4FX2R4VG45SRT6J4GTQSAIIJV5DUKOWBDXVQ7YHW27RQ, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:15.751660647 (279h41m42.452605542s) [noise=true , address=89.149.201.147:4009 , piece_id=ANDBRC4RIDM22WRCSHZ7L7DXCS6JHLBMAQC6NUCZMRKNXQ6GWQFA, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:15.801906234 (279h41m42.502851129s) [noise=true , address=185.167.204.206:4062 , piece_id=73WGCZWRFPJ7LQ4W7VHX7MDEI2MW4C3XCOAMQ3D47724GAFB5AUA, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:15.831928271 (279h41m42.532873156s) [noise=true , address=81.171.14.70:4048 , piece_id=CZLVUWLL6KDDHWU34AEZZP7AJPN7K4YDQPZW76SUUWR4R7OHNACA, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:16.079318619 (279h41m42.780263534s) [noise=true , address=81.171.14.70:4036 , piece_id=SO6B4PSLYRZSBIADJUGMGYNZP24KTWFUPQYXHG42V5BVWGNTWHWA, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:16.265614049 (279h41m42.966558944s) [noise=true , address=89.149.201.147:4005 , piece_id=A2CEPWHQ5KLQUNLZLSX2R7JLIZUOGZVT54ONK4O6FWQJPYWXLQ5Q, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:16.545491749 (279h41m43.246436625s) [noise=true , address=81.171.14.70:4032 , piece_id=D5ENMOUIZFP2MZ2QXAOINGRUMDYNZ7PQKBY5XCEMTZ2RDHD6FVGA, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:16.734033676 (279h41m43.434978571s) [noise=true , address=185.167.204.205:4031 , piece_id=SRTTAKM4WE76PUOPB2HRDPDCZMPVTTS7WFXCNLAZLAYYOTJQTDHA, seg_pos={0 0}, upload=246132]: Done uploading piece. err: <nil>
Nov 8 02:55:16.734047502 (279h41m43.434992397s) [seg_pos={0 0}, upload=246132]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:55:16.734121441 (279h41m43.435066336s) [noise=true , address=185.167.204.205:4005 , piece_id=VNT33BUFF6CQZELI5L7CYXMZAISKUGWHXJSWHEBOTDX5CQXN62AQ, seg_pos={0 0}, upload=246132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B18LegNdvxjRqBgwnFB4Aig1nt5URm9Au7bWXsfbBPyCnterM): protocol: expected piece hash; context canceled; EOF
Nov 8 02:55:16.734126570 (279h41m43.435071456s) [noise=true , address=185.167.204.205:4005 , piece_id=VNT33BUFF6CQZELI5L7CYXMZAISKUGWHXJSWHEBOTDX5CQXN62AQ, seg_pos={0 0}, upload=246132]: Long tail cancellation due to optimal threshold
Nov 8 02:55:16.734201801 (279h41m43.435146696s) [noise=true , address=185.167.204.206:4072 , piece_id=H6ICCDXB6VBYMBRDXHO5VAYFP6JQF6HKCEH6JSBBX2F5S3RSEXPA, seg_pos={0 0}, upload=246132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v): protocol: expected piece hash; context canceled; EOF
Nov 8 02:55:16.734206951 (279h41m43.435151836s) [noise=true , address=185.167.204.206:4072 , piece_id=H6ICCDXB6VBYMBRDXHO5VAYFP6JQF6HKCEH6JSBBX2F5S3RSEXPA, seg_pos={0 0}, upload=246132]: Long tail cancellation due to optimal threshold
Nov 8 02:55:16.734218232 (279h41m43.435163117s) [seg_pos={0 0}, upload=246132]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:55:16.734280850 (279h41m43.435225745s) [upload=246132]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:55:16.734284266 (279h41m43.435229151s) [upload=246132]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:55:16.883902841 (279h41m43.584847726s) [upload=246132]: Done uploading segments...
Nov 8 02:55:16.883928860 (279h41m43.584873755s) [upload=246132]: Upload finished. err: <nil>
Duration: 43.702906085s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.890185004s
FAIL (2025-11-08 02:55:29 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.890203358s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.851862452s
FAIL (2025-11-08 02:55:12 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.851884683s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
7 out of 60 is failed (threshold=3) [...X...X.........X........X..........X.......X......X.......] duration:
7.196195817s
FAIL (2025-11-08 02:54:10 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=246021]: Uploading piece...
Nov 8 02:48:07.564209332 (279h34m34.265154216s) [noise=true , address=89.149.201.147:4003 , piece_id=2KMCW6CN4TYHOMYFFLRUCRICLK4BQ2WNYHLDG6KIQ7RCB5BFC2JQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.564530063 (279h34m34.265474978s) [noise=true , address=185.167.204.205:4021 , piece_id=BM6MT5BGUOG4SMZWLQGZLKI77FOWJ3PGZMVBQHSGYHC5B2D7L7FA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.564552204 (279h34m34.265497099s) [noise=true , address=185.167.204.206:4059 , piece_id=TKZ4HIAKFI5NQAUSWXQ2PJZ3BQG6ANCVVJIBCF62JNH22ZZSFHCQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565090054 (279h34m34.266034939s) [noise=true , address=185.167.204.205:4024 , piece_id=2RAHK7XS62MMTUOGP2LO4WOQ7IWKEWMNTFBIJUIE62AOG6AJI3YQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565153183 (279h34m34.266098078s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565912337 (279h34m34.266857232s) [noise=true , address=81.171.14.70:4044 , piece_id=APZJFULIUB5HCY7Y5SRAEASRHO2HSEXT3X53K4FQKZJCTJK6D4HA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565992638 (279h34m34.266937533s) [noise=true , address=185.167.204.206:4047 , piece_id=FHE6TQRU4B3HZ743AHCHKJOUAEY334OYYD2RH3MI72IMUTBXTSPQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.566504739 (279h34m34.267449625s) [noise=true , address=89.149.201.147:4006 , piece_id=QWRWHALL6F6HEG23SSYV54SDUQ224OCGUYW4HZK6LOPX4AMVBSFA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.566949423 (279h34m34.267894308s) [noise=true , address=89.149.201.147:4018 , piece_id=JW2D6AIT2BNSUTG635CGDV4AQCWNPPQOGU2YJXPBY54QND5ZHCGQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.569202421 (279h34m34.270147316s) [noise=true , address=89.149.201.147:4008 , piece_id=GMYISIBUWV7WPPAW627NUEOMU4AEPF2XAJFBLWL2HEV72RYNSHDA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:08.100479513 (279h34m34.801424398s) [upload=246021]: Next returned nil segment
Nov 8 02:48:08.100491705 (279h34m34.8014366s) [upload=246021]: Waiting for error group managing segments...
Nov 8 02:48:08.293540939 (279h34m34.994485845s) [noise=true , address=185.167.204.205:4001 , piece_id=L72WX6M6OFTPY7FDM4BVU655R7X7WWZOUKIGT6YHZSIXTPWGJPMQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.294756852 (279h34m34.995701737s) [noise=true , address=89.149.201.147:4010 , piece_id=AOA6D4Z5J5MSAAPOXQG6IHJALFXBVDTMQTWAWTM2HLDWNCIX6PPQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.297507002 (279h34m34.998451897s) [noise=true , address=81.171.14.70:4038 , piece_id=MTQW3DX5B7QJPK7WQ5HNI5OO36OXFRKUBNLKUH72OPU76Q3II5UA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.322717090 (279h34m35.023661975s) [noise=true , address=185.167.204.206:4064 , piece_id=F75JQOQYCYMCZKRLWNYA44U35IUU2B5X4B635L74QVUQGMROE3SA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.325185132 (279h34m35.026130027s) [noise=true , address=185.167.204.206:4047 , piece_id=FHE6TQRU4B3HZ743AHCHKJOUAEY334OYYD2RH3MI72IMUTBXTSPQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.584450313 (279h34m35.285395198s) [noise=true , address=89.149.201.147:4011 , piece_id=2I7B4FKX4EA6ZFZI4DYVLEBSAIULUW6DKSI75VV6JB4KU264BDIQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.637569593 (279h34m35.338514488s) [noise=true , address=185.167.204.205:4025 , piece_id=7AQQOYQT3OJXWXAGUQM5DHYOQV26TU24R7VXNZIWNG3HG7J4RUWQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.689181695 (279h34m35.39012659s) [noise=true , address=81.171.14.70:4033 , piece_id=HNIH7CALKBLQJ6YHSHCEO7EWJKVUK7HMWPYEEPIXSC4RGLM26D6Q, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.698627029 (279h34m35.399571924s) [noise=true , address=89.149.201.147:4015 , piece_id=PXTKO4YLALXQFTZH7L4NVWV3FSFUWTSS6UHDYKV47IX62MABMJUQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.735330024 (279h34m35.436274919s) [noise=true , address=81.171.14.70:4037 , piece_id=4MSH6ADK675UAOE7ZGIVEXTM3HWPT6OD34NMZ5GAMY5C2XAXY2BQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.772595975 (279h34m35.47354087s) [noise=true , address=81.171.14.70:4042 , piece_id=FX24RVXID4JM2D7M7FJLEIUN67KP2MGWS4CH6YMKAU4ZQFZBHPCA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.773873873 (279h34m35.474818768s) [noise=true , address=89.149.201.147:4022 , piece_id=ACDC2SS274G3XKOZLIAFAXMPNPZEYVULXLGAXJAHTO5LAEFMLOAQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.814538973 (279h34m35.515483868s) [noise=true , address=89.149.201.147:4006 , piece_id=QWRWHALL6F6HEG23SSYV54SDUQ224OCGUYW4HZK6LOPX4AMVBSFA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.866611448 (279h34m35.567556343s) [noise=true , address=81.171.14.70:4036 , piece_id=PMZMCGKXZ63Q7QA4M5QEYBCPL3PWYGN2TIMXZRFDMERBJOGLDCXA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.874940157 (279h34m35.575885043s) [noise=true , address=89.149.201.147:4002 , piece_id=5273LH6LI5WH7SVRPQ4UJTYMEMODHHY36AXLSAYO5RPVS3L7LUBQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.024000725 (279h34m35.72494561s) [noise=true , address=89.149.201.147:4008 , piece_id=GMYISIBUWV7WPPAW627NUEOMU4AEPF2XAJFBLWL2HEV72RYNSHDA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.140995941 (279h34m35.841940836s) [noise=true , address=89.149.201.147:4003 , piece_id=2KMCW6CN4TYHOMYFFLRUCRICLK4BQ2WNYHLDG6KIQ7RCB5BFC2JQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.220418241 (279h34m35.921363166s) [noise=true , address=81.171.14.70:4044 , piece_id=APZJFULIUB5HCY7Y5SRAEASRHO2HSEXT3X53K4FQKZJCTJK6D4HA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.370695010 (279h34m36.071639905s) [noise=true , address=81.171.14.70:4025 , piece_id=N47CFJY5GPNZN7CDKJNNUKY2CNDIWHGAIN3HNYIIDLEKH4TXSZFQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.491857967 (279h34m36.192802862s) [noise=true , address=185.167.204.205:4013 , piece_id=57SSRVEXTPE2SV3JGLDH7Z3ISZBMZTQAXOGX5WLFPEP73QEXSGZQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.627465551 (279h34m36.328410446s) [noise=true , address=89.149.201.147:4018 , piece_id=JW2D6AIT2BNSUTG635CGDV4AQCWNPPQOGU2YJXPBY54QND5ZHCGQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.670235069 (279h34m36.371179954s) [noise=true , address=81.171.14.70:4040 , piece_id=LYE4ZACHL4PNW72BJ7VWBU4W52N4U33INWTDKCLDG646ZZSDJEAQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.676242974 (279h34m36.377187859s) [noise=true , address=185.167.204.205:4024 , piece_id=2RAHK7XS62MMTUOGP2LO4WOQ7IWKEWMNTFBIJUIE62AOG6AJI3YQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.691931334 (279h34m36.392876219s) [noise=true , address=185.167.204.206:4059 , piece_id=TKZ4HIAKFI5NQAUSWXQ2PJZ3BQG6ANCVVJIBCF62JNH22ZZSFHCQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.710047799 (279h34m36.410992694s) [noise=true , address=185.167.204.206:4061 , piece_id=Q46O2O336YDLMSEH4X24DRUWLPMWRFFWFQKWTEPMYWQGD2DF7PFA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.748059960 (279h34m36.449004855s) [noise=true , address=185.167.204.205:4021 , piece_id=BM6MT5BGUOG4SMZWLQGZLKI77FOWJ3PGZMVBQHSGYHC5B2D7L7FA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.748088564 (279h34m36.449033459s) [seg_pos={0 0}, upload=246021]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:48:09.748212817 (279h34m36.449157712s) [noise=true , address=185.167.204.205:4023 , piece_id=Y64QB5BESQ6YUCZGXSCNKC3K36LDFWDHRZVOY4BRPYAPY3YMK4XA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo): protocol: expected piece hash; context canceled; EOF
Nov 8 02:48:09.748222986 (279h34m36.449167881s) [noise=true , address=185.167.204.205:4023 , piece_id=Y64QB5BESQ6YUCZGXSCNKC3K36LDFWDHRZVOY4BRPYAPY3YMK4XA, seg_pos={0 0}, upload=246021]: Long tail cancellation due to optimal threshold
Nov 8 02:48:09.748234237 (279h34m36.449179132s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF
Nov 8 02:48:09.748243093 (279h34m36.449187989s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Long tail cancellation due to optimal threshold
Nov 8 02:48:09.748258823 (279h34m36.449203828s) [seg_pos={0 0}, upload=246021]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:48:09.748340356 (279h34m36.449285251s) [upload=246021]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:48:09.748346357 (279h34m36.449291252s) [upload=246021]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:48:09.898552235 (279h34m36.59949713s) [upload=246021]: Done uploading segments...
Nov 8 02:48:09.898570108 (279h34m36.599514993s) [upload=246021]: Upload finished. err: <nil>
Duration: 7.196215234s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
3.137687029s
FAIL (2025-11-08 02:54:09 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.137706746s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
3.134960273s
FAIL (2025-11-08 02:53:29 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.134986112s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
7 out of 60 is failed (threshold=3) [....X...X.........X........X..........X.......X......X......] duration:
28.327812298s
FAIL (2025-11-08 02:53:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=246021]: Uploading piece...
Nov 8 02:48:07.564209332 (279h34m34.265154216s) [noise=true , address=89.149.201.147:4003 , piece_id=2KMCW6CN4TYHOMYFFLRUCRICLK4BQ2WNYHLDG6KIQ7RCB5BFC2JQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.564530063 (279h34m34.265474978s) [noise=true , address=185.167.204.205:4021 , piece_id=BM6MT5BGUOG4SMZWLQGZLKI77FOWJ3PGZMVBQHSGYHC5B2D7L7FA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.564552204 (279h34m34.265497099s) [noise=true , address=185.167.204.206:4059 , piece_id=TKZ4HIAKFI5NQAUSWXQ2PJZ3BQG6ANCVVJIBCF62JNH22ZZSFHCQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565090054 (279h34m34.266034939s) [noise=true , address=185.167.204.205:4024 , piece_id=2RAHK7XS62MMTUOGP2LO4WOQ7IWKEWMNTFBIJUIE62AOG6AJI3YQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565153183 (279h34m34.266098078s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565912337 (279h34m34.266857232s) [noise=true , address=81.171.14.70:4044 , piece_id=APZJFULIUB5HCY7Y5SRAEASRHO2HSEXT3X53K4FQKZJCTJK6D4HA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565992638 (279h34m34.266937533s) [noise=true , address=185.167.204.206:4047 , piece_id=FHE6TQRU4B3HZ743AHCHKJOUAEY334OYYD2RH3MI72IMUTBXTSPQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.566504739 (279h34m34.267449625s) [noise=true , address=89.149.201.147:4006 , piece_id=QWRWHALL6F6HEG23SSYV54SDUQ224OCGUYW4HZK6LOPX4AMVBSFA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.566949423 (279h34m34.267894308s) [noise=true , address=89.149.201.147:4018 , piece_id=JW2D6AIT2BNSUTG635CGDV4AQCWNPPQOGU2YJXPBY54QND5ZHCGQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.569202421 (279h34m34.270147316s) [noise=true , address=89.149.201.147:4008 , piece_id=GMYISIBUWV7WPPAW627NUEOMU4AEPF2XAJFBLWL2HEV72RYNSHDA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:08.100479513 (279h34m34.801424398s) [upload=246021]: Next returned nil segment
Nov 8 02:48:08.100491705 (279h34m34.8014366s) [upload=246021]: Waiting for error group managing segments...
Nov 8 02:48:08.293540939 (279h34m34.994485845s) [noise=true , address=185.167.204.205:4001 , piece_id=L72WX6M6OFTPY7FDM4BVU655R7X7WWZOUKIGT6YHZSIXTPWGJPMQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.294756852 (279h34m34.995701737s) [noise=true , address=89.149.201.147:4010 , piece_id=AOA6D4Z5J5MSAAPOXQG6IHJALFXBVDTMQTWAWTM2HLDWNCIX6PPQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.297507002 (279h34m34.998451897s) [noise=true , address=81.171.14.70:4038 , piece_id=MTQW3DX5B7QJPK7WQ5HNI5OO36OXFRKUBNLKUH72OPU76Q3II5UA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.322717090 (279h34m35.023661975s) [noise=true , address=185.167.204.206:4064 , piece_id=F75JQOQYCYMCZKRLWNYA44U35IUU2B5X4B635L74QVUQGMROE3SA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.325185132 (279h34m35.026130027s) [noise=true , address=185.167.204.206:4047 , piece_id=FHE6TQRU4B3HZ743AHCHKJOUAEY334OYYD2RH3MI72IMUTBXTSPQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.584450313 (279h34m35.285395198s) [noise=true , address=89.149.201.147:4011 , piece_id=2I7B4FKX4EA6ZFZI4DYVLEBSAIULUW6DKSI75VV6JB4KU264BDIQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.637569593 (279h34m35.338514488s) [noise=true , address=185.167.204.205:4025 , piece_id=7AQQOYQT3OJXWXAGUQM5DHYOQV26TU24R7VXNZIWNG3HG7J4RUWQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.689181695 (279h34m35.39012659s) [noise=true , address=81.171.14.70:4033 , piece_id=HNIH7CALKBLQJ6YHSHCEO7EWJKVUK7HMWPYEEPIXSC4RGLM26D6Q, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.698627029 (279h34m35.399571924s) [noise=true , address=89.149.201.147:4015 , piece_id=PXTKO4YLALXQFTZH7L4NVWV3FSFUWTSS6UHDYKV47IX62MABMJUQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.735330024 (279h34m35.436274919s) [noise=true , address=81.171.14.70:4037 , piece_id=4MSH6ADK675UAOE7ZGIVEXTM3HWPT6OD34NMZ5GAMY5C2XAXY2BQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.772595975 (279h34m35.47354087s) [noise=true , address=81.171.14.70:4042 , piece_id=FX24RVXID4JM2D7M7FJLEIUN67KP2MGWS4CH6YMKAU4ZQFZBHPCA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.773873873 (279h34m35.474818768s) [noise=true , address=89.149.201.147:4022 , piece_id=ACDC2SS274G3XKOZLIAFAXMPNPZEYVULXLGAXJAHTO5LAEFMLOAQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.814538973 (279h34m35.515483868s) [noise=true , address=89.149.201.147:4006 , piece_id=QWRWHALL6F6HEG23SSYV54SDUQ224OCGUYW4HZK6LOPX4AMVBSFA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.866611448 (279h34m35.567556343s) [noise=true , address=81.171.14.70:4036 , piece_id=PMZMCGKXZ63Q7QA4M5QEYBCPL3PWYGN2TIMXZRFDMERBJOGLDCXA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.874940157 (279h34m35.575885043s) [noise=true , address=89.149.201.147:4002 , piece_id=5273LH6LI5WH7SVRPQ4UJTYMEMODHHY36AXLSAYO5RPVS3L7LUBQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.024000725 (279h34m35.72494561s) [noise=true , address=89.149.201.147:4008 , piece_id=GMYISIBUWV7WPPAW627NUEOMU4AEPF2XAJFBLWL2HEV72RYNSHDA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.140995941 (279h34m35.841940836s) [noise=true , address=89.149.201.147:4003 , piece_id=2KMCW6CN4TYHOMYFFLRUCRICLK4BQ2WNYHLDG6KIQ7RCB5BFC2JQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.220418241 (279h34m35.921363166s) [noise=true , address=81.171.14.70:4044 , piece_id=APZJFULIUB5HCY7Y5SRAEASRHO2HSEXT3X53K4FQKZJCTJK6D4HA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.370695010 (279h34m36.071639905s) [noise=true , address=81.171.14.70:4025 , piece_id=N47CFJY5GPNZN7CDKJNNUKY2CNDIWHGAIN3HNYIIDLEKH4TXSZFQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.491857967 (279h34m36.192802862s) [noise=true , address=185.167.204.205:4013 , piece_id=57SSRVEXTPE2SV3JGLDH7Z3ISZBMZTQAXOGX5WLFPEP73QEXSGZQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.627465551 (279h34m36.328410446s) [noise=true , address=89.149.201.147:4018 , piece_id=JW2D6AIT2BNSUTG635CGDV4AQCWNPPQOGU2YJXPBY54QND5ZHCGQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.670235069 (279h34m36.371179954s) [noise=true , address=81.171.14.70:4040 , piece_id=LYE4ZACHL4PNW72BJ7VWBU4W52N4U33INWTDKCLDG646ZZSDJEAQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.676242974 (279h34m36.377187859s) [noise=true , address=185.167.204.205:4024 , piece_id=2RAHK7XS62MMTUOGP2LO4WOQ7IWKEWMNTFBIJUIE62AOG6AJI3YQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.691931334 (279h34m36.392876219s) [noise=true , address=185.167.204.206:4059 , piece_id=TKZ4HIAKFI5NQAUSWXQ2PJZ3BQG6ANCVVJIBCF62JNH22ZZSFHCQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.710047799 (279h34m36.410992694s) [noise=true , address=185.167.204.206:4061 , piece_id=Q46O2O336YDLMSEH4X24DRUWLPMWRFFWFQKWTEPMYWQGD2DF7PFA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.748059960 (279h34m36.449004855s) [noise=true , address=185.167.204.205:4021 , piece_id=BM6MT5BGUOG4SMZWLQGZLKI77FOWJ3PGZMVBQHSGYHC5B2D7L7FA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.748088564 (279h34m36.449033459s) [seg_pos={0 0}, upload=246021]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:48:09.748212817 (279h34m36.449157712s) [noise=true , address=185.167.204.205:4023 , piece_id=Y64QB5BESQ6YUCZGXSCNKC3K36LDFWDHRZVOY4BRPYAPY3YMK4XA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo): protocol: expected piece hash; context canceled; EOF
Nov 8 02:48:09.748222986 (279h34m36.449167881s) [noise=true , address=185.167.204.205:4023 , piece_id=Y64QB5BESQ6YUCZGXSCNKC3K36LDFWDHRZVOY4BRPYAPY3YMK4XA, seg_pos={0 0}, upload=246021]: Long tail cancellation due to optimal threshold
Nov 8 02:48:09.748234237 (279h34m36.449179132s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF
Nov 8 02:48:09.748243093 (279h34m36.449187989s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Long tail cancellation due to optimal threshold
Nov 8 02:48:09.748258823 (279h34m36.449203828s) [seg_pos={0 0}, upload=246021]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:48:09.748340356 (279h34m36.449285251s) [upload=246021]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:48:09.748346357 (279h34m36.449291252s) [upload=246021]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:48:09.898552235 (279h34m36.59949713s) [upload=246021]: Done uploading segments...
Nov 8 02:48:09.898570108 (279h34m36.599514993s) [upload=246021]: Upload finished. err: <nil>
Duration: 28.327831213s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
3.289969924s
FAIL (2025-11-08 02:52:30 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.290019016s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
7 out of 60 is failed (threshold=3) [.....X...X.........X........X..........X.......X......X.....] duration:
4.992926809s
FAIL (2025-11-08 02:51:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=246021]: Uploading piece...
Nov 8 02:48:07.564209332 (279h34m34.265154216s) [noise=true , address=89.149.201.147:4003 , piece_id=2KMCW6CN4TYHOMYFFLRUCRICLK4BQ2WNYHLDG6KIQ7RCB5BFC2JQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.564530063 (279h34m34.265474978s) [noise=true , address=185.167.204.205:4021 , piece_id=BM6MT5BGUOG4SMZWLQGZLKI77FOWJ3PGZMVBQHSGYHC5B2D7L7FA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.564552204 (279h34m34.265497099s) [noise=true , address=185.167.204.206:4059 , piece_id=TKZ4HIAKFI5NQAUSWXQ2PJZ3BQG6ANCVVJIBCF62JNH22ZZSFHCQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565090054 (279h34m34.266034939s) [noise=true , address=185.167.204.205:4024 , piece_id=2RAHK7XS62MMTUOGP2LO4WOQ7IWKEWMNTFBIJUIE62AOG6AJI3YQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565153183 (279h34m34.266098078s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565912337 (279h34m34.266857232s) [noise=true , address=81.171.14.70:4044 , piece_id=APZJFULIUB5HCY7Y5SRAEASRHO2HSEXT3X53K4FQKZJCTJK6D4HA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565992638 (279h34m34.266937533s) [noise=true , address=185.167.204.206:4047 , piece_id=FHE6TQRU4B3HZ743AHCHKJOUAEY334OYYD2RH3MI72IMUTBXTSPQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.566504739 (279h34m34.267449625s) [noise=true , address=89.149.201.147:4006 , piece_id=QWRWHALL6F6HEG23SSYV54SDUQ224OCGUYW4HZK6LOPX4AMVBSFA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.566949423 (279h34m34.267894308s) [noise=true , address=89.149.201.147:4018 , piece_id=JW2D6AIT2BNSUTG635CGDV4AQCWNPPQOGU2YJXPBY54QND5ZHCGQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.569202421 (279h34m34.270147316s) [noise=true , address=89.149.201.147:4008 , piece_id=GMYISIBUWV7WPPAW627NUEOMU4AEPF2XAJFBLWL2HEV72RYNSHDA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:08.100479513 (279h34m34.801424398s) [upload=246021]: Next returned nil segment
Nov 8 02:48:08.100491705 (279h34m34.8014366s) [upload=246021]: Waiting for error group managing segments...
Nov 8 02:48:08.293540939 (279h34m34.994485845s) [noise=true , address=185.167.204.205:4001 , piece_id=L72WX6M6OFTPY7FDM4BVU655R7X7WWZOUKIGT6YHZSIXTPWGJPMQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.294756852 (279h34m34.995701737s) [noise=true , address=89.149.201.147:4010 , piece_id=AOA6D4Z5J5MSAAPOXQG6IHJALFXBVDTMQTWAWTM2HLDWNCIX6PPQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.297507002 (279h34m34.998451897s) [noise=true , address=81.171.14.70:4038 , piece_id=MTQW3DX5B7QJPK7WQ5HNI5OO36OXFRKUBNLKUH72OPU76Q3II5UA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.322717090 (279h34m35.023661975s) [noise=true , address=185.167.204.206:4064 , piece_id=F75JQOQYCYMCZKRLWNYA44U35IUU2B5X4B635L74QVUQGMROE3SA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.325185132 (279h34m35.026130027s) [noise=true , address=185.167.204.206:4047 , piece_id=FHE6TQRU4B3HZ743AHCHKJOUAEY334OYYD2RH3MI72IMUTBXTSPQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.584450313 (279h34m35.285395198s) [noise=true , address=89.149.201.147:4011 , piece_id=2I7B4FKX4EA6ZFZI4DYVLEBSAIULUW6DKSI75VV6JB4KU264BDIQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.637569593 (279h34m35.338514488s) [noise=true , address=185.167.204.205:4025 , piece_id=7AQQOYQT3OJXWXAGUQM5DHYOQV26TU24R7VXNZIWNG3HG7J4RUWQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.689181695 (279h34m35.39012659s) [noise=true , address=81.171.14.70:4033 , piece_id=HNIH7CALKBLQJ6YHSHCEO7EWJKVUK7HMWPYEEPIXSC4RGLM26D6Q, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.698627029 (279h34m35.399571924s) [noise=true , address=89.149.201.147:4015 , piece_id=PXTKO4YLALXQFTZH7L4NVWV3FSFUWTSS6UHDYKV47IX62MABMJUQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.735330024 (279h34m35.436274919s) [noise=true , address=81.171.14.70:4037 , piece_id=4MSH6ADK675UAOE7ZGIVEXTM3HWPT6OD34NMZ5GAMY5C2XAXY2BQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.772595975 (279h34m35.47354087s) [noise=true , address=81.171.14.70:4042 , piece_id=FX24RVXID4JM2D7M7FJLEIUN67KP2MGWS4CH6YMKAU4ZQFZBHPCA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.773873873 (279h34m35.474818768s) [noise=true , address=89.149.201.147:4022 , piece_id=ACDC2SS274G3XKOZLIAFAXMPNPZEYVULXLGAXJAHTO5LAEFMLOAQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.814538973 (279h34m35.515483868s) [noise=true , address=89.149.201.147:4006 , piece_id=QWRWHALL6F6HEG23SSYV54SDUQ224OCGUYW4HZK6LOPX4AMVBSFA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.866611448 (279h34m35.567556343s) [noise=true , address=81.171.14.70:4036 , piece_id=PMZMCGKXZ63Q7QA4M5QEYBCPL3PWYGN2TIMXZRFDMERBJOGLDCXA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.874940157 (279h34m35.575885043s) [noise=true , address=89.149.201.147:4002 , piece_id=5273LH6LI5WH7SVRPQ4UJTYMEMODHHY36AXLSAYO5RPVS3L7LUBQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.024000725 (279h34m35.72494561s) [noise=true , address=89.149.201.147:4008 , piece_id=GMYISIBUWV7WPPAW627NUEOMU4AEPF2XAJFBLWL2HEV72RYNSHDA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.140995941 (279h34m35.841940836s) [noise=true , address=89.149.201.147:4003 , piece_id=2KMCW6CN4TYHOMYFFLRUCRICLK4BQ2WNYHLDG6KIQ7RCB5BFC2JQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.220418241 (279h34m35.921363166s) [noise=true , address=81.171.14.70:4044 , piece_id=APZJFULIUB5HCY7Y5SRAEASRHO2HSEXT3X53K4FQKZJCTJK6D4HA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.370695010 (279h34m36.071639905s) [noise=true , address=81.171.14.70:4025 , piece_id=N47CFJY5GPNZN7CDKJNNUKY2CNDIWHGAIN3HNYIIDLEKH4TXSZFQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.491857967 (279h34m36.192802862s) [noise=true , address=185.167.204.205:4013 , piece_id=57SSRVEXTPE2SV3JGLDH7Z3ISZBMZTQAXOGX5WLFPEP73QEXSGZQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.627465551 (279h34m36.328410446s) [noise=true , address=89.149.201.147:4018 , piece_id=JW2D6AIT2BNSUTG635CGDV4AQCWNPPQOGU2YJXPBY54QND5ZHCGQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.670235069 (279h34m36.371179954s) [noise=true , address=81.171.14.70:4040 , piece_id=LYE4ZACHL4PNW72BJ7VWBU4W52N4U33INWTDKCLDG646ZZSDJEAQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.676242974 (279h34m36.377187859s) [noise=true , address=185.167.204.205:4024 , piece_id=2RAHK7XS62MMTUOGP2LO4WOQ7IWKEWMNTFBIJUIE62AOG6AJI3YQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.691931334 (279h34m36.392876219s) [noise=true , address=185.167.204.206:4059 , piece_id=TKZ4HIAKFI5NQAUSWXQ2PJZ3BQG6ANCVVJIBCF62JNH22ZZSFHCQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.710047799 (279h34m36.410992694s) [noise=true , address=185.167.204.206:4061 , piece_id=Q46O2O336YDLMSEH4X24DRUWLPMWRFFWFQKWTEPMYWQGD2DF7PFA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.748059960 (279h34m36.449004855s) [noise=true , address=185.167.204.205:4021 , piece_id=BM6MT5BGUOG4SMZWLQGZLKI77FOWJ3PGZMVBQHSGYHC5B2D7L7FA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.748088564 (279h34m36.449033459s) [seg_pos={0 0}, upload=246021]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:48:09.748212817 (279h34m36.449157712s) [noise=true , address=185.167.204.205:4023 , piece_id=Y64QB5BESQ6YUCZGXSCNKC3K36LDFWDHRZVOY4BRPYAPY3YMK4XA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo): protocol: expected piece hash; context canceled; EOF
Nov 8 02:48:09.748222986 (279h34m36.449167881s) [noise=true , address=185.167.204.205:4023 , piece_id=Y64QB5BESQ6YUCZGXSCNKC3K36LDFWDHRZVOY4BRPYAPY3YMK4XA, seg_pos={0 0}, upload=246021]: Long tail cancellation due to optimal threshold
Nov 8 02:48:09.748234237 (279h34m36.449179132s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF
Nov 8 02:48:09.748243093 (279h34m36.449187989s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Long tail cancellation due to optimal threshold
Nov 8 02:48:09.748258823 (279h34m36.449203828s) [seg_pos={0 0}, upload=246021]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:48:09.748340356 (279h34m36.449285251s) [upload=246021]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:48:09.748346357 (279h34m36.449291252s) [upload=246021]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:48:09.898552235 (279h34m36.59949713s) [upload=246021]: Done uploading segments...
Nov 8 02:48:09.898570108 (279h34m36.599514993s) [upload=246021]: Upload finished. err: <nil>
Duration: 4.992951475s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
7 out of 60 is failed (threshold=3) [......X...X.........X........X..........X.......X......X....] duration:
36.38437903s
FAIL (2025-11-08 02:51:45 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=246021]: Uploading piece...
Nov 8 02:48:07.564209332 (279h34m34.265154216s) [noise=true , address=89.149.201.147:4003 , piece_id=2KMCW6CN4TYHOMYFFLRUCRICLK4BQ2WNYHLDG6KIQ7RCB5BFC2JQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.564530063 (279h34m34.265474978s) [noise=true , address=185.167.204.205:4021 , piece_id=BM6MT5BGUOG4SMZWLQGZLKI77FOWJ3PGZMVBQHSGYHC5B2D7L7FA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.564552204 (279h34m34.265497099s) [noise=true , address=185.167.204.206:4059 , piece_id=TKZ4HIAKFI5NQAUSWXQ2PJZ3BQG6ANCVVJIBCF62JNH22ZZSFHCQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565090054 (279h34m34.266034939s) [noise=true , address=185.167.204.205:4024 , piece_id=2RAHK7XS62MMTUOGP2LO4WOQ7IWKEWMNTFBIJUIE62AOG6AJI3YQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565153183 (279h34m34.266098078s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565912337 (279h34m34.266857232s) [noise=true , address=81.171.14.70:4044 , piece_id=APZJFULIUB5HCY7Y5SRAEASRHO2HSEXT3X53K4FQKZJCTJK6D4HA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565992638 (279h34m34.266937533s) [noise=true , address=185.167.204.206:4047 , piece_id=FHE6TQRU4B3HZ743AHCHKJOUAEY334OYYD2RH3MI72IMUTBXTSPQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.566504739 (279h34m34.267449625s) [noise=true , address=89.149.201.147:4006 , piece_id=QWRWHALL6F6HEG23SSYV54SDUQ224OCGUYW4HZK6LOPX4AMVBSFA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.566949423 (279h34m34.267894308s) [noise=true , address=89.149.201.147:4018 , piece_id=JW2D6AIT2BNSUTG635CGDV4AQCWNPPQOGU2YJXPBY54QND5ZHCGQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.569202421 (279h34m34.270147316s) [noise=true , address=89.149.201.147:4008 , piece_id=GMYISIBUWV7WPPAW627NUEOMU4AEPF2XAJFBLWL2HEV72RYNSHDA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:08.100479513 (279h34m34.801424398s) [upload=246021]: Next returned nil segment
Nov 8 02:48:08.100491705 (279h34m34.8014366s) [upload=246021]: Waiting for error group managing segments...
Nov 8 02:48:08.293540939 (279h34m34.994485845s) [noise=true , address=185.167.204.205:4001 , piece_id=L72WX6M6OFTPY7FDM4BVU655R7X7WWZOUKIGT6YHZSIXTPWGJPMQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.294756852 (279h34m34.995701737s) [noise=true , address=89.149.201.147:4010 , piece_id=AOA6D4Z5J5MSAAPOXQG6IHJALFXBVDTMQTWAWTM2HLDWNCIX6PPQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.297507002 (279h34m34.998451897s) [noise=true , address=81.171.14.70:4038 , piece_id=MTQW3DX5B7QJPK7WQ5HNI5OO36OXFRKUBNLKUH72OPU76Q3II5UA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.322717090 (279h34m35.023661975s) [noise=true , address=185.167.204.206:4064 , piece_id=F75JQOQYCYMCZKRLWNYA44U35IUU2B5X4B635L74QVUQGMROE3SA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.325185132 (279h34m35.026130027s) [noise=true , address=185.167.204.206:4047 , piece_id=FHE6TQRU4B3HZ743AHCHKJOUAEY334OYYD2RH3MI72IMUTBXTSPQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.584450313 (279h34m35.285395198s) [noise=true , address=89.149.201.147:4011 , piece_id=2I7B4FKX4EA6ZFZI4DYVLEBSAIULUW6DKSI75VV6JB4KU264BDIQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.637569593 (279h34m35.338514488s) [noise=true , address=185.167.204.205:4025 , piece_id=7AQQOYQT3OJXWXAGUQM5DHYOQV26TU24R7VXNZIWNG3HG7J4RUWQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.689181695 (279h34m35.39012659s) [noise=true , address=81.171.14.70:4033 , piece_id=HNIH7CALKBLQJ6YHSHCEO7EWJKVUK7HMWPYEEPIXSC4RGLM26D6Q, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.698627029 (279h34m35.399571924s) [noise=true , address=89.149.201.147:4015 , piece_id=PXTKO4YLALXQFTZH7L4NVWV3FSFUWTSS6UHDYKV47IX62MABMJUQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.735330024 (279h34m35.436274919s) [noise=true , address=81.171.14.70:4037 , piece_id=4MSH6ADK675UAOE7ZGIVEXTM3HWPT6OD34NMZ5GAMY5C2XAXY2BQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.772595975 (279h34m35.47354087s) [noise=true , address=81.171.14.70:4042 , piece_id=FX24RVXID4JM2D7M7FJLEIUN67KP2MGWS4CH6YMKAU4ZQFZBHPCA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.773873873 (279h34m35.474818768s) [noise=true , address=89.149.201.147:4022 , piece_id=ACDC2SS274G3XKOZLIAFAXMPNPZEYVULXLGAXJAHTO5LAEFMLOAQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.814538973 (279h34m35.515483868s) [noise=true , address=89.149.201.147:4006 , piece_id=QWRWHALL6F6HEG23SSYV54SDUQ224OCGUYW4HZK6LOPX4AMVBSFA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.866611448 (279h34m35.567556343s) [noise=true , address=81.171.14.70:4036 , piece_id=PMZMCGKXZ63Q7QA4M5QEYBCPL3PWYGN2TIMXZRFDMERBJOGLDCXA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.874940157 (279h34m35.575885043s) [noise=true , address=89.149.201.147:4002 , piece_id=5273LH6LI5WH7SVRPQ4UJTYMEMODHHY36AXLSAYO5RPVS3L7LUBQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.024000725 (279h34m35.72494561s) [noise=true , address=89.149.201.147:4008 , piece_id=GMYISIBUWV7WPPAW627NUEOMU4AEPF2XAJFBLWL2HEV72RYNSHDA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.140995941 (279h34m35.841940836s) [noise=true , address=89.149.201.147:4003 , piece_id=2KMCW6CN4TYHOMYFFLRUCRICLK4BQ2WNYHLDG6KIQ7RCB5BFC2JQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.220418241 (279h34m35.921363166s) [noise=true , address=81.171.14.70:4044 , piece_id=APZJFULIUB5HCY7Y5SRAEASRHO2HSEXT3X53K4FQKZJCTJK6D4HA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.370695010 (279h34m36.071639905s) [noise=true , address=81.171.14.70:4025 , piece_id=N47CFJY5GPNZN7CDKJNNUKY2CNDIWHGAIN3HNYIIDLEKH4TXSZFQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.491857967 (279h34m36.192802862s) [noise=true , address=185.167.204.205:4013 , piece_id=57SSRVEXTPE2SV3JGLDH7Z3ISZBMZTQAXOGX5WLFPEP73QEXSGZQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.627465551 (279h34m36.328410446s) [noise=true , address=89.149.201.147:4018 , piece_id=JW2D6AIT2BNSUTG635CGDV4AQCWNPPQOGU2YJXPBY54QND5ZHCGQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.670235069 (279h34m36.371179954s) [noise=true , address=81.171.14.70:4040 , piece_id=LYE4ZACHL4PNW72BJ7VWBU4W52N4U33INWTDKCLDG646ZZSDJEAQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.676242974 (279h34m36.377187859s) [noise=true , address=185.167.204.205:4024 , piece_id=2RAHK7XS62MMTUOGP2LO4WOQ7IWKEWMNTFBIJUIE62AOG6AJI3YQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.691931334 (279h34m36.392876219s) [noise=true , address=185.167.204.206:4059 , piece_id=TKZ4HIAKFI5NQAUSWXQ2PJZ3BQG6ANCVVJIBCF62JNH22ZZSFHCQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.710047799 (279h34m36.410992694s) [noise=true , address=185.167.204.206:4061 , piece_id=Q46O2O336YDLMSEH4X24DRUWLPMWRFFWFQKWTEPMYWQGD2DF7PFA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.748059960 (279h34m36.449004855s) [noise=true , address=185.167.204.205:4021 , piece_id=BM6MT5BGUOG4SMZWLQGZLKI77FOWJ3PGZMVBQHSGYHC5B2D7L7FA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.748088564 (279h34m36.449033459s) [seg_pos={0 0}, upload=246021]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:48:09.748212817 (279h34m36.449157712s) [noise=true , address=185.167.204.205:4023 , piece_id=Y64QB5BESQ6YUCZGXSCNKC3K36LDFWDHRZVOY4BRPYAPY3YMK4XA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo): protocol: expected piece hash; context canceled; EOF
Nov 8 02:48:09.748222986 (279h34m36.449167881s) [noise=true , address=185.167.204.205:4023 , piece_id=Y64QB5BESQ6YUCZGXSCNKC3K36LDFWDHRZVOY4BRPYAPY3YMK4XA, seg_pos={0 0}, upload=246021]: Long tail cancellation due to optimal threshold
Nov 8 02:48:09.748234237 (279h34m36.449179132s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF
Nov 8 02:48:09.748243093 (279h34m36.449187989s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Long tail cancellation due to optimal threshold
Nov 8 02:48:09.748258823 (279h34m36.449203828s) [seg_pos={0 0}, upload=246021]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:48:09.748340356 (279h34m36.449285251s) [upload=246021]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:48:09.748346357 (279h34m36.449291252s) [upload=246021]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:48:09.898552235 (279h34m36.59949713s) [upload=246021]: Done uploading segments...
Nov 8 02:48:09.898570108 (279h34m36.599514993s) [upload=246021]: Upload finished. err: <nil>
Duration: 36.384400591s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.832596393s
FAIL (2025-11-08 02:51:30 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.832615739s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.78175931s
FAIL (2025-11-08 02:50:45 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.78178144s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
7 out of 60 is failed (threshold=3) [.......X...X.........X........X..........X.......X......X...] duration:
5.233743427s
FAIL (2025-11-08 02:50:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=246021]: Uploading piece...
Nov 8 02:48:07.564209332 (279h34m34.265154216s) [noise=true , address=89.149.201.147:4003 , piece_id=2KMCW6CN4TYHOMYFFLRUCRICLK4BQ2WNYHLDG6KIQ7RCB5BFC2JQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.564530063 (279h34m34.265474978s) [noise=true , address=185.167.204.205:4021 , piece_id=BM6MT5BGUOG4SMZWLQGZLKI77FOWJ3PGZMVBQHSGYHC5B2D7L7FA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.564552204 (279h34m34.265497099s) [noise=true , address=185.167.204.206:4059 , piece_id=TKZ4HIAKFI5NQAUSWXQ2PJZ3BQG6ANCVVJIBCF62JNH22ZZSFHCQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565090054 (279h34m34.266034939s) [noise=true , address=185.167.204.205:4024 , piece_id=2RAHK7XS62MMTUOGP2LO4WOQ7IWKEWMNTFBIJUIE62AOG6AJI3YQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565153183 (279h34m34.266098078s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565912337 (279h34m34.266857232s) [noise=true , address=81.171.14.70:4044 , piece_id=APZJFULIUB5HCY7Y5SRAEASRHO2HSEXT3X53K4FQKZJCTJK6D4HA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565992638 (279h34m34.266937533s) [noise=true , address=185.167.204.206:4047 , piece_id=FHE6TQRU4B3HZ743AHCHKJOUAEY334OYYD2RH3MI72IMUTBXTSPQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.566504739 (279h34m34.267449625s) [noise=true , address=89.149.201.147:4006 , piece_id=QWRWHALL6F6HEG23SSYV54SDUQ224OCGUYW4HZK6LOPX4AMVBSFA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.566949423 (279h34m34.267894308s) [noise=true , address=89.149.201.147:4018 , piece_id=JW2D6AIT2BNSUTG635CGDV4AQCWNPPQOGU2YJXPBY54QND5ZHCGQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.569202421 (279h34m34.270147316s) [noise=true , address=89.149.201.147:4008 , piece_id=GMYISIBUWV7WPPAW627NUEOMU4AEPF2XAJFBLWL2HEV72RYNSHDA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:08.100479513 (279h34m34.801424398s) [upload=246021]: Next returned nil segment
Nov 8 02:48:08.100491705 (279h34m34.8014366s) [upload=246021]: Waiting for error group managing segments...
Nov 8 02:48:08.293540939 (279h34m34.994485845s) [noise=true , address=185.167.204.205:4001 , piece_id=L72WX6M6OFTPY7FDM4BVU655R7X7WWZOUKIGT6YHZSIXTPWGJPMQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.294756852 (279h34m34.995701737s) [noise=true , address=89.149.201.147:4010 , piece_id=AOA6D4Z5J5MSAAPOXQG6IHJALFXBVDTMQTWAWTM2HLDWNCIX6PPQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.297507002 (279h34m34.998451897s) [noise=true , address=81.171.14.70:4038 , piece_id=MTQW3DX5B7QJPK7WQ5HNI5OO36OXFRKUBNLKUH72OPU76Q3II5UA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.322717090 (279h34m35.023661975s) [noise=true , address=185.167.204.206:4064 , piece_id=F75JQOQYCYMCZKRLWNYA44U35IUU2B5X4B635L74QVUQGMROE3SA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.325185132 (279h34m35.026130027s) [noise=true , address=185.167.204.206:4047 , piece_id=FHE6TQRU4B3HZ743AHCHKJOUAEY334OYYD2RH3MI72IMUTBXTSPQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.584450313 (279h34m35.285395198s) [noise=true , address=89.149.201.147:4011 , piece_id=2I7B4FKX4EA6ZFZI4DYVLEBSAIULUW6DKSI75VV6JB4KU264BDIQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.637569593 (279h34m35.338514488s) [noise=true , address=185.167.204.205:4025 , piece_id=7AQQOYQT3OJXWXAGUQM5DHYOQV26TU24R7VXNZIWNG3HG7J4RUWQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.689181695 (279h34m35.39012659s) [noise=true , address=81.171.14.70:4033 , piece_id=HNIH7CALKBLQJ6YHSHCEO7EWJKVUK7HMWPYEEPIXSC4RGLM26D6Q, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.698627029 (279h34m35.399571924s) [noise=true , address=89.149.201.147:4015 , piece_id=PXTKO4YLALXQFTZH7L4NVWV3FSFUWTSS6UHDYKV47IX62MABMJUQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.735330024 (279h34m35.436274919s) [noise=true , address=81.171.14.70:4037 , piece_id=4MSH6ADK675UAOE7ZGIVEXTM3HWPT6OD34NMZ5GAMY5C2XAXY2BQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.772595975 (279h34m35.47354087s) [noise=true , address=81.171.14.70:4042 , piece_id=FX24RVXID4JM2D7M7FJLEIUN67KP2MGWS4CH6YMKAU4ZQFZBHPCA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.773873873 (279h34m35.474818768s) [noise=true , address=89.149.201.147:4022 , piece_id=ACDC2SS274G3XKOZLIAFAXMPNPZEYVULXLGAXJAHTO5LAEFMLOAQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.814538973 (279h34m35.515483868s) [noise=true , address=89.149.201.147:4006 , piece_id=QWRWHALL6F6HEG23SSYV54SDUQ224OCGUYW4HZK6LOPX4AMVBSFA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.866611448 (279h34m35.567556343s) [noise=true , address=81.171.14.70:4036 , piece_id=PMZMCGKXZ63Q7QA4M5QEYBCPL3PWYGN2TIMXZRFDMERBJOGLDCXA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.874940157 (279h34m35.575885043s) [noise=true , address=89.149.201.147:4002 , piece_id=5273LH6LI5WH7SVRPQ4UJTYMEMODHHY36AXLSAYO5RPVS3L7LUBQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.024000725 (279h34m35.72494561s) [noise=true , address=89.149.201.147:4008 , piece_id=GMYISIBUWV7WPPAW627NUEOMU4AEPF2XAJFBLWL2HEV72RYNSHDA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.140995941 (279h34m35.841940836s) [noise=true , address=89.149.201.147:4003 , piece_id=2KMCW6CN4TYHOMYFFLRUCRICLK4BQ2WNYHLDG6KIQ7RCB5BFC2JQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.220418241 (279h34m35.921363166s) [noise=true , address=81.171.14.70:4044 , piece_id=APZJFULIUB5HCY7Y5SRAEASRHO2HSEXT3X53K4FQKZJCTJK6D4HA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.370695010 (279h34m36.071639905s) [noise=true , address=81.171.14.70:4025 , piece_id=N47CFJY5GPNZN7CDKJNNUKY2CNDIWHGAIN3HNYIIDLEKH4TXSZFQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.491857967 (279h34m36.192802862s) [noise=true , address=185.167.204.205:4013 , piece_id=57SSRVEXTPE2SV3JGLDH7Z3ISZBMZTQAXOGX5WLFPEP73QEXSGZQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.627465551 (279h34m36.328410446s) [noise=true , address=89.149.201.147:4018 , piece_id=JW2D6AIT2BNSUTG635CGDV4AQCWNPPQOGU2YJXPBY54QND5ZHCGQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.670235069 (279h34m36.371179954s) [noise=true , address=81.171.14.70:4040 , piece_id=LYE4ZACHL4PNW72BJ7VWBU4W52N4U33INWTDKCLDG646ZZSDJEAQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.676242974 (279h34m36.377187859s) [noise=true , address=185.167.204.205:4024 , piece_id=2RAHK7XS62MMTUOGP2LO4WOQ7IWKEWMNTFBIJUIE62AOG6AJI3YQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.691931334 (279h34m36.392876219s) [noise=true , address=185.167.204.206:4059 , piece_id=TKZ4HIAKFI5NQAUSWXQ2PJZ3BQG6ANCVVJIBCF62JNH22ZZSFHCQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.710047799 (279h34m36.410992694s) [noise=true , address=185.167.204.206:4061 , piece_id=Q46O2O336YDLMSEH4X24DRUWLPMWRFFWFQKWTEPMYWQGD2DF7PFA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.748059960 (279h34m36.449004855s) [noise=true , address=185.167.204.205:4021 , piece_id=BM6MT5BGUOG4SMZWLQGZLKI77FOWJ3PGZMVBQHSGYHC5B2D7L7FA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.748088564 (279h34m36.449033459s) [seg_pos={0 0}, upload=246021]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:48:09.748212817 (279h34m36.449157712s) [noise=true , address=185.167.204.205:4023 , piece_id=Y64QB5BESQ6YUCZGXSCNKC3K36LDFWDHRZVOY4BRPYAPY3YMK4XA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo): protocol: expected piece hash; context canceled; EOF
Nov 8 02:48:09.748222986 (279h34m36.449167881s) [noise=true , address=185.167.204.205:4023 , piece_id=Y64QB5BESQ6YUCZGXSCNKC3K36LDFWDHRZVOY4BRPYAPY3YMK4XA, seg_pos={0 0}, upload=246021]: Long tail cancellation due to optimal threshold
Nov 8 02:48:09.748234237 (279h34m36.449179132s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF
Nov 8 02:48:09.748243093 (279h34m36.449187989s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Long tail cancellation due to optimal threshold
Nov 8 02:48:09.748258823 (279h34m36.449203828s) [seg_pos={0 0}, upload=246021]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:48:09.748340356 (279h34m36.449285251s) [upload=246021]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:48:09.748346357 (279h34m36.449291252s) [upload=246021]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:48:09.898552235 (279h34m36.59949713s) [upload=246021]: Done uploading segments...
Nov 8 02:48:09.898570108 (279h34m36.599514993s) [upload=246021]: Upload finished. err: <nil>
Duration: 5.233784403s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
3.153134488s
FAIL (2025-11-08 02:50:27 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.153163963s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
7 out of 60 is failed (threshold=3) [........X...X.........X........X..........X.......X......X..] duration:
4.055144391s
FAIL (2025-11-08 02:50:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=246021]: Uploading piece...
Nov 8 02:48:07.564209332 (279h34m34.265154216s) [noise=true , address=89.149.201.147:4003 , piece_id=2KMCW6CN4TYHOMYFFLRUCRICLK4BQ2WNYHLDG6KIQ7RCB5BFC2JQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.564530063 (279h34m34.265474978s) [noise=true , address=185.167.204.205:4021 , piece_id=BM6MT5BGUOG4SMZWLQGZLKI77FOWJ3PGZMVBQHSGYHC5B2D7L7FA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.564552204 (279h34m34.265497099s) [noise=true , address=185.167.204.206:4059 , piece_id=TKZ4HIAKFI5NQAUSWXQ2PJZ3BQG6ANCVVJIBCF62JNH22ZZSFHCQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565090054 (279h34m34.266034939s) [noise=true , address=185.167.204.205:4024 , piece_id=2RAHK7XS62MMTUOGP2LO4WOQ7IWKEWMNTFBIJUIE62AOG6AJI3YQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565153183 (279h34m34.266098078s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565912337 (279h34m34.266857232s) [noise=true , address=81.171.14.70:4044 , piece_id=APZJFULIUB5HCY7Y5SRAEASRHO2HSEXT3X53K4FQKZJCTJK6D4HA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565992638 (279h34m34.266937533s) [noise=true , address=185.167.204.206:4047 , piece_id=FHE6TQRU4B3HZ743AHCHKJOUAEY334OYYD2RH3MI72IMUTBXTSPQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.566504739 (279h34m34.267449625s) [noise=true , address=89.149.201.147:4006 , piece_id=QWRWHALL6F6HEG23SSYV54SDUQ224OCGUYW4HZK6LOPX4AMVBSFA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.566949423 (279h34m34.267894308s) [noise=true , address=89.149.201.147:4018 , piece_id=JW2D6AIT2BNSUTG635CGDV4AQCWNPPQOGU2YJXPBY54QND5ZHCGQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.569202421 (279h34m34.270147316s) [noise=true , address=89.149.201.147:4008 , piece_id=GMYISIBUWV7WPPAW627NUEOMU4AEPF2XAJFBLWL2HEV72RYNSHDA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:08.100479513 (279h34m34.801424398s) [upload=246021]: Next returned nil segment
Nov 8 02:48:08.100491705 (279h34m34.8014366s) [upload=246021]: Waiting for error group managing segments...
Nov 8 02:48:08.293540939 (279h34m34.994485845s) [noise=true , address=185.167.204.205:4001 , piece_id=L72WX6M6OFTPY7FDM4BVU655R7X7WWZOUKIGT6YHZSIXTPWGJPMQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.294756852 (279h34m34.995701737s) [noise=true , address=89.149.201.147:4010 , piece_id=AOA6D4Z5J5MSAAPOXQG6IHJALFXBVDTMQTWAWTM2HLDWNCIX6PPQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.297507002 (279h34m34.998451897s) [noise=true , address=81.171.14.70:4038 , piece_id=MTQW3DX5B7QJPK7WQ5HNI5OO36OXFRKUBNLKUH72OPU76Q3II5UA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.322717090 (279h34m35.023661975s) [noise=true , address=185.167.204.206:4064 , piece_id=F75JQOQYCYMCZKRLWNYA44U35IUU2B5X4B635L74QVUQGMROE3SA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.325185132 (279h34m35.026130027s) [noise=true , address=185.167.204.206:4047 , piece_id=FHE6TQRU4B3HZ743AHCHKJOUAEY334OYYD2RH3MI72IMUTBXTSPQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.584450313 (279h34m35.285395198s) [noise=true , address=89.149.201.147:4011 , piece_id=2I7B4FKX4EA6ZFZI4DYVLEBSAIULUW6DKSI75VV6JB4KU264BDIQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.637569593 (279h34m35.338514488s) [noise=true , address=185.167.204.205:4025 , piece_id=7AQQOYQT3OJXWXAGUQM5DHYOQV26TU24R7VXNZIWNG3HG7J4RUWQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.689181695 (279h34m35.39012659s) [noise=true , address=81.171.14.70:4033 , piece_id=HNIH7CALKBLQJ6YHSHCEO7EWJKVUK7HMWPYEEPIXSC4RGLM26D6Q, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.698627029 (279h34m35.399571924s) [noise=true , address=89.149.201.147:4015 , piece_id=PXTKO4YLALXQFTZH7L4NVWV3FSFUWTSS6UHDYKV47IX62MABMJUQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.735330024 (279h34m35.436274919s) [noise=true , address=81.171.14.70:4037 , piece_id=4MSH6ADK675UAOE7ZGIVEXTM3HWPT6OD34NMZ5GAMY5C2XAXY2BQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.772595975 (279h34m35.47354087s) [noise=true , address=81.171.14.70:4042 , piece_id=FX24RVXID4JM2D7M7FJLEIUN67KP2MGWS4CH6YMKAU4ZQFZBHPCA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.773873873 (279h34m35.474818768s) [noise=true , address=89.149.201.147:4022 , piece_id=ACDC2SS274G3XKOZLIAFAXMPNPZEYVULXLGAXJAHTO5LAEFMLOAQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.814538973 (279h34m35.515483868s) [noise=true , address=89.149.201.147:4006 , piece_id=QWRWHALL6F6HEG23SSYV54SDUQ224OCGUYW4HZK6LOPX4AMVBSFA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.866611448 (279h34m35.567556343s) [noise=true , address=81.171.14.70:4036 , piece_id=PMZMCGKXZ63Q7QA4M5QEYBCPL3PWYGN2TIMXZRFDMERBJOGLDCXA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.874940157 (279h34m35.575885043s) [noise=true , address=89.149.201.147:4002 , piece_id=5273LH6LI5WH7SVRPQ4UJTYMEMODHHY36AXLSAYO5RPVS3L7LUBQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.024000725 (279h34m35.72494561s) [noise=true , address=89.149.201.147:4008 , piece_id=GMYISIBUWV7WPPAW627NUEOMU4AEPF2XAJFBLWL2HEV72RYNSHDA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.140995941 (279h34m35.841940836s) [noise=true , address=89.149.201.147:4003 , piece_id=2KMCW6CN4TYHOMYFFLRUCRICLK4BQ2WNYHLDG6KIQ7RCB5BFC2JQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.220418241 (279h34m35.921363166s) [noise=true , address=81.171.14.70:4044 , piece_id=APZJFULIUB5HCY7Y5SRAEASRHO2HSEXT3X53K4FQKZJCTJK6D4HA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.370695010 (279h34m36.071639905s) [noise=true , address=81.171.14.70:4025 , piece_id=N47CFJY5GPNZN7CDKJNNUKY2CNDIWHGAIN3HNYIIDLEKH4TXSZFQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.491857967 (279h34m36.192802862s) [noise=true , address=185.167.204.205:4013 , piece_id=57SSRVEXTPE2SV3JGLDH7Z3ISZBMZTQAXOGX5WLFPEP73QEXSGZQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.627465551 (279h34m36.328410446s) [noise=true , address=89.149.201.147:4018 , piece_id=JW2D6AIT2BNSUTG635CGDV4AQCWNPPQOGU2YJXPBY54QND5ZHCGQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.670235069 (279h34m36.371179954s) [noise=true , address=81.171.14.70:4040 , piece_id=LYE4ZACHL4PNW72BJ7VWBU4W52N4U33INWTDKCLDG646ZZSDJEAQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.676242974 (279h34m36.377187859s) [noise=true , address=185.167.204.205:4024 , piece_id=2RAHK7XS62MMTUOGP2LO4WOQ7IWKEWMNTFBIJUIE62AOG6AJI3YQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.691931334 (279h34m36.392876219s) [noise=true , address=185.167.204.206:4059 , piece_id=TKZ4HIAKFI5NQAUSWXQ2PJZ3BQG6ANCVVJIBCF62JNH22ZZSFHCQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.710047799 (279h34m36.410992694s) [noise=true , address=185.167.204.206:4061 , piece_id=Q46O2O336YDLMSEH4X24DRUWLPMWRFFWFQKWTEPMYWQGD2DF7PFA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.748059960 (279h34m36.449004855s) [noise=true , address=185.167.204.205:4021 , piece_id=BM6MT5BGUOG4SMZWLQGZLKI77FOWJ3PGZMVBQHSGYHC5B2D7L7FA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.748088564 (279h34m36.449033459s) [seg_pos={0 0}, upload=246021]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:48:09.748212817 (279h34m36.449157712s) [noise=true , address=185.167.204.205:4023 , piece_id=Y64QB5BESQ6YUCZGXSCNKC3K36LDFWDHRZVOY4BRPYAPY3YMK4XA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo): protocol: expected piece hash; context canceled; EOF
Nov 8 02:48:09.748222986 (279h34m36.449167881s) [noise=true , address=185.167.204.205:4023 , piece_id=Y64QB5BESQ6YUCZGXSCNKC3K36LDFWDHRZVOY4BRPYAPY3YMK4XA, seg_pos={0 0}, upload=246021]: Long tail cancellation due to optimal threshold
Nov 8 02:48:09.748234237 (279h34m36.449179132s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF
Nov 8 02:48:09.748243093 (279h34m36.449187989s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Long tail cancellation due to optimal threshold
Nov 8 02:48:09.748258823 (279h34m36.449203828s) [seg_pos={0 0}, upload=246021]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:48:09.748340356 (279h34m36.449285251s) [upload=246021]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:48:09.748346357 (279h34m36.449291252s) [upload=246021]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:48:09.898552235 (279h34m36.59949713s) [upload=246021]: Done uploading segments...
Nov 8 02:48:09.898570108 (279h34m36.599514993s) [upload=246021]: Upload finished. err: <nil>
Duration: 4.055159651s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.937227008s
FAIL (2025-11-08 02:49:15 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.937252535s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
7 out of 60 is failed (threshold=3) [.........X...X.........X........X..........X.......X......X.] duration:
5.181806301s
FAIL (2025-11-08 02:48:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=246021]: Uploading piece...
Nov 8 02:48:07.564209332 (279h34m34.265154216s) [noise=true , address=89.149.201.147:4003 , piece_id=2KMCW6CN4TYHOMYFFLRUCRICLK4BQ2WNYHLDG6KIQ7RCB5BFC2JQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.564530063 (279h34m34.265474978s) [noise=true , address=185.167.204.205:4021 , piece_id=BM6MT5BGUOG4SMZWLQGZLKI77FOWJ3PGZMVBQHSGYHC5B2D7L7FA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.564552204 (279h34m34.265497099s) [noise=true , address=185.167.204.206:4059 , piece_id=TKZ4HIAKFI5NQAUSWXQ2PJZ3BQG6ANCVVJIBCF62JNH22ZZSFHCQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565090054 (279h34m34.266034939s) [noise=true , address=185.167.204.205:4024 , piece_id=2RAHK7XS62MMTUOGP2LO4WOQ7IWKEWMNTFBIJUIE62AOG6AJI3YQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565153183 (279h34m34.266098078s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565912337 (279h34m34.266857232s) [noise=true , address=81.171.14.70:4044 , piece_id=APZJFULIUB5HCY7Y5SRAEASRHO2HSEXT3X53K4FQKZJCTJK6D4HA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565992638 (279h34m34.266937533s) [noise=true , address=185.167.204.206:4047 , piece_id=FHE6TQRU4B3HZ743AHCHKJOUAEY334OYYD2RH3MI72IMUTBXTSPQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.566504739 (279h34m34.267449625s) [noise=true , address=89.149.201.147:4006 , piece_id=QWRWHALL6F6HEG23SSYV54SDUQ224OCGUYW4HZK6LOPX4AMVBSFA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.566949423 (279h34m34.267894308s) [noise=true , address=89.149.201.147:4018 , piece_id=JW2D6AIT2BNSUTG635CGDV4AQCWNPPQOGU2YJXPBY54QND5ZHCGQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.569202421 (279h34m34.270147316s) [noise=true , address=89.149.201.147:4008 , piece_id=GMYISIBUWV7WPPAW627NUEOMU4AEPF2XAJFBLWL2HEV72RYNSHDA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:08.100479513 (279h34m34.801424398s) [upload=246021]: Next returned nil segment
Nov 8 02:48:08.100491705 (279h34m34.8014366s) [upload=246021]: Waiting for error group managing segments...
Nov 8 02:48:08.293540939 (279h34m34.994485845s) [noise=true , address=185.167.204.205:4001 , piece_id=L72WX6M6OFTPY7FDM4BVU655R7X7WWZOUKIGT6YHZSIXTPWGJPMQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.294756852 (279h34m34.995701737s) [noise=true , address=89.149.201.147:4010 , piece_id=AOA6D4Z5J5MSAAPOXQG6IHJALFXBVDTMQTWAWTM2HLDWNCIX6PPQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.297507002 (279h34m34.998451897s) [noise=true , address=81.171.14.70:4038 , piece_id=MTQW3DX5B7QJPK7WQ5HNI5OO36OXFRKUBNLKUH72OPU76Q3II5UA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.322717090 (279h34m35.023661975s) [noise=true , address=185.167.204.206:4064 , piece_id=F75JQOQYCYMCZKRLWNYA44U35IUU2B5X4B635L74QVUQGMROE3SA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.325185132 (279h34m35.026130027s) [noise=true , address=185.167.204.206:4047 , piece_id=FHE6TQRU4B3HZ743AHCHKJOUAEY334OYYD2RH3MI72IMUTBXTSPQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.584450313 (279h34m35.285395198s) [noise=true , address=89.149.201.147:4011 , piece_id=2I7B4FKX4EA6ZFZI4DYVLEBSAIULUW6DKSI75VV6JB4KU264BDIQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.637569593 (279h34m35.338514488s) [noise=true , address=185.167.204.205:4025 , piece_id=7AQQOYQT3OJXWXAGUQM5DHYOQV26TU24R7VXNZIWNG3HG7J4RUWQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.689181695 (279h34m35.39012659s) [noise=true , address=81.171.14.70:4033 , piece_id=HNIH7CALKBLQJ6YHSHCEO7EWJKVUK7HMWPYEEPIXSC4RGLM26D6Q, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.698627029 (279h34m35.399571924s) [noise=true , address=89.149.201.147:4015 , piece_id=PXTKO4YLALXQFTZH7L4NVWV3FSFUWTSS6UHDYKV47IX62MABMJUQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.735330024 (279h34m35.436274919s) [noise=true , address=81.171.14.70:4037 , piece_id=4MSH6ADK675UAOE7ZGIVEXTM3HWPT6OD34NMZ5GAMY5C2XAXY2BQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.772595975 (279h34m35.47354087s) [noise=true , address=81.171.14.70:4042 , piece_id=FX24RVXID4JM2D7M7FJLEIUN67KP2MGWS4CH6YMKAU4ZQFZBHPCA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.773873873 (279h34m35.474818768s) [noise=true , address=89.149.201.147:4022 , piece_id=ACDC2SS274G3XKOZLIAFAXMPNPZEYVULXLGAXJAHTO5LAEFMLOAQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.814538973 (279h34m35.515483868s) [noise=true , address=89.149.201.147:4006 , piece_id=QWRWHALL6F6HEG23SSYV54SDUQ224OCGUYW4HZK6LOPX4AMVBSFA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.866611448 (279h34m35.567556343s) [noise=true , address=81.171.14.70:4036 , piece_id=PMZMCGKXZ63Q7QA4M5QEYBCPL3PWYGN2TIMXZRFDMERBJOGLDCXA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.874940157 (279h34m35.575885043s) [noise=true , address=89.149.201.147:4002 , piece_id=5273LH6LI5WH7SVRPQ4UJTYMEMODHHY36AXLSAYO5RPVS3L7LUBQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.024000725 (279h34m35.72494561s) [noise=true , address=89.149.201.147:4008 , piece_id=GMYISIBUWV7WPPAW627NUEOMU4AEPF2XAJFBLWL2HEV72RYNSHDA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.140995941 (279h34m35.841940836s) [noise=true , address=89.149.201.147:4003 , piece_id=2KMCW6CN4TYHOMYFFLRUCRICLK4BQ2WNYHLDG6KIQ7RCB5BFC2JQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.220418241 (279h34m35.921363166s) [noise=true , address=81.171.14.70:4044 , piece_id=APZJFULIUB5HCY7Y5SRAEASRHO2HSEXT3X53K4FQKZJCTJK6D4HA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.370695010 (279h34m36.071639905s) [noise=true , address=81.171.14.70:4025 , piece_id=N47CFJY5GPNZN7CDKJNNUKY2CNDIWHGAIN3HNYIIDLEKH4TXSZFQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.491857967 (279h34m36.192802862s) [noise=true , address=185.167.204.205:4013 , piece_id=57SSRVEXTPE2SV3JGLDH7Z3ISZBMZTQAXOGX5WLFPEP73QEXSGZQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.627465551 (279h34m36.328410446s) [noise=true , address=89.149.201.147:4018 , piece_id=JW2D6AIT2BNSUTG635CGDV4AQCWNPPQOGU2YJXPBY54QND5ZHCGQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.670235069 (279h34m36.371179954s) [noise=true , address=81.171.14.70:4040 , piece_id=LYE4ZACHL4PNW72BJ7VWBU4W52N4U33INWTDKCLDG646ZZSDJEAQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.676242974 (279h34m36.377187859s) [noise=true , address=185.167.204.205:4024 , piece_id=2RAHK7XS62MMTUOGP2LO4WOQ7IWKEWMNTFBIJUIE62AOG6AJI3YQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.691931334 (279h34m36.392876219s) [noise=true , address=185.167.204.206:4059 , piece_id=TKZ4HIAKFI5NQAUSWXQ2PJZ3BQG6ANCVVJIBCF62JNH22ZZSFHCQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.710047799 (279h34m36.410992694s) [noise=true , address=185.167.204.206:4061 , piece_id=Q46O2O336YDLMSEH4X24DRUWLPMWRFFWFQKWTEPMYWQGD2DF7PFA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.748059960 (279h34m36.449004855s) [noise=true , address=185.167.204.205:4021 , piece_id=BM6MT5BGUOG4SMZWLQGZLKI77FOWJ3PGZMVBQHSGYHC5B2D7L7FA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.748088564 (279h34m36.449033459s) [seg_pos={0 0}, upload=246021]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:48:09.748212817 (279h34m36.449157712s) [noise=true , address=185.167.204.205:4023 , piece_id=Y64QB5BESQ6YUCZGXSCNKC3K36LDFWDHRZVOY4BRPYAPY3YMK4XA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo): protocol: expected piece hash; context canceled; EOF
Nov 8 02:48:09.748222986 (279h34m36.449167881s) [noise=true , address=185.167.204.205:4023 , piece_id=Y64QB5BESQ6YUCZGXSCNKC3K36LDFWDHRZVOY4BRPYAPY3YMK4XA, seg_pos={0 0}, upload=246021]: Long tail cancellation due to optimal threshold
Nov 8 02:48:09.748234237 (279h34m36.449179132s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF
Nov 8 02:48:09.748243093 (279h34m36.449187989s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Long tail cancellation due to optimal threshold
Nov 8 02:48:09.748258823 (279h34m36.449203828s) [seg_pos={0 0}, upload=246021]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:48:09.748340356 (279h34m36.449285251s) [upload=246021]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:48:09.748346357 (279h34m36.449291252s) [upload=246021]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:48:09.898552235 (279h34m36.59949713s) [upload=246021]: Done uploading segments...
Nov 8 02:48:09.898570108 (279h34m36.599514993s) [upload=246021]: Upload finished. err: <nil>
Duration: 5.181820688s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
7 out of 60 is failed (threshold=3) [..........X...X.........X........X..........X.......X......X] duration:
46.320672385s
FAIL (2025-11-08 02:48:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=246021]: Uploading piece...
Nov 8 02:48:07.564209332 (279h34m34.265154216s) [noise=true , address=89.149.201.147:4003 , piece_id=2KMCW6CN4TYHOMYFFLRUCRICLK4BQ2WNYHLDG6KIQ7RCB5BFC2JQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.564530063 (279h34m34.265474978s) [noise=true , address=185.167.204.205:4021 , piece_id=BM6MT5BGUOG4SMZWLQGZLKI77FOWJ3PGZMVBQHSGYHC5B2D7L7FA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.564552204 (279h34m34.265497099s) [noise=true , address=185.167.204.206:4059 , piece_id=TKZ4HIAKFI5NQAUSWXQ2PJZ3BQG6ANCVVJIBCF62JNH22ZZSFHCQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565090054 (279h34m34.266034939s) [noise=true , address=185.167.204.205:4024 , piece_id=2RAHK7XS62MMTUOGP2LO4WOQ7IWKEWMNTFBIJUIE62AOG6AJI3YQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565153183 (279h34m34.266098078s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565912337 (279h34m34.266857232s) [noise=true , address=81.171.14.70:4044 , piece_id=APZJFULIUB5HCY7Y5SRAEASRHO2HSEXT3X53K4FQKZJCTJK6D4HA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.565992638 (279h34m34.266937533s) [noise=true , address=185.167.204.206:4047 , piece_id=FHE6TQRU4B3HZ743AHCHKJOUAEY334OYYD2RH3MI72IMUTBXTSPQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.566504739 (279h34m34.267449625s) [noise=true , address=89.149.201.147:4006 , piece_id=QWRWHALL6F6HEG23SSYV54SDUQ224OCGUYW4HZK6LOPX4AMVBSFA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.566949423 (279h34m34.267894308s) [noise=true , address=89.149.201.147:4018 , piece_id=JW2D6AIT2BNSUTG635CGDV4AQCWNPPQOGU2YJXPBY54QND5ZHCGQ, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:07.569202421 (279h34m34.270147316s) [noise=true , address=89.149.201.147:4008 , piece_id=GMYISIBUWV7WPPAW627NUEOMU4AEPF2XAJFBLWL2HEV72RYNSHDA, seg_pos={0 0}, upload=246021]: Uploading piece...
Nov 8 02:48:08.100479513 (279h34m34.801424398s) [upload=246021]: Next returned nil segment
Nov 8 02:48:08.100491705 (279h34m34.8014366s) [upload=246021]: Waiting for error group managing segments...
Nov 8 02:48:08.293540939 (279h34m34.994485845s) [noise=true , address=185.167.204.205:4001 , piece_id=L72WX6M6OFTPY7FDM4BVU655R7X7WWZOUKIGT6YHZSIXTPWGJPMQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.294756852 (279h34m34.995701737s) [noise=true , address=89.149.201.147:4010 , piece_id=AOA6D4Z5J5MSAAPOXQG6IHJALFXBVDTMQTWAWTM2HLDWNCIX6PPQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.297507002 (279h34m34.998451897s) [noise=true , address=81.171.14.70:4038 , piece_id=MTQW3DX5B7QJPK7WQ5HNI5OO36OXFRKUBNLKUH72OPU76Q3II5UA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.322717090 (279h34m35.023661975s) [noise=true , address=185.167.204.206:4064 , piece_id=F75JQOQYCYMCZKRLWNYA44U35IUU2B5X4B635L74QVUQGMROE3SA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.325185132 (279h34m35.026130027s) [noise=true , address=185.167.204.206:4047 , piece_id=FHE6TQRU4B3HZ743AHCHKJOUAEY334OYYD2RH3MI72IMUTBXTSPQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.584450313 (279h34m35.285395198s) [noise=true , address=89.149.201.147:4011 , piece_id=2I7B4FKX4EA6ZFZI4DYVLEBSAIULUW6DKSI75VV6JB4KU264BDIQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.637569593 (279h34m35.338514488s) [noise=true , address=185.167.204.205:4025 , piece_id=7AQQOYQT3OJXWXAGUQM5DHYOQV26TU24R7VXNZIWNG3HG7J4RUWQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.689181695 (279h34m35.39012659s) [noise=true , address=81.171.14.70:4033 , piece_id=HNIH7CALKBLQJ6YHSHCEO7EWJKVUK7HMWPYEEPIXSC4RGLM26D6Q, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.698627029 (279h34m35.399571924s) [noise=true , address=89.149.201.147:4015 , piece_id=PXTKO4YLALXQFTZH7L4NVWV3FSFUWTSS6UHDYKV47IX62MABMJUQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.735330024 (279h34m35.436274919s) [noise=true , address=81.171.14.70:4037 , piece_id=4MSH6ADK675UAOE7ZGIVEXTM3HWPT6OD34NMZ5GAMY5C2XAXY2BQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.772595975 (279h34m35.47354087s) [noise=true , address=81.171.14.70:4042 , piece_id=FX24RVXID4JM2D7M7FJLEIUN67KP2MGWS4CH6YMKAU4ZQFZBHPCA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.773873873 (279h34m35.474818768s) [noise=true , address=89.149.201.147:4022 , piece_id=ACDC2SS274G3XKOZLIAFAXMPNPZEYVULXLGAXJAHTO5LAEFMLOAQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.814538973 (279h34m35.515483868s) [noise=true , address=89.149.201.147:4006 , piece_id=QWRWHALL6F6HEG23SSYV54SDUQ224OCGUYW4HZK6LOPX4AMVBSFA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.866611448 (279h34m35.567556343s) [noise=true , address=81.171.14.70:4036 , piece_id=PMZMCGKXZ63Q7QA4M5QEYBCPL3PWYGN2TIMXZRFDMERBJOGLDCXA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:08.874940157 (279h34m35.575885043s) [noise=true , address=89.149.201.147:4002 , piece_id=5273LH6LI5WH7SVRPQ4UJTYMEMODHHY36AXLSAYO5RPVS3L7LUBQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.024000725 (279h34m35.72494561s) [noise=true , address=89.149.201.147:4008 , piece_id=GMYISIBUWV7WPPAW627NUEOMU4AEPF2XAJFBLWL2HEV72RYNSHDA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.140995941 (279h34m35.841940836s) [noise=true , address=89.149.201.147:4003 , piece_id=2KMCW6CN4TYHOMYFFLRUCRICLK4BQ2WNYHLDG6KIQ7RCB5BFC2JQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.220418241 (279h34m35.921363166s) [noise=true , address=81.171.14.70:4044 , piece_id=APZJFULIUB5HCY7Y5SRAEASRHO2HSEXT3X53K4FQKZJCTJK6D4HA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.370695010 (279h34m36.071639905s) [noise=true , address=81.171.14.70:4025 , piece_id=N47CFJY5GPNZN7CDKJNNUKY2CNDIWHGAIN3HNYIIDLEKH4TXSZFQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.491857967 (279h34m36.192802862s) [noise=true , address=185.167.204.205:4013 , piece_id=57SSRVEXTPE2SV3JGLDH7Z3ISZBMZTQAXOGX5WLFPEP73QEXSGZQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.627465551 (279h34m36.328410446s) [noise=true , address=89.149.201.147:4018 , piece_id=JW2D6AIT2BNSUTG635CGDV4AQCWNPPQOGU2YJXPBY54QND5ZHCGQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.670235069 (279h34m36.371179954s) [noise=true , address=81.171.14.70:4040 , piece_id=LYE4ZACHL4PNW72BJ7VWBU4W52N4U33INWTDKCLDG646ZZSDJEAQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.676242974 (279h34m36.377187859s) [noise=true , address=185.167.204.205:4024 , piece_id=2RAHK7XS62MMTUOGP2LO4WOQ7IWKEWMNTFBIJUIE62AOG6AJI3YQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.691931334 (279h34m36.392876219s) [noise=true , address=185.167.204.206:4059 , piece_id=TKZ4HIAKFI5NQAUSWXQ2PJZ3BQG6ANCVVJIBCF62JNH22ZZSFHCQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.710047799 (279h34m36.410992694s) [noise=true , address=185.167.204.206:4061 , piece_id=Q46O2O336YDLMSEH4X24DRUWLPMWRFFWFQKWTEPMYWQGD2DF7PFA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.748059960 (279h34m36.449004855s) [noise=true , address=185.167.204.205:4021 , piece_id=BM6MT5BGUOG4SMZWLQGZLKI77FOWJ3PGZMVBQHSGYHC5B2D7L7FA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: <nil>
Nov 8 02:48:09.748088564 (279h34m36.449033459s) [seg_pos={0 0}, upload=246021]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:48:09.748212817 (279h34m36.449157712s) [noise=true , address=185.167.204.205:4023 , piece_id=Y64QB5BESQ6YUCZGXSCNKC3K36LDFWDHRZVOY4BRPYAPY3YMK4XA, seg_pos={0 0}, upload=246021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo): protocol: expected piece hash; context canceled; EOF
Nov 8 02:48:09.748222986 (279h34m36.449167881s) [noise=true , address=185.167.204.205:4023 , piece_id=Y64QB5BESQ6YUCZGXSCNKC3K36LDFWDHRZVOY4BRPYAPY3YMK4XA, seg_pos={0 0}, upload=246021]: Long tail cancellation due to optimal threshold
Nov 8 02:48:09.748234237 (279h34m36.449179132s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF
Nov 8 02:48:09.748243093 (279h34m36.449187989s) [noise=true , address=89.149.201.147:4016 , piece_id=I7JB6RUREMEAQASEDBHZEOSPJXUN24R32MUS5VJKMFJHMQ4JD3QQ, seg_pos={0 0}, upload=246021]: Long tail cancellation due to optimal threshold
Nov 8 02:48:09.748258823 (279h34m36.449203828s) [seg_pos={0 0}, upload=246021]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:48:09.748340356 (279h34m36.449285251s) [upload=246021]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:48:09.748346357 (279h34m36.449291252s) [upload=246021]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:48:09.898552235 (279h34m36.59949713s) [upload=246021]: Done uploading segments...
Nov 8 02:48:09.898570108 (279h34m36.599514993s) [upload=246021]: Upload finished. err: <nil>
Duration: 46.320711849s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
3.124311657s
FAIL (2025-11-08 02:48:37 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.12432922s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [...........X...X.........X........X..........X.......X......] duration:
5.172364982s
FAIL (2025-11-08 02:47:44 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
s=185.167.204.206:4048 , piece_id=AKYB6E3HZJN25HWITXQDEVDYKUQKCXTRYURH4MNGYIBBMQQTIDPA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.729481152 (279h29m55.430426036s) [noise=true , address=81.171.14.70:4047 , piece_id=XCQQYTJLEAGC4EB3ERHXNXIBY45F4KYK743WRWF3XT6S3GRI5MJA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.729742581 (279h29m55.430687476s) [noise=true , address=185.167.204.205:4028 , piece_id=7V6V5JAMMA76RNDLAN57UXHA5SEUOODDX2Y6YTTZ4IMEU6FNRMMA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.730318441 (279h29m55.431263325s) [noise=true , address=89.149.201.147:4017 , piece_id=REYZSF3QQYJKJUNLCINYO2XEKWP5LCDWZRQC3UZ3SAFOCHZS2UJA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.731989455 (279h29m55.432934339s) [noise=true , address=81.171.14.70:4031 , piece_id=BRYASIH2IENI6SH36ZOJJEYEB2FBVIFOCENHZCGIVWRDCIXIYFPA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.732373715 (279h29m55.43331861s) [noise=true , address=81.171.14.70:4027 , piece_id=ENUXPPWGRMCVI7ZHNB2YEALOTE3VP2J3UB56LJMLGXJV5MSKF2UQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.732738249 (279h29m55.433683134s) [noise=true , address=185.167.204.205:4012 , piece_id=PYA7GWYHRD5ZM4XNWGXAHJOTP4M2BLAU3QBDU4O6TAURUJJ3EXZQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.733069279 (279h29m55.434014164s) [noise=true , address=81.171.14.70:4038 , piece_id=6IJFS6ENFR7L4LW2EYKJRKPNPUWPL6L7Q67M6NMMJTQB6ZHGFANQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.733571130 (279h29m55.434516025s) [noise=true , address=89.149.201.147:4016 , piece_id=Y5UI73372TWUQCAOAIIUF5MET3CPURKZBDR6K3YZVVF6V3JQWL6Q, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.733945021 (279h29m55.434889907s) [noise=true , address=185.167.204.205:4016 , piece_id=4O7EBNS533D47EK3NJDVEDZ4KGWFV257DBIOOVWVKROD64MHEFSQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:29.239559670 (279h29m55.940504585s) [upload=245957]: Next returned nil segment
Nov 8 02:43:29.239576071 (279h29m55.940520986s) [upload=245957]: Waiting for error group managing segments...
Nov 8 02:43:29.448419100 (279h29m56.149364015s) [noise=true , address=185.167.204.205:4021 , piece_id=IZEVUOQZEO5BJEH5TV53GTMSY37DBPZVAXX45RYSQPTWKWK6VTAA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.455980619 (279h29m56.156925504s) [noise=true , address=185.167.204.206:4048 , piece_id=AKYB6E3HZJN25HWITXQDEVDYKUQKCXTRYURH4MNGYIBBMQQTIDPA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.492563218 (279h29m56.193508133s) [noise=true , address=185.167.204.205:4016 , piece_id=4O7EBNS533D47EK3NJDVEDZ4KGWFV257DBIOOVWVKROD64MHEFSQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.722147970 (279h29m56.423092865s) [noise=true , address=185.167.204.206:4050 , piece_id=LC5R4QT2BNKQTISHG6MB4VXQ6G2HLIPWJH7LVRZTLKMJHFB5YAHQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.744127447 (279h29m56.445072332s) [noise=true , address=185.167.204.205:4012 , piece_id=PYA7GWYHRD5ZM4XNWGXAHJOTP4M2BLAU3QBDU4O6TAURUJJ3EXZQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.750938157 (279h29m56.451883042s) [noise=true , address=81.171.14.70:4031 , piece_id=BRYASIH2IENI6SH36ZOJJEYEB2FBVIFOCENHZCGIVWRDCIXIYFPA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.836693364 (279h29m56.537638249s) [noise=true , address=81.171.14.70:4030 , piece_id=FNTQD6KEYJBUFAEPHPSWFZ2CYEBUXM77MK56OIYHUELVATY57ECQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.867734622 (279h29m56.568679507s) [noise=true , address=185.167.204.206:4063 , piece_id=AS3QWIMCTMDWW6MU7E7OQQE4W4CNYGQYEBCZNPONI3VF5FAFNTMQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.915844196 (279h29m56.616789091s) [noise=true , address=89.149.201.147:4015 , piece_id=3XFFAKR42BP3QV6WTZCOJ3GZDE7BP7JPX7XXR2AWMJXBUASVRREQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.919243079 (279h29m56.620187965s) [noise=true , address=89.149.201.147:4013 , piece_id=GH6S2X2NHR6XZERNDQ4VCIXG6WTGUQMVVARP6E5QH7JCOMK3MP2A, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.929755662 (279h29m56.630700557s) [noise=true , address=81.171.14.70:4033 , piece_id=6CS4IEZ7H6NPD4B5JIWIPMEW3J35CGBPQEHUZVYLVOISWURQD2MQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.939420996 (279h29m56.640365882s) [noise=true , address=185.167.204.206:4058 , piece_id=A65WCTY5NBLMPILIWERTM5GTSZSSMY3WIPOSARUFG7XHNYTPRWYA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.965928062 (279h29m56.666872947s) [noise=true , address=185.167.204.206:4059 , piece_id=LLK5WUYF5L253KHM4D35IW2HG3AHOITH3YTJIWIMNKVT2EU44HMQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.966014364 (279h29m56.666959259s) [noise=true , address=81.171.14.70:4027 , piece_id=ENUXPPWGRMCVI7ZHNB2YEALOTE3VP2J3UB56LJMLGXJV5MSKF2UQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.977664951 (279h29m56.678609846s) [noise=true , address=185.167.204.205:4023 , piece_id=CY6IS6YNVY3LD7N4BDV3DIESHWLFVWOP7UPQROK7GXWNJ266OJGA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.167000160 (279h29m56.867945055s) [noise=true , address=89.149.201.147:4006 , piece_id=7UQMSU4DLZSQY7Z23TH5ZYI4PB5LFORSYAALZPEX2ANIQVVRXQ7A, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.188026247 (279h29m56.888971133s) [noise=true , address=81.171.14.70:4029 , piece_id=AOEB7P4EAWL4BWQP2AEUM53VMIH2CC3OO2TJTW4VZBQVJIESQQYQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.219950881 (279h29m56.920895776s) [noise=true , address=185.167.204.205:4019 , piece_id=FC3QKHT4XMSM3DYHZ4K4KOGD7XU74L3X6WFJZ7ZKPRX2EBYP73IQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.380077468 (279h29m57.081022353s) [noise=true , address=81.171.14.70:4036 , piece_id=ZCYZAAG6JKW3JJXS2LZ5PFZ6GELNK5VZ3TWHOUMQEEHZENQ7POPA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.383417131 (279h29m57.084362026s) [noise=true , address=89.149.201.147:4017 , piece_id=REYZSF3QQYJKJUNLCINYO2XEKWP5LCDWZRQC3UZ3SAFOCHZS2UJA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.398552363 (279h29m57.099497258s) [noise=true , address=81.171.14.70:4035 , piece_id=YRYQEFRTJQYHUA5WI6E6ZQMXH6GHV6DGH2GAIBQ2VA3LUYWPESXA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.693120991 (279h29m57.394065886s) [noise=true , address=185.167.204.205:4028 , piece_id=7V6V5JAMMA76RNDLAN57UXHA5SEUOODDX2Y6YTTZ4IMEU6FNRMMA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.762215857 (279h29m57.463160741s) [noise=true , address=89.149.201.147:4009 , piece_id=2ZR42I73WIQ5OX5T5PFGF26ILNQXJHKI4COXVGBB3EFXFVT7O4GQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.819050832 (279h29m57.519995727s) [noise=true , address=89.149.201.147:4016 , piece_id=Y5UI73372TWUQCAOAIIUF5MET3CPURKZBDR6K3YZVVF6V3JQWL6Q, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.874626807 (279h29m57.575571703s) [noise=true , address=185.167.204.206:4071 , piece_id=JMSZYQTZEHJ2DTCSURS335JPUR3I6AVKH4E6PB6Q2YAZ655PRH6A, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.891196239 (279h29m57.592141123s) [noise=true , address=81.171.14.70:4028 , piece_id=KYILI6WH7GV7PIMHWK7626N6NRNEE34HRADFXVK7YE5ZZKFTLNQA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.891215435 (279h29m57.592160319s) [seg_pos={0 0}, upload=245957]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:43:30.891326763 (279h29m57.592271658s) [noise=true , address=81.171.14.70:4047 , piece_id=XCQQYTJLEAGC4EB3ERHXNXIBY45F4KYK743WRWF3XT6S3GRI5MJA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF
Nov 8 02:43:30.891334968 (279h29m57.592279853s) [noise=true , address=81.171.14.70:4047 , piece_id=XCQQYTJLEAGC4EB3ERHXNXIBY45F4KYK743WRWF3XT6S3GRI5MJA, seg_pos={0 0}, upload=245957]: Long tail cancellation due to optimal threshold
Nov 8 02:43:30.891388920 (279h29m57.592333815s) [noise=true , address=81.171.14.70:4038 , piece_id=6IJFS6ENFR7L4LW2EYKJRKPNPUWPL6L7Q67M6NMMJTQB6ZHGFANQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: read tcp 5.161.89.252:45454->81.171.14.70:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled
Nov 8 02:43:30.891395792 (279h29m57.592340688s) [noise=true , address=81.171.14.70:4038 , piece_id=6IJFS6ENFR7L4LW2EYKJRKPNPUWPL6L7Q67M6NMMJTQB6ZHGFANQ, seg_pos={0 0}, upload=245957]: Long tail cancellation due to optimal threshold
Nov 8 02:43:30.891409588 (279h29m57.592354473s) [seg_pos={0 0}, upload=245957]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:43:30.891457218 (279h29m57.592402113s) [upload=245957]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:43:30.891460744 (279h29m57.59240563s) [upload=245957]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:43:31.034541897 (279h29m57.735486782s) [upload=245957]: Done uploading segments...
Nov 8 02:43:31.034555543 (279h29m57.735500438s) [upload=245957]: Upload finished. err: <nil>
Duration: 5.172382004s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
3.437964853s
FAIL (2025-11-08 02:47:39 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.437985653s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [............X...X.........X........X..........X.......X.....] duration:
6.146024802s
FAIL (2025-11-08 02:47:24 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
s=185.167.204.206:4048 , piece_id=AKYB6E3HZJN25HWITXQDEVDYKUQKCXTRYURH4MNGYIBBMQQTIDPA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.729481152 (279h29m55.430426036s) [noise=true , address=81.171.14.70:4047 , piece_id=XCQQYTJLEAGC4EB3ERHXNXIBY45F4KYK743WRWF3XT6S3GRI5MJA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.729742581 (279h29m55.430687476s) [noise=true , address=185.167.204.205:4028 , piece_id=7V6V5JAMMA76RNDLAN57UXHA5SEUOODDX2Y6YTTZ4IMEU6FNRMMA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.730318441 (279h29m55.431263325s) [noise=true , address=89.149.201.147:4017 , piece_id=REYZSF3QQYJKJUNLCINYO2XEKWP5LCDWZRQC3UZ3SAFOCHZS2UJA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.731989455 (279h29m55.432934339s) [noise=true , address=81.171.14.70:4031 , piece_id=BRYASIH2IENI6SH36ZOJJEYEB2FBVIFOCENHZCGIVWRDCIXIYFPA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.732373715 (279h29m55.43331861s) [noise=true , address=81.171.14.70:4027 , piece_id=ENUXPPWGRMCVI7ZHNB2YEALOTE3VP2J3UB56LJMLGXJV5MSKF2UQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.732738249 (279h29m55.433683134s) [noise=true , address=185.167.204.205:4012 , piece_id=PYA7GWYHRD5ZM4XNWGXAHJOTP4M2BLAU3QBDU4O6TAURUJJ3EXZQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.733069279 (279h29m55.434014164s) [noise=true , address=81.171.14.70:4038 , piece_id=6IJFS6ENFR7L4LW2EYKJRKPNPUWPL6L7Q67M6NMMJTQB6ZHGFANQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.733571130 (279h29m55.434516025s) [noise=true , address=89.149.201.147:4016 , piece_id=Y5UI73372TWUQCAOAIIUF5MET3CPURKZBDR6K3YZVVF6V3JQWL6Q, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.733945021 (279h29m55.434889907s) [noise=true , address=185.167.204.205:4016 , piece_id=4O7EBNS533D47EK3NJDVEDZ4KGWFV257DBIOOVWVKROD64MHEFSQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:29.239559670 (279h29m55.940504585s) [upload=245957]: Next returned nil segment
Nov 8 02:43:29.239576071 (279h29m55.940520986s) [upload=245957]: Waiting for error group managing segments...
Nov 8 02:43:29.448419100 (279h29m56.149364015s) [noise=true , address=185.167.204.205:4021 , piece_id=IZEVUOQZEO5BJEH5TV53GTMSY37DBPZVAXX45RYSQPTWKWK6VTAA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.455980619 (279h29m56.156925504s) [noise=true , address=185.167.204.206:4048 , piece_id=AKYB6E3HZJN25HWITXQDEVDYKUQKCXTRYURH4MNGYIBBMQQTIDPA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.492563218 (279h29m56.193508133s) [noise=true , address=185.167.204.205:4016 , piece_id=4O7EBNS533D47EK3NJDVEDZ4KGWFV257DBIOOVWVKROD64MHEFSQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.722147970 (279h29m56.423092865s) [noise=true , address=185.167.204.206:4050 , piece_id=LC5R4QT2BNKQTISHG6MB4VXQ6G2HLIPWJH7LVRZTLKMJHFB5YAHQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.744127447 (279h29m56.445072332s) [noise=true , address=185.167.204.205:4012 , piece_id=PYA7GWYHRD5ZM4XNWGXAHJOTP4M2BLAU3QBDU4O6TAURUJJ3EXZQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.750938157 (279h29m56.451883042s) [noise=true , address=81.171.14.70:4031 , piece_id=BRYASIH2IENI6SH36ZOJJEYEB2FBVIFOCENHZCGIVWRDCIXIYFPA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.836693364 (279h29m56.537638249s) [noise=true , address=81.171.14.70:4030 , piece_id=FNTQD6KEYJBUFAEPHPSWFZ2CYEBUXM77MK56OIYHUELVATY57ECQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.867734622 (279h29m56.568679507s) [noise=true , address=185.167.204.206:4063 , piece_id=AS3QWIMCTMDWW6MU7E7OQQE4W4CNYGQYEBCZNPONI3VF5FAFNTMQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.915844196 (279h29m56.616789091s) [noise=true , address=89.149.201.147:4015 , piece_id=3XFFAKR42BP3QV6WTZCOJ3GZDE7BP7JPX7XXR2AWMJXBUASVRREQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.919243079 (279h29m56.620187965s) [noise=true , address=89.149.201.147:4013 , piece_id=GH6S2X2NHR6XZERNDQ4VCIXG6WTGUQMVVARP6E5QH7JCOMK3MP2A, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.929755662 (279h29m56.630700557s) [noise=true , address=81.171.14.70:4033 , piece_id=6CS4IEZ7H6NPD4B5JIWIPMEW3J35CGBPQEHUZVYLVOISWURQD2MQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.939420996 (279h29m56.640365882s) [noise=true , address=185.167.204.206:4058 , piece_id=A65WCTY5NBLMPILIWERTM5GTSZSSMY3WIPOSARUFG7XHNYTPRWYA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.965928062 (279h29m56.666872947s) [noise=true , address=185.167.204.206:4059 , piece_id=LLK5WUYF5L253KHM4D35IW2HG3AHOITH3YTJIWIMNKVT2EU44HMQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.966014364 (279h29m56.666959259s) [noise=true , address=81.171.14.70:4027 , piece_id=ENUXPPWGRMCVI7ZHNB2YEALOTE3VP2J3UB56LJMLGXJV5MSKF2UQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.977664951 (279h29m56.678609846s) [noise=true , address=185.167.204.205:4023 , piece_id=CY6IS6YNVY3LD7N4BDV3DIESHWLFVWOP7UPQROK7GXWNJ266OJGA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.167000160 (279h29m56.867945055s) [noise=true , address=89.149.201.147:4006 , piece_id=7UQMSU4DLZSQY7Z23TH5ZYI4PB5LFORSYAALZPEX2ANIQVVRXQ7A, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.188026247 (279h29m56.888971133s) [noise=true , address=81.171.14.70:4029 , piece_id=AOEB7P4EAWL4BWQP2AEUM53VMIH2CC3OO2TJTW4VZBQVJIESQQYQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.219950881 (279h29m56.920895776s) [noise=true , address=185.167.204.205:4019 , piece_id=FC3QKHT4XMSM3DYHZ4K4KOGD7XU74L3X6WFJZ7ZKPRX2EBYP73IQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.380077468 (279h29m57.081022353s) [noise=true , address=81.171.14.70:4036 , piece_id=ZCYZAAG6JKW3JJXS2LZ5PFZ6GELNK5VZ3TWHOUMQEEHZENQ7POPA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.383417131 (279h29m57.084362026s) [noise=true , address=89.149.201.147:4017 , piece_id=REYZSF3QQYJKJUNLCINYO2XEKWP5LCDWZRQC3UZ3SAFOCHZS2UJA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.398552363 (279h29m57.099497258s) [noise=true , address=81.171.14.70:4035 , piece_id=YRYQEFRTJQYHUA5WI6E6ZQMXH6GHV6DGH2GAIBQ2VA3LUYWPESXA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.693120991 (279h29m57.394065886s) [noise=true , address=185.167.204.205:4028 , piece_id=7V6V5JAMMA76RNDLAN57UXHA5SEUOODDX2Y6YTTZ4IMEU6FNRMMA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.762215857 (279h29m57.463160741s) [noise=true , address=89.149.201.147:4009 , piece_id=2ZR42I73WIQ5OX5T5PFGF26ILNQXJHKI4COXVGBB3EFXFVT7O4GQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.819050832 (279h29m57.519995727s) [noise=true , address=89.149.201.147:4016 , piece_id=Y5UI73372TWUQCAOAIIUF5MET3CPURKZBDR6K3YZVVF6V3JQWL6Q, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.874626807 (279h29m57.575571703s) [noise=true , address=185.167.204.206:4071 , piece_id=JMSZYQTZEHJ2DTCSURS335JPUR3I6AVKH4E6PB6Q2YAZ655PRH6A, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.891196239 (279h29m57.592141123s) [noise=true , address=81.171.14.70:4028 , piece_id=KYILI6WH7GV7PIMHWK7626N6NRNEE34HRADFXVK7YE5ZZKFTLNQA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.891215435 (279h29m57.592160319s) [seg_pos={0 0}, upload=245957]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:43:30.891326763 (279h29m57.592271658s) [noise=true , address=81.171.14.70:4047 , piece_id=XCQQYTJLEAGC4EB3ERHXNXIBY45F4KYK743WRWF3XT6S3GRI5MJA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF
Nov 8 02:43:30.891334968 (279h29m57.592279853s) [noise=true , address=81.171.14.70:4047 , piece_id=XCQQYTJLEAGC4EB3ERHXNXIBY45F4KYK743WRWF3XT6S3GRI5MJA, seg_pos={0 0}, upload=245957]: Long tail cancellation due to optimal threshold
Nov 8 02:43:30.891388920 (279h29m57.592333815s) [noise=true , address=81.171.14.70:4038 , piece_id=6IJFS6ENFR7L4LW2EYKJRKPNPUWPL6L7Q67M6NMMJTQB6ZHGFANQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: read tcp 5.161.89.252:45454->81.171.14.70:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled
Nov 8 02:43:30.891395792 (279h29m57.592340688s) [noise=true , address=81.171.14.70:4038 , piece_id=6IJFS6ENFR7L4LW2EYKJRKPNPUWPL6L7Q67M6NMMJTQB6ZHGFANQ, seg_pos={0 0}, upload=245957]: Long tail cancellation due to optimal threshold
Nov 8 02:43:30.891409588 (279h29m57.592354473s) [seg_pos={0 0}, upload=245957]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:43:30.891457218 (279h29m57.592402113s) [upload=245957]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:43:30.891460744 (279h29m57.59240563s) [upload=245957]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:43:31.034541897 (279h29m57.735486782s) [upload=245957]: Done uploading segments...
Nov 8 02:43:31.034555543 (279h29m57.735500438s) [upload=245957]: Upload finished. err: <nil>
Duration: 6.146046072s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.831270463s
FAIL (2025-11-08 02:46:35 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.831295882s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [.............X...X.........X........X..........X.......X....] duration:
3.952152336s
FAIL (2025-11-08 02:46:10 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
s=185.167.204.206:4048 , piece_id=AKYB6E3HZJN25HWITXQDEVDYKUQKCXTRYURH4MNGYIBBMQQTIDPA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.729481152 (279h29m55.430426036s) [noise=true , address=81.171.14.70:4047 , piece_id=XCQQYTJLEAGC4EB3ERHXNXIBY45F4KYK743WRWF3XT6S3GRI5MJA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.729742581 (279h29m55.430687476s) [noise=true , address=185.167.204.205:4028 , piece_id=7V6V5JAMMA76RNDLAN57UXHA5SEUOODDX2Y6YTTZ4IMEU6FNRMMA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.730318441 (279h29m55.431263325s) [noise=true , address=89.149.201.147:4017 , piece_id=REYZSF3QQYJKJUNLCINYO2XEKWP5LCDWZRQC3UZ3SAFOCHZS2UJA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.731989455 (279h29m55.432934339s) [noise=true , address=81.171.14.70:4031 , piece_id=BRYASIH2IENI6SH36ZOJJEYEB2FBVIFOCENHZCGIVWRDCIXIYFPA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.732373715 (279h29m55.43331861s) [noise=true , address=81.171.14.70:4027 , piece_id=ENUXPPWGRMCVI7ZHNB2YEALOTE3VP2J3UB56LJMLGXJV5MSKF2UQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.732738249 (279h29m55.433683134s) [noise=true , address=185.167.204.205:4012 , piece_id=PYA7GWYHRD5ZM4XNWGXAHJOTP4M2BLAU3QBDU4O6TAURUJJ3EXZQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.733069279 (279h29m55.434014164s) [noise=true , address=81.171.14.70:4038 , piece_id=6IJFS6ENFR7L4LW2EYKJRKPNPUWPL6L7Q67M6NMMJTQB6ZHGFANQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.733571130 (279h29m55.434516025s) [noise=true , address=89.149.201.147:4016 , piece_id=Y5UI73372TWUQCAOAIIUF5MET3CPURKZBDR6K3YZVVF6V3JQWL6Q, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.733945021 (279h29m55.434889907s) [noise=true , address=185.167.204.205:4016 , piece_id=4O7EBNS533D47EK3NJDVEDZ4KGWFV257DBIOOVWVKROD64MHEFSQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:29.239559670 (279h29m55.940504585s) [upload=245957]: Next returned nil segment
Nov 8 02:43:29.239576071 (279h29m55.940520986s) [upload=245957]: Waiting for error group managing segments...
Nov 8 02:43:29.448419100 (279h29m56.149364015s) [noise=true , address=185.167.204.205:4021 , piece_id=IZEVUOQZEO5BJEH5TV53GTMSY37DBPZVAXX45RYSQPTWKWK6VTAA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.455980619 (279h29m56.156925504s) [noise=true , address=185.167.204.206:4048 , piece_id=AKYB6E3HZJN25HWITXQDEVDYKUQKCXTRYURH4MNGYIBBMQQTIDPA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.492563218 (279h29m56.193508133s) [noise=true , address=185.167.204.205:4016 , piece_id=4O7EBNS533D47EK3NJDVEDZ4KGWFV257DBIOOVWVKROD64MHEFSQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.722147970 (279h29m56.423092865s) [noise=true , address=185.167.204.206:4050 , piece_id=LC5R4QT2BNKQTISHG6MB4VXQ6G2HLIPWJH7LVRZTLKMJHFB5YAHQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.744127447 (279h29m56.445072332s) [noise=true , address=185.167.204.205:4012 , piece_id=PYA7GWYHRD5ZM4XNWGXAHJOTP4M2BLAU3QBDU4O6TAURUJJ3EXZQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.750938157 (279h29m56.451883042s) [noise=true , address=81.171.14.70:4031 , piece_id=BRYASIH2IENI6SH36ZOJJEYEB2FBVIFOCENHZCGIVWRDCIXIYFPA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.836693364 (279h29m56.537638249s) [noise=true , address=81.171.14.70:4030 , piece_id=FNTQD6KEYJBUFAEPHPSWFZ2CYEBUXM77MK56OIYHUELVATY57ECQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.867734622 (279h29m56.568679507s) [noise=true , address=185.167.204.206:4063 , piece_id=AS3QWIMCTMDWW6MU7E7OQQE4W4CNYGQYEBCZNPONI3VF5FAFNTMQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.915844196 (279h29m56.616789091s) [noise=true , address=89.149.201.147:4015 , piece_id=3XFFAKR42BP3QV6WTZCOJ3GZDE7BP7JPX7XXR2AWMJXBUASVRREQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.919243079 (279h29m56.620187965s) [noise=true , address=89.149.201.147:4013 , piece_id=GH6S2X2NHR6XZERNDQ4VCIXG6WTGUQMVVARP6E5QH7JCOMK3MP2A, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.929755662 (279h29m56.630700557s) [noise=true , address=81.171.14.70:4033 , piece_id=6CS4IEZ7H6NPD4B5JIWIPMEW3J35CGBPQEHUZVYLVOISWURQD2MQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.939420996 (279h29m56.640365882s) [noise=true , address=185.167.204.206:4058 , piece_id=A65WCTY5NBLMPILIWERTM5GTSZSSMY3WIPOSARUFG7XHNYTPRWYA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.965928062 (279h29m56.666872947s) [noise=true , address=185.167.204.206:4059 , piece_id=LLK5WUYF5L253KHM4D35IW2HG3AHOITH3YTJIWIMNKVT2EU44HMQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.966014364 (279h29m56.666959259s) [noise=true , address=81.171.14.70:4027 , piece_id=ENUXPPWGRMCVI7ZHNB2YEALOTE3VP2J3UB56LJMLGXJV5MSKF2UQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.977664951 (279h29m56.678609846s) [noise=true , address=185.167.204.205:4023 , piece_id=CY6IS6YNVY3LD7N4BDV3DIESHWLFVWOP7UPQROK7GXWNJ266OJGA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.167000160 (279h29m56.867945055s) [noise=true , address=89.149.201.147:4006 , piece_id=7UQMSU4DLZSQY7Z23TH5ZYI4PB5LFORSYAALZPEX2ANIQVVRXQ7A, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.188026247 (279h29m56.888971133s) [noise=true , address=81.171.14.70:4029 , piece_id=AOEB7P4EAWL4BWQP2AEUM53VMIH2CC3OO2TJTW4VZBQVJIESQQYQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.219950881 (279h29m56.920895776s) [noise=true , address=185.167.204.205:4019 , piece_id=FC3QKHT4XMSM3DYHZ4K4KOGD7XU74L3X6WFJZ7ZKPRX2EBYP73IQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.380077468 (279h29m57.081022353s) [noise=true , address=81.171.14.70:4036 , piece_id=ZCYZAAG6JKW3JJXS2LZ5PFZ6GELNK5VZ3TWHOUMQEEHZENQ7POPA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.383417131 (279h29m57.084362026s) [noise=true , address=89.149.201.147:4017 , piece_id=REYZSF3QQYJKJUNLCINYO2XEKWP5LCDWZRQC3UZ3SAFOCHZS2UJA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.398552363 (279h29m57.099497258s) [noise=true , address=81.171.14.70:4035 , piece_id=YRYQEFRTJQYHUA5WI6E6ZQMXH6GHV6DGH2GAIBQ2VA3LUYWPESXA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.693120991 (279h29m57.394065886s) [noise=true , address=185.167.204.205:4028 , piece_id=7V6V5JAMMA76RNDLAN57UXHA5SEUOODDX2Y6YTTZ4IMEU6FNRMMA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.762215857 (279h29m57.463160741s) [noise=true , address=89.149.201.147:4009 , piece_id=2ZR42I73WIQ5OX5T5PFGF26ILNQXJHKI4COXVGBB3EFXFVT7O4GQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.819050832 (279h29m57.519995727s) [noise=true , address=89.149.201.147:4016 , piece_id=Y5UI73372TWUQCAOAIIUF5MET3CPURKZBDR6K3YZVVF6V3JQWL6Q, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.874626807 (279h29m57.575571703s) [noise=true , address=185.167.204.206:4071 , piece_id=JMSZYQTZEHJ2DTCSURS335JPUR3I6AVKH4E6PB6Q2YAZ655PRH6A, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.891196239 (279h29m57.592141123s) [noise=true , address=81.171.14.70:4028 , piece_id=KYILI6WH7GV7PIMHWK7626N6NRNEE34HRADFXVK7YE5ZZKFTLNQA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.891215435 (279h29m57.592160319s) [seg_pos={0 0}, upload=245957]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:43:30.891326763 (279h29m57.592271658s) [noise=true , address=81.171.14.70:4047 , piece_id=XCQQYTJLEAGC4EB3ERHXNXIBY45F4KYK743WRWF3XT6S3GRI5MJA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF
Nov 8 02:43:30.891334968 (279h29m57.592279853s) [noise=true , address=81.171.14.70:4047 , piece_id=XCQQYTJLEAGC4EB3ERHXNXIBY45F4KYK743WRWF3XT6S3GRI5MJA, seg_pos={0 0}, upload=245957]: Long tail cancellation due to optimal threshold
Nov 8 02:43:30.891388920 (279h29m57.592333815s) [noise=true , address=81.171.14.70:4038 , piece_id=6IJFS6ENFR7L4LW2EYKJRKPNPUWPL6L7Q67M6NMMJTQB6ZHGFANQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: read tcp 5.161.89.252:45454->81.171.14.70:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled
Nov 8 02:43:30.891395792 (279h29m57.592340688s) [noise=true , address=81.171.14.70:4038 , piece_id=6IJFS6ENFR7L4LW2EYKJRKPNPUWPL6L7Q67M6NMMJTQB6ZHGFANQ, seg_pos={0 0}, upload=245957]: Long tail cancellation due to optimal threshold
Nov 8 02:43:30.891409588 (279h29m57.592354473s) [seg_pos={0 0}, upload=245957]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:43:30.891457218 (279h29m57.592402113s) [upload=245957]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:43:30.891460744 (279h29m57.59240563s) [upload=245957]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:43:31.034541897 (279h29m57.735486782s) [upload=245957]: Done uploading segments...
Nov 8 02:43:31.034555543 (279h29m57.735500438s) [upload=245957]: Upload finished. err: <nil>
Duration: 3.952171091s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [..............X...X.........X........X..........X.......X...] duration:
6.720514079s
FAIL (2025-11-08 02:45:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
s=185.167.204.206:4048 , piece_id=AKYB6E3HZJN25HWITXQDEVDYKUQKCXTRYURH4MNGYIBBMQQTIDPA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.729481152 (279h29m55.430426036s) [noise=true , address=81.171.14.70:4047 , piece_id=XCQQYTJLEAGC4EB3ERHXNXIBY45F4KYK743WRWF3XT6S3GRI5MJA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.729742581 (279h29m55.430687476s) [noise=true , address=185.167.204.205:4028 , piece_id=7V6V5JAMMA76RNDLAN57UXHA5SEUOODDX2Y6YTTZ4IMEU6FNRMMA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.730318441 (279h29m55.431263325s) [noise=true , address=89.149.201.147:4017 , piece_id=REYZSF3QQYJKJUNLCINYO2XEKWP5LCDWZRQC3UZ3SAFOCHZS2UJA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.731989455 (279h29m55.432934339s) [noise=true , address=81.171.14.70:4031 , piece_id=BRYASIH2IENI6SH36ZOJJEYEB2FBVIFOCENHZCGIVWRDCIXIYFPA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.732373715 (279h29m55.43331861s) [noise=true , address=81.171.14.70:4027 , piece_id=ENUXPPWGRMCVI7ZHNB2YEALOTE3VP2J3UB56LJMLGXJV5MSKF2UQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.732738249 (279h29m55.433683134s) [noise=true , address=185.167.204.205:4012 , piece_id=PYA7GWYHRD5ZM4XNWGXAHJOTP4M2BLAU3QBDU4O6TAURUJJ3EXZQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.733069279 (279h29m55.434014164s) [noise=true , address=81.171.14.70:4038 , piece_id=6IJFS6ENFR7L4LW2EYKJRKPNPUWPL6L7Q67M6NMMJTQB6ZHGFANQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.733571130 (279h29m55.434516025s) [noise=true , address=89.149.201.147:4016 , piece_id=Y5UI73372TWUQCAOAIIUF5MET3CPURKZBDR6K3YZVVF6V3JQWL6Q, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.733945021 (279h29m55.434889907s) [noise=true , address=185.167.204.205:4016 , piece_id=4O7EBNS533D47EK3NJDVEDZ4KGWFV257DBIOOVWVKROD64MHEFSQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:29.239559670 (279h29m55.940504585s) [upload=245957]: Next returned nil segment
Nov 8 02:43:29.239576071 (279h29m55.940520986s) [upload=245957]: Waiting for error group managing segments...
Nov 8 02:43:29.448419100 (279h29m56.149364015s) [noise=true , address=185.167.204.205:4021 , piece_id=IZEVUOQZEO5BJEH5TV53GTMSY37DBPZVAXX45RYSQPTWKWK6VTAA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.455980619 (279h29m56.156925504s) [noise=true , address=185.167.204.206:4048 , piece_id=AKYB6E3HZJN25HWITXQDEVDYKUQKCXTRYURH4MNGYIBBMQQTIDPA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.492563218 (279h29m56.193508133s) [noise=true , address=185.167.204.205:4016 , piece_id=4O7EBNS533D47EK3NJDVEDZ4KGWFV257DBIOOVWVKROD64MHEFSQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.722147970 (279h29m56.423092865s) [noise=true , address=185.167.204.206:4050 , piece_id=LC5R4QT2BNKQTISHG6MB4VXQ6G2HLIPWJH7LVRZTLKMJHFB5YAHQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.744127447 (279h29m56.445072332s) [noise=true , address=185.167.204.205:4012 , piece_id=PYA7GWYHRD5ZM4XNWGXAHJOTP4M2BLAU3QBDU4O6TAURUJJ3EXZQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.750938157 (279h29m56.451883042s) [noise=true , address=81.171.14.70:4031 , piece_id=BRYASIH2IENI6SH36ZOJJEYEB2FBVIFOCENHZCGIVWRDCIXIYFPA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.836693364 (279h29m56.537638249s) [noise=true , address=81.171.14.70:4030 , piece_id=FNTQD6KEYJBUFAEPHPSWFZ2CYEBUXM77MK56OIYHUELVATY57ECQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.867734622 (279h29m56.568679507s) [noise=true , address=185.167.204.206:4063 , piece_id=AS3QWIMCTMDWW6MU7E7OQQE4W4CNYGQYEBCZNPONI3VF5FAFNTMQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.915844196 (279h29m56.616789091s) [noise=true , address=89.149.201.147:4015 , piece_id=3XFFAKR42BP3QV6WTZCOJ3GZDE7BP7JPX7XXR2AWMJXBUASVRREQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.919243079 (279h29m56.620187965s) [noise=true , address=89.149.201.147:4013 , piece_id=GH6S2X2NHR6XZERNDQ4VCIXG6WTGUQMVVARP6E5QH7JCOMK3MP2A, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.929755662 (279h29m56.630700557s) [noise=true , address=81.171.14.70:4033 , piece_id=6CS4IEZ7H6NPD4B5JIWIPMEW3J35CGBPQEHUZVYLVOISWURQD2MQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.939420996 (279h29m56.640365882s) [noise=true , address=185.167.204.206:4058 , piece_id=A65WCTY5NBLMPILIWERTM5GTSZSSMY3WIPOSARUFG7XHNYTPRWYA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.965928062 (279h29m56.666872947s) [noise=true , address=185.167.204.206:4059 , piece_id=LLK5WUYF5L253KHM4D35IW2HG3AHOITH3YTJIWIMNKVT2EU44HMQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.966014364 (279h29m56.666959259s) [noise=true , address=81.171.14.70:4027 , piece_id=ENUXPPWGRMCVI7ZHNB2YEALOTE3VP2J3UB56LJMLGXJV5MSKF2UQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.977664951 (279h29m56.678609846s) [noise=true , address=185.167.204.205:4023 , piece_id=CY6IS6YNVY3LD7N4BDV3DIESHWLFVWOP7UPQROK7GXWNJ266OJGA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.167000160 (279h29m56.867945055s) [noise=true , address=89.149.201.147:4006 , piece_id=7UQMSU4DLZSQY7Z23TH5ZYI4PB5LFORSYAALZPEX2ANIQVVRXQ7A, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.188026247 (279h29m56.888971133s) [noise=true , address=81.171.14.70:4029 , piece_id=AOEB7P4EAWL4BWQP2AEUM53VMIH2CC3OO2TJTW4VZBQVJIESQQYQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.219950881 (279h29m56.920895776s) [noise=true , address=185.167.204.205:4019 , piece_id=FC3QKHT4XMSM3DYHZ4K4KOGD7XU74L3X6WFJZ7ZKPRX2EBYP73IQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.380077468 (279h29m57.081022353s) [noise=true , address=81.171.14.70:4036 , piece_id=ZCYZAAG6JKW3JJXS2LZ5PFZ6GELNK5VZ3TWHOUMQEEHZENQ7POPA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.383417131 (279h29m57.084362026s) [noise=true , address=89.149.201.147:4017 , piece_id=REYZSF3QQYJKJUNLCINYO2XEKWP5LCDWZRQC3UZ3SAFOCHZS2UJA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.398552363 (279h29m57.099497258s) [noise=true , address=81.171.14.70:4035 , piece_id=YRYQEFRTJQYHUA5WI6E6ZQMXH6GHV6DGH2GAIBQ2VA3LUYWPESXA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.693120991 (279h29m57.394065886s) [noise=true , address=185.167.204.205:4028 , piece_id=7V6V5JAMMA76RNDLAN57UXHA5SEUOODDX2Y6YTTZ4IMEU6FNRMMA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.762215857 (279h29m57.463160741s) [noise=true , address=89.149.201.147:4009 , piece_id=2ZR42I73WIQ5OX5T5PFGF26ILNQXJHKI4COXVGBB3EFXFVT7O4GQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.819050832 (279h29m57.519995727s) [noise=true , address=89.149.201.147:4016 , piece_id=Y5UI73372TWUQCAOAIIUF5MET3CPURKZBDR6K3YZVVF6V3JQWL6Q, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.874626807 (279h29m57.575571703s) [noise=true , address=185.167.204.206:4071 , piece_id=JMSZYQTZEHJ2DTCSURS335JPUR3I6AVKH4E6PB6Q2YAZ655PRH6A, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.891196239 (279h29m57.592141123s) [noise=true , address=81.171.14.70:4028 , piece_id=KYILI6WH7GV7PIMHWK7626N6NRNEE34HRADFXVK7YE5ZZKFTLNQA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.891215435 (279h29m57.592160319s) [seg_pos={0 0}, upload=245957]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:43:30.891326763 (279h29m57.592271658s) [noise=true , address=81.171.14.70:4047 , piece_id=XCQQYTJLEAGC4EB3ERHXNXIBY45F4KYK743WRWF3XT6S3GRI5MJA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF
Nov 8 02:43:30.891334968 (279h29m57.592279853s) [noise=true , address=81.171.14.70:4047 , piece_id=XCQQYTJLEAGC4EB3ERHXNXIBY45F4KYK743WRWF3XT6S3GRI5MJA, seg_pos={0 0}, upload=245957]: Long tail cancellation due to optimal threshold
Nov 8 02:43:30.891388920 (279h29m57.592333815s) [noise=true , address=81.171.14.70:4038 , piece_id=6IJFS6ENFR7L4LW2EYKJRKPNPUWPL6L7Q67M6NMMJTQB6ZHGFANQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: read tcp 5.161.89.252:45454->81.171.14.70:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled
Nov 8 02:43:30.891395792 (279h29m57.592340688s) [noise=true , address=81.171.14.70:4038 , piece_id=6IJFS6ENFR7L4LW2EYKJRKPNPUWPL6L7Q67M6NMMJTQB6ZHGFANQ, seg_pos={0 0}, upload=245957]: Long tail cancellation due to optimal threshold
Nov 8 02:43:30.891409588 (279h29m57.592354473s) [seg_pos={0 0}, upload=245957]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:43:30.891457218 (279h29m57.592402113s) [upload=245957]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:43:30.891460744 (279h29m57.59240563s) [upload=245957]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:43:31.034541897 (279h29m57.735486782s) [upload=245957]: Done uploading segments...
Nov 8 02:43:31.034555543 (279h29m57.735500438s) [upload=245957]: Upload finished. err: <nil>
Duration: 6.720528968s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [...............X...X.........X........X..........X.......X..] duration:
22.708499696s
FAIL (2025-11-08 02:45:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
s=185.167.204.206:4048 , piece_id=AKYB6E3HZJN25HWITXQDEVDYKUQKCXTRYURH4MNGYIBBMQQTIDPA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.729481152 (279h29m55.430426036s) [noise=true , address=81.171.14.70:4047 , piece_id=XCQQYTJLEAGC4EB3ERHXNXIBY45F4KYK743WRWF3XT6S3GRI5MJA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.729742581 (279h29m55.430687476s) [noise=true , address=185.167.204.205:4028 , piece_id=7V6V5JAMMA76RNDLAN57UXHA5SEUOODDX2Y6YTTZ4IMEU6FNRMMA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.730318441 (279h29m55.431263325s) [noise=true , address=89.149.201.147:4017 , piece_id=REYZSF3QQYJKJUNLCINYO2XEKWP5LCDWZRQC3UZ3SAFOCHZS2UJA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.731989455 (279h29m55.432934339s) [noise=true , address=81.171.14.70:4031 , piece_id=BRYASIH2IENI6SH36ZOJJEYEB2FBVIFOCENHZCGIVWRDCIXIYFPA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.732373715 (279h29m55.43331861s) [noise=true , address=81.171.14.70:4027 , piece_id=ENUXPPWGRMCVI7ZHNB2YEALOTE3VP2J3UB56LJMLGXJV5MSKF2UQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.732738249 (279h29m55.433683134s) [noise=true , address=185.167.204.205:4012 , piece_id=PYA7GWYHRD5ZM4XNWGXAHJOTP4M2BLAU3QBDU4O6TAURUJJ3EXZQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.733069279 (279h29m55.434014164s) [noise=true , address=81.171.14.70:4038 , piece_id=6IJFS6ENFR7L4LW2EYKJRKPNPUWPL6L7Q67M6NMMJTQB6ZHGFANQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.733571130 (279h29m55.434516025s) [noise=true , address=89.149.201.147:4016 , piece_id=Y5UI73372TWUQCAOAIIUF5MET3CPURKZBDR6K3YZVVF6V3JQWL6Q, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.733945021 (279h29m55.434889907s) [noise=true , address=185.167.204.205:4016 , piece_id=4O7EBNS533D47EK3NJDVEDZ4KGWFV257DBIOOVWVKROD64MHEFSQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:29.239559670 (279h29m55.940504585s) [upload=245957]: Next returned nil segment
Nov 8 02:43:29.239576071 (279h29m55.940520986s) [upload=245957]: Waiting for error group managing segments...
Nov 8 02:43:29.448419100 (279h29m56.149364015s) [noise=true , address=185.167.204.205:4021 , piece_id=IZEVUOQZEO5BJEH5TV53GTMSY37DBPZVAXX45RYSQPTWKWK6VTAA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.455980619 (279h29m56.156925504s) [noise=true , address=185.167.204.206:4048 , piece_id=AKYB6E3HZJN25HWITXQDEVDYKUQKCXTRYURH4MNGYIBBMQQTIDPA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.492563218 (279h29m56.193508133s) [noise=true , address=185.167.204.205:4016 , piece_id=4O7EBNS533D47EK3NJDVEDZ4KGWFV257DBIOOVWVKROD64MHEFSQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.722147970 (279h29m56.423092865s) [noise=true , address=185.167.204.206:4050 , piece_id=LC5R4QT2BNKQTISHG6MB4VXQ6G2HLIPWJH7LVRZTLKMJHFB5YAHQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.744127447 (279h29m56.445072332s) [noise=true , address=185.167.204.205:4012 , piece_id=PYA7GWYHRD5ZM4XNWGXAHJOTP4M2BLAU3QBDU4O6TAURUJJ3EXZQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.750938157 (279h29m56.451883042s) [noise=true , address=81.171.14.70:4031 , piece_id=BRYASIH2IENI6SH36ZOJJEYEB2FBVIFOCENHZCGIVWRDCIXIYFPA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.836693364 (279h29m56.537638249s) [noise=true , address=81.171.14.70:4030 , piece_id=FNTQD6KEYJBUFAEPHPSWFZ2CYEBUXM77MK56OIYHUELVATY57ECQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.867734622 (279h29m56.568679507s) [noise=true , address=185.167.204.206:4063 , piece_id=AS3QWIMCTMDWW6MU7E7OQQE4W4CNYGQYEBCZNPONI3VF5FAFNTMQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.915844196 (279h29m56.616789091s) [noise=true , address=89.149.201.147:4015 , piece_id=3XFFAKR42BP3QV6WTZCOJ3GZDE7BP7JPX7XXR2AWMJXBUASVRREQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.919243079 (279h29m56.620187965s) [noise=true , address=89.149.201.147:4013 , piece_id=GH6S2X2NHR6XZERNDQ4VCIXG6WTGUQMVVARP6E5QH7JCOMK3MP2A, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.929755662 (279h29m56.630700557s) [noise=true , address=81.171.14.70:4033 , piece_id=6CS4IEZ7H6NPD4B5JIWIPMEW3J35CGBPQEHUZVYLVOISWURQD2MQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.939420996 (279h29m56.640365882s) [noise=true , address=185.167.204.206:4058 , piece_id=A65WCTY5NBLMPILIWERTM5GTSZSSMY3WIPOSARUFG7XHNYTPRWYA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.965928062 (279h29m56.666872947s) [noise=true , address=185.167.204.206:4059 , piece_id=LLK5WUYF5L253KHM4D35IW2HG3AHOITH3YTJIWIMNKVT2EU44HMQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.966014364 (279h29m56.666959259s) [noise=true , address=81.171.14.70:4027 , piece_id=ENUXPPWGRMCVI7ZHNB2YEALOTE3VP2J3UB56LJMLGXJV5MSKF2UQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.977664951 (279h29m56.678609846s) [noise=true , address=185.167.204.205:4023 , piece_id=CY6IS6YNVY3LD7N4BDV3DIESHWLFVWOP7UPQROK7GXWNJ266OJGA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.167000160 (279h29m56.867945055s) [noise=true , address=89.149.201.147:4006 , piece_id=7UQMSU4DLZSQY7Z23TH5ZYI4PB5LFORSYAALZPEX2ANIQVVRXQ7A, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.188026247 (279h29m56.888971133s) [noise=true , address=81.171.14.70:4029 , piece_id=AOEB7P4EAWL4BWQP2AEUM53VMIH2CC3OO2TJTW4VZBQVJIESQQYQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.219950881 (279h29m56.920895776s) [noise=true , address=185.167.204.205:4019 , piece_id=FC3QKHT4XMSM3DYHZ4K4KOGD7XU74L3X6WFJZ7ZKPRX2EBYP73IQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.380077468 (279h29m57.081022353s) [noise=true , address=81.171.14.70:4036 , piece_id=ZCYZAAG6JKW3JJXS2LZ5PFZ6GELNK5VZ3TWHOUMQEEHZENQ7POPA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.383417131 (279h29m57.084362026s) [noise=true , address=89.149.201.147:4017 , piece_id=REYZSF3QQYJKJUNLCINYO2XEKWP5LCDWZRQC3UZ3SAFOCHZS2UJA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.398552363 (279h29m57.099497258s) [noise=true , address=81.171.14.70:4035 , piece_id=YRYQEFRTJQYHUA5WI6E6ZQMXH6GHV6DGH2GAIBQ2VA3LUYWPESXA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.693120991 (279h29m57.394065886s) [noise=true , address=185.167.204.205:4028 , piece_id=7V6V5JAMMA76RNDLAN57UXHA5SEUOODDX2Y6YTTZ4IMEU6FNRMMA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.762215857 (279h29m57.463160741s) [noise=true , address=89.149.201.147:4009 , piece_id=2ZR42I73WIQ5OX5T5PFGF26ILNQXJHKI4COXVGBB3EFXFVT7O4GQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.819050832 (279h29m57.519995727s) [noise=true , address=89.149.201.147:4016 , piece_id=Y5UI73372TWUQCAOAIIUF5MET3CPURKZBDR6K3YZVVF6V3JQWL6Q, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.874626807 (279h29m57.575571703s) [noise=true , address=185.167.204.206:4071 , piece_id=JMSZYQTZEHJ2DTCSURS335JPUR3I6AVKH4E6PB6Q2YAZ655PRH6A, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.891196239 (279h29m57.592141123s) [noise=true , address=81.171.14.70:4028 , piece_id=KYILI6WH7GV7PIMHWK7626N6NRNEE34HRADFXVK7YE5ZZKFTLNQA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.891215435 (279h29m57.592160319s) [seg_pos={0 0}, upload=245957]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:43:30.891326763 (279h29m57.592271658s) [noise=true , address=81.171.14.70:4047 , piece_id=XCQQYTJLEAGC4EB3ERHXNXIBY45F4KYK743WRWF3XT6S3GRI5MJA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF
Nov 8 02:43:30.891334968 (279h29m57.592279853s) [noise=true , address=81.171.14.70:4047 , piece_id=XCQQYTJLEAGC4EB3ERHXNXIBY45F4KYK743WRWF3XT6S3GRI5MJA, seg_pos={0 0}, upload=245957]: Long tail cancellation due to optimal threshold
Nov 8 02:43:30.891388920 (279h29m57.592333815s) [noise=true , address=81.171.14.70:4038 , piece_id=6IJFS6ENFR7L4LW2EYKJRKPNPUWPL6L7Q67M6NMMJTQB6ZHGFANQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: read tcp 5.161.89.252:45454->81.171.14.70:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled
Nov 8 02:43:30.891395792 (279h29m57.592340688s) [noise=true , address=81.171.14.70:4038 , piece_id=6IJFS6ENFR7L4LW2EYKJRKPNPUWPL6L7Q67M6NMMJTQB6ZHGFANQ, seg_pos={0 0}, upload=245957]: Long tail cancellation due to optimal threshold
Nov 8 02:43:30.891409588 (279h29m57.592354473s) [seg_pos={0 0}, upload=245957]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:43:30.891457218 (279h29m57.592402113s) [upload=245957]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:43:30.891460744 (279h29m57.59240563s) [upload=245957]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:43:31.034541897 (279h29m57.735486782s) [upload=245957]: Done uploading segments...
Nov 8 02:43:31.034555543 (279h29m57.735500438s) [upload=245957]: Upload finished. err: <nil>
Duration: 22.708520795s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
3.267805215s
FAIL (2025-11-08 02:45:35 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.267818159s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.966443955s
FAIL (2025-11-08 02:45:13 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.966468881s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [................X...X.........X........X..........X.......X.] duration:
24.512257001s
FAIL (2025-11-08 02:44:56 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
s=185.167.204.206:4048 , piece_id=AKYB6E3HZJN25HWITXQDEVDYKUQKCXTRYURH4MNGYIBBMQQTIDPA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.729481152 (279h29m55.430426036s) [noise=true , address=81.171.14.70:4047 , piece_id=XCQQYTJLEAGC4EB3ERHXNXIBY45F4KYK743WRWF3XT6S3GRI5MJA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.729742581 (279h29m55.430687476s) [noise=true , address=185.167.204.205:4028 , piece_id=7V6V5JAMMA76RNDLAN57UXHA5SEUOODDX2Y6YTTZ4IMEU6FNRMMA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.730318441 (279h29m55.431263325s) [noise=true , address=89.149.201.147:4017 , piece_id=REYZSF3QQYJKJUNLCINYO2XEKWP5LCDWZRQC3UZ3SAFOCHZS2UJA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.731989455 (279h29m55.432934339s) [noise=true , address=81.171.14.70:4031 , piece_id=BRYASIH2IENI6SH36ZOJJEYEB2FBVIFOCENHZCGIVWRDCIXIYFPA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.732373715 (279h29m55.43331861s) [noise=true , address=81.171.14.70:4027 , piece_id=ENUXPPWGRMCVI7ZHNB2YEALOTE3VP2J3UB56LJMLGXJV5MSKF2UQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.732738249 (279h29m55.433683134s) [noise=true , address=185.167.204.205:4012 , piece_id=PYA7GWYHRD5ZM4XNWGXAHJOTP4M2BLAU3QBDU4O6TAURUJJ3EXZQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.733069279 (279h29m55.434014164s) [noise=true , address=81.171.14.70:4038 , piece_id=6IJFS6ENFR7L4LW2EYKJRKPNPUWPL6L7Q67M6NMMJTQB6ZHGFANQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.733571130 (279h29m55.434516025s) [noise=true , address=89.149.201.147:4016 , piece_id=Y5UI73372TWUQCAOAIIUF5MET3CPURKZBDR6K3YZVVF6V3JQWL6Q, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.733945021 (279h29m55.434889907s) [noise=true , address=185.167.204.205:4016 , piece_id=4O7EBNS533D47EK3NJDVEDZ4KGWFV257DBIOOVWVKROD64MHEFSQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:29.239559670 (279h29m55.940504585s) [upload=245957]: Next returned nil segment
Nov 8 02:43:29.239576071 (279h29m55.940520986s) [upload=245957]: Waiting for error group managing segments...
Nov 8 02:43:29.448419100 (279h29m56.149364015s) [noise=true , address=185.167.204.205:4021 , piece_id=IZEVUOQZEO5BJEH5TV53GTMSY37DBPZVAXX45RYSQPTWKWK6VTAA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.455980619 (279h29m56.156925504s) [noise=true , address=185.167.204.206:4048 , piece_id=AKYB6E3HZJN25HWITXQDEVDYKUQKCXTRYURH4MNGYIBBMQQTIDPA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.492563218 (279h29m56.193508133s) [noise=true , address=185.167.204.205:4016 , piece_id=4O7EBNS533D47EK3NJDVEDZ4KGWFV257DBIOOVWVKROD64MHEFSQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.722147970 (279h29m56.423092865s) [noise=true , address=185.167.204.206:4050 , piece_id=LC5R4QT2BNKQTISHG6MB4VXQ6G2HLIPWJH7LVRZTLKMJHFB5YAHQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.744127447 (279h29m56.445072332s) [noise=true , address=185.167.204.205:4012 , piece_id=PYA7GWYHRD5ZM4XNWGXAHJOTP4M2BLAU3QBDU4O6TAURUJJ3EXZQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.750938157 (279h29m56.451883042s) [noise=true , address=81.171.14.70:4031 , piece_id=BRYASIH2IENI6SH36ZOJJEYEB2FBVIFOCENHZCGIVWRDCIXIYFPA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.836693364 (279h29m56.537638249s) [noise=true , address=81.171.14.70:4030 , piece_id=FNTQD6KEYJBUFAEPHPSWFZ2CYEBUXM77MK56OIYHUELVATY57ECQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.867734622 (279h29m56.568679507s) [noise=true , address=185.167.204.206:4063 , piece_id=AS3QWIMCTMDWW6MU7E7OQQE4W4CNYGQYEBCZNPONI3VF5FAFNTMQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.915844196 (279h29m56.616789091s) [noise=true , address=89.149.201.147:4015 , piece_id=3XFFAKR42BP3QV6WTZCOJ3GZDE7BP7JPX7XXR2AWMJXBUASVRREQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.919243079 (279h29m56.620187965s) [noise=true , address=89.149.201.147:4013 , piece_id=GH6S2X2NHR6XZERNDQ4VCIXG6WTGUQMVVARP6E5QH7JCOMK3MP2A, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.929755662 (279h29m56.630700557s) [noise=true , address=81.171.14.70:4033 , piece_id=6CS4IEZ7H6NPD4B5JIWIPMEW3J35CGBPQEHUZVYLVOISWURQD2MQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.939420996 (279h29m56.640365882s) [noise=true , address=185.167.204.206:4058 , piece_id=A65WCTY5NBLMPILIWERTM5GTSZSSMY3WIPOSARUFG7XHNYTPRWYA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.965928062 (279h29m56.666872947s) [noise=true , address=185.167.204.206:4059 , piece_id=LLK5WUYF5L253KHM4D35IW2HG3AHOITH3YTJIWIMNKVT2EU44HMQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.966014364 (279h29m56.666959259s) [noise=true , address=81.171.14.70:4027 , piece_id=ENUXPPWGRMCVI7ZHNB2YEALOTE3VP2J3UB56LJMLGXJV5MSKF2UQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.977664951 (279h29m56.678609846s) [noise=true , address=185.167.204.205:4023 , piece_id=CY6IS6YNVY3LD7N4BDV3DIESHWLFVWOP7UPQROK7GXWNJ266OJGA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.167000160 (279h29m56.867945055s) [noise=true , address=89.149.201.147:4006 , piece_id=7UQMSU4DLZSQY7Z23TH5ZYI4PB5LFORSYAALZPEX2ANIQVVRXQ7A, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.188026247 (279h29m56.888971133s) [noise=true , address=81.171.14.70:4029 , piece_id=AOEB7P4EAWL4BWQP2AEUM53VMIH2CC3OO2TJTW4VZBQVJIESQQYQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.219950881 (279h29m56.920895776s) [noise=true , address=185.167.204.205:4019 , piece_id=FC3QKHT4XMSM3DYHZ4K4KOGD7XU74L3X6WFJZ7ZKPRX2EBYP73IQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.380077468 (279h29m57.081022353s) [noise=true , address=81.171.14.70:4036 , piece_id=ZCYZAAG6JKW3JJXS2LZ5PFZ6GELNK5VZ3TWHOUMQEEHZENQ7POPA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.383417131 (279h29m57.084362026s) [noise=true , address=89.149.201.147:4017 , piece_id=REYZSF3QQYJKJUNLCINYO2XEKWP5LCDWZRQC3UZ3SAFOCHZS2UJA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.398552363 (279h29m57.099497258s) [noise=true , address=81.171.14.70:4035 , piece_id=YRYQEFRTJQYHUA5WI6E6ZQMXH6GHV6DGH2GAIBQ2VA3LUYWPESXA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.693120991 (279h29m57.394065886s) [noise=true , address=185.167.204.205:4028 , piece_id=7V6V5JAMMA76RNDLAN57UXHA5SEUOODDX2Y6YTTZ4IMEU6FNRMMA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.762215857 (279h29m57.463160741s) [noise=true , address=89.149.201.147:4009 , piece_id=2ZR42I73WIQ5OX5T5PFGF26ILNQXJHKI4COXVGBB3EFXFVT7O4GQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.819050832 (279h29m57.519995727s) [noise=true , address=89.149.201.147:4016 , piece_id=Y5UI73372TWUQCAOAIIUF5MET3CPURKZBDR6K3YZVVF6V3JQWL6Q, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.874626807 (279h29m57.575571703s) [noise=true , address=185.167.204.206:4071 , piece_id=JMSZYQTZEHJ2DTCSURS335JPUR3I6AVKH4E6PB6Q2YAZ655PRH6A, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.891196239 (279h29m57.592141123s) [noise=true , address=81.171.14.70:4028 , piece_id=KYILI6WH7GV7PIMHWK7626N6NRNEE34HRADFXVK7YE5ZZKFTLNQA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.891215435 (279h29m57.592160319s) [seg_pos={0 0}, upload=245957]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:43:30.891326763 (279h29m57.592271658s) [noise=true , address=81.171.14.70:4047 , piece_id=XCQQYTJLEAGC4EB3ERHXNXIBY45F4KYK743WRWF3XT6S3GRI5MJA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF
Nov 8 02:43:30.891334968 (279h29m57.592279853s) [noise=true , address=81.171.14.70:4047 , piece_id=XCQQYTJLEAGC4EB3ERHXNXIBY45F4KYK743WRWF3XT6S3GRI5MJA, seg_pos={0 0}, upload=245957]: Long tail cancellation due to optimal threshold
Nov 8 02:43:30.891388920 (279h29m57.592333815s) [noise=true , address=81.171.14.70:4038 , piece_id=6IJFS6ENFR7L4LW2EYKJRKPNPUWPL6L7Q67M6NMMJTQB6ZHGFANQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: read tcp 5.161.89.252:45454->81.171.14.70:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled
Nov 8 02:43:30.891395792 (279h29m57.592340688s) [noise=true , address=81.171.14.70:4038 , piece_id=6IJFS6ENFR7L4LW2EYKJRKPNPUWPL6L7Q67M6NMMJTQB6ZHGFANQ, seg_pos={0 0}, upload=245957]: Long tail cancellation due to optimal threshold
Nov 8 02:43:30.891409588 (279h29m57.592354473s) [seg_pos={0 0}, upload=245957]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:43:30.891457218 (279h29m57.592402113s) [upload=245957]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:43:30.891460744 (279h29m57.59240563s) [upload=245957]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:43:31.034541897 (279h29m57.735486782s) [upload=245957]: Done uploading segments...
Nov 8 02:43:31.034555543 (279h29m57.735500438s) [upload=245957]: Upload finished. err: <nil>
Duration: 24.512276288s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.894571763s
FAIL (2025-11-08 02:44:24 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.894619262s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [.................X...X.........X........X..........X.......X] duration:
29.099369831s
FAIL (2025-11-08 02:43:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
s=185.167.204.206:4048 , piece_id=AKYB6E3HZJN25HWITXQDEVDYKUQKCXTRYURH4MNGYIBBMQQTIDPA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.729481152 (279h29m55.430426036s) [noise=true , address=81.171.14.70:4047 , piece_id=XCQQYTJLEAGC4EB3ERHXNXIBY45F4KYK743WRWF3XT6S3GRI5MJA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.729742581 (279h29m55.430687476s) [noise=true , address=185.167.204.205:4028 , piece_id=7V6V5JAMMA76RNDLAN57UXHA5SEUOODDX2Y6YTTZ4IMEU6FNRMMA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.730318441 (279h29m55.431263325s) [noise=true , address=89.149.201.147:4017 , piece_id=REYZSF3QQYJKJUNLCINYO2XEKWP5LCDWZRQC3UZ3SAFOCHZS2UJA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.731989455 (279h29m55.432934339s) [noise=true , address=81.171.14.70:4031 , piece_id=BRYASIH2IENI6SH36ZOJJEYEB2FBVIFOCENHZCGIVWRDCIXIYFPA, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.732373715 (279h29m55.43331861s) [noise=true , address=81.171.14.70:4027 , piece_id=ENUXPPWGRMCVI7ZHNB2YEALOTE3VP2J3UB56LJMLGXJV5MSKF2UQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.732738249 (279h29m55.433683134s) [noise=true , address=185.167.204.205:4012 , piece_id=PYA7GWYHRD5ZM4XNWGXAHJOTP4M2BLAU3QBDU4O6TAURUJJ3EXZQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.733069279 (279h29m55.434014164s) [noise=true , address=81.171.14.70:4038 , piece_id=6IJFS6ENFR7L4LW2EYKJRKPNPUWPL6L7Q67M6NMMJTQB6ZHGFANQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.733571130 (279h29m55.434516025s) [noise=true , address=89.149.201.147:4016 , piece_id=Y5UI73372TWUQCAOAIIUF5MET3CPURKZBDR6K3YZVVF6V3JQWL6Q, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:28.733945021 (279h29m55.434889907s) [noise=true , address=185.167.204.205:4016 , piece_id=4O7EBNS533D47EK3NJDVEDZ4KGWFV257DBIOOVWVKROD64MHEFSQ, seg_pos={0 0}, upload=245957]: Uploading piece...
Nov 8 02:43:29.239559670 (279h29m55.940504585s) [upload=245957]: Next returned nil segment
Nov 8 02:43:29.239576071 (279h29m55.940520986s) [upload=245957]: Waiting for error group managing segments...
Nov 8 02:43:29.448419100 (279h29m56.149364015s) [noise=true , address=185.167.204.205:4021 , piece_id=IZEVUOQZEO5BJEH5TV53GTMSY37DBPZVAXX45RYSQPTWKWK6VTAA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.455980619 (279h29m56.156925504s) [noise=true , address=185.167.204.206:4048 , piece_id=AKYB6E3HZJN25HWITXQDEVDYKUQKCXTRYURH4MNGYIBBMQQTIDPA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.492563218 (279h29m56.193508133s) [noise=true , address=185.167.204.205:4016 , piece_id=4O7EBNS533D47EK3NJDVEDZ4KGWFV257DBIOOVWVKROD64MHEFSQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.722147970 (279h29m56.423092865s) [noise=true , address=185.167.204.206:4050 , piece_id=LC5R4QT2BNKQTISHG6MB4VXQ6G2HLIPWJH7LVRZTLKMJHFB5YAHQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.744127447 (279h29m56.445072332s) [noise=true , address=185.167.204.205:4012 , piece_id=PYA7GWYHRD5ZM4XNWGXAHJOTP4M2BLAU3QBDU4O6TAURUJJ3EXZQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.750938157 (279h29m56.451883042s) [noise=true , address=81.171.14.70:4031 , piece_id=BRYASIH2IENI6SH36ZOJJEYEB2FBVIFOCENHZCGIVWRDCIXIYFPA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.836693364 (279h29m56.537638249s) [noise=true , address=81.171.14.70:4030 , piece_id=FNTQD6KEYJBUFAEPHPSWFZ2CYEBUXM77MK56OIYHUELVATY57ECQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.867734622 (279h29m56.568679507s) [noise=true , address=185.167.204.206:4063 , piece_id=AS3QWIMCTMDWW6MU7E7OQQE4W4CNYGQYEBCZNPONI3VF5FAFNTMQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.915844196 (279h29m56.616789091s) [noise=true , address=89.149.201.147:4015 , piece_id=3XFFAKR42BP3QV6WTZCOJ3GZDE7BP7JPX7XXR2AWMJXBUASVRREQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.919243079 (279h29m56.620187965s) [noise=true , address=89.149.201.147:4013 , piece_id=GH6S2X2NHR6XZERNDQ4VCIXG6WTGUQMVVARP6E5QH7JCOMK3MP2A, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.929755662 (279h29m56.630700557s) [noise=true , address=81.171.14.70:4033 , piece_id=6CS4IEZ7H6NPD4B5JIWIPMEW3J35CGBPQEHUZVYLVOISWURQD2MQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.939420996 (279h29m56.640365882s) [noise=true , address=185.167.204.206:4058 , piece_id=A65WCTY5NBLMPILIWERTM5GTSZSSMY3WIPOSARUFG7XHNYTPRWYA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.965928062 (279h29m56.666872947s) [noise=true , address=185.167.204.206:4059 , piece_id=LLK5WUYF5L253KHM4D35IW2HG3AHOITH3YTJIWIMNKVT2EU44HMQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.966014364 (279h29m56.666959259s) [noise=true , address=81.171.14.70:4027 , piece_id=ENUXPPWGRMCVI7ZHNB2YEALOTE3VP2J3UB56LJMLGXJV5MSKF2UQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:29.977664951 (279h29m56.678609846s) [noise=true , address=185.167.204.205:4023 , piece_id=CY6IS6YNVY3LD7N4BDV3DIESHWLFVWOP7UPQROK7GXWNJ266OJGA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.167000160 (279h29m56.867945055s) [noise=true , address=89.149.201.147:4006 , piece_id=7UQMSU4DLZSQY7Z23TH5ZYI4PB5LFORSYAALZPEX2ANIQVVRXQ7A, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.188026247 (279h29m56.888971133s) [noise=true , address=81.171.14.70:4029 , piece_id=AOEB7P4EAWL4BWQP2AEUM53VMIH2CC3OO2TJTW4VZBQVJIESQQYQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.219950881 (279h29m56.920895776s) [noise=true , address=185.167.204.205:4019 , piece_id=FC3QKHT4XMSM3DYHZ4K4KOGD7XU74L3X6WFJZ7ZKPRX2EBYP73IQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.380077468 (279h29m57.081022353s) [noise=true , address=81.171.14.70:4036 , piece_id=ZCYZAAG6JKW3JJXS2LZ5PFZ6GELNK5VZ3TWHOUMQEEHZENQ7POPA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.383417131 (279h29m57.084362026s) [noise=true , address=89.149.201.147:4017 , piece_id=REYZSF3QQYJKJUNLCINYO2XEKWP5LCDWZRQC3UZ3SAFOCHZS2UJA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.398552363 (279h29m57.099497258s) [noise=true , address=81.171.14.70:4035 , piece_id=YRYQEFRTJQYHUA5WI6E6ZQMXH6GHV6DGH2GAIBQ2VA3LUYWPESXA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.693120991 (279h29m57.394065886s) [noise=true , address=185.167.204.205:4028 , piece_id=7V6V5JAMMA76RNDLAN57UXHA5SEUOODDX2Y6YTTZ4IMEU6FNRMMA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.762215857 (279h29m57.463160741s) [noise=true , address=89.149.201.147:4009 , piece_id=2ZR42I73WIQ5OX5T5PFGF26ILNQXJHKI4COXVGBB3EFXFVT7O4GQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.819050832 (279h29m57.519995727s) [noise=true , address=89.149.201.147:4016 , piece_id=Y5UI73372TWUQCAOAIIUF5MET3CPURKZBDR6K3YZVVF6V3JQWL6Q, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.874626807 (279h29m57.575571703s) [noise=true , address=185.167.204.206:4071 , piece_id=JMSZYQTZEHJ2DTCSURS335JPUR3I6AVKH4E6PB6Q2YAZ655PRH6A, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.891196239 (279h29m57.592141123s) [noise=true , address=81.171.14.70:4028 , piece_id=KYILI6WH7GV7PIMHWK7626N6NRNEE34HRADFXVK7YE5ZZKFTLNQA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: <nil>
Nov 8 02:43:30.891215435 (279h29m57.592160319s) [seg_pos={0 0}, upload=245957]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:43:30.891326763 (279h29m57.592271658s) [noise=true , address=81.171.14.70:4047 , piece_id=XCQQYTJLEAGC4EB3ERHXNXIBY45F4KYK743WRWF3XT6S3GRI5MJA, seg_pos={0 0}, upload=245957]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF
Nov 8 02:43:30.891334968 (279h29m57.592279853s) [noise=true , address=81.171.14.70:4047 , piece_id=XCQQYTJLEAGC4EB3ERHXNXIBY45F4KYK743WRWF3XT6S3GRI5MJA, seg_pos={0 0}, upload=245957]: Long tail cancellation due to optimal threshold
Nov 8 02:43:30.891388920 (279h29m57.592333815s) [noise=true , address=81.171.14.70:4038 , piece_id=6IJFS6ENFR7L4LW2EYKJRKPNPUWPL6L7Q67M6NMMJTQB6ZHGFANQ, seg_pos={0 0}, upload=245957]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: read tcp 5.161.89.252:45454->81.171.14.70:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled
Nov 8 02:43:30.891395792 (279h29m57.592340688s) [noise=true , address=81.171.14.70:4038 , piece_id=6IJFS6ENFR7L4LW2EYKJRKPNPUWPL6L7Q67M6NMMJTQB6ZHGFANQ, seg_pos={0 0}, upload=245957]: Long tail cancellation due to optimal threshold
Nov 8 02:43:30.891409588 (279h29m57.592354473s) [seg_pos={0 0}, upload=245957]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:43:30.891457218 (279h29m57.592402113s) [upload=245957]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:43:30.891460744 (279h29m57.59240563s) [upload=245957]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:43:31.034541897 (279h29m57.735486782s) [upload=245957]: Done uploading segments...
Nov 8 02:43:31.034555543 (279h29m57.735500438s) [upload=245957]: Upload finished. err: <nil>
Duration: 29.099422721s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.753365598s
FAIL (2025-11-08 02:43:20 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.75338717s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [..................X...X.........X........X..........X.......] duration:
5.160588957s
FAIL (2025-11-08 02:43:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
HF3MQGFU7QCLIWMORI6Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.642492581 (279h22m59.343437496s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.642886229 (279h22m59.343831144s) [noise=true , address=81.171.14.70:4047 , piece_id=HBWAER3WH6335N4VF5A4NIFHULT5VDQQCT3SMT6V3572OPJG5X7Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.643335311 (279h22m59.344280227s) [noise=true , address=81.171.14.70:4037 , piece_id=AGIAS66YNGY7SSTLLP2P3RBUPHEGL264FEW5XUGO7T5Y666N44AA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.643721315 (279h22m59.344666231s) [noise=true , address=185.167.204.206:4063 , piece_id=BB7LAYPJSHDHBRZ5F2UHIGJ7NF3AER6CFZBDIAAMDVRLMNRCVZYA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644141734 (279h22m59.345086649s) [noise=true , address=81.171.14.70:4043 , piece_id=JCJDQC23FEMQD7BMMBBT5JDYZQK625JEIECNHYP7ZDYOC3HVCS7A, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644597609 (279h22m59.345542524s) [noise=true , address=89.149.201.147:4002 , piece_id=4CRT7EN5VCVOJGFHAUS7IUNHBVEVYMMOSDN5AX55OLCX653HTB5Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644997908 (279h22m59.345942824s) [noise=true , address=81.171.14.70:4029 , piece_id=MCFEOJYVUQOUZVOPJHP2WQBUXEVI2H5CPJD7HMHWI7E7KJUUPTXA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.645425491 (279h22m59.346370405s) [noise=true , address=89.149.201.147:4004 , piece_id=3TBMRJXLGWGHGFI4ESTECAXNVQFXMVJCL2CW4OXJVTRJ63LLEANA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.645875675 (279h22m59.3468206s) [noise=true , address=185.167.204.205:4031 , piece_id=4NNQC3SE567HAZ2MNFZMFI66AMLFLJF4JZEEJDQ5DQU7S5PM336Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.646310170 (279h22m59.347255085s) [noise=true , address=185.167.204.205:4018 , piece_id=BAK75WKDOWWOIUI2VMY4WDDJ3WCPV3JJN4MRKM3WKRHB2AM2UWOQ, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:33.135570941 (279h22m59.836515837s) [upload=245855]: Next returned nil segment
Nov 8 02:36:33.135581582 (279h22m59.836526477s) [upload=245855]: Waiting for error group managing segments...
Nov 8 02:36:33.354304295 (279h23m0.055249181s) [noise=true , address=81.171.14.70:4038 , piece_id=JY2WHLXDL7L5MN3LTJJGYQNL6BN4TWS4PHTWQ34N42AUETO4YKQQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.375512945 (279h23m0.076457841s) [noise=true , address=81.171.14.70:4044 , piece_id=PWITFUVXJQXHBEVZBYJQL5ZY6JWCAHEWJ5N63U35YPUUADSICL7A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.383322430 (279h23m0.084267315s) [noise=true , address=81.171.14.70:4047 , piece_id=HBWAER3WH6335N4VF5A4NIFHULT5VDQQCT3SMT6V3572OPJG5X7Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.393092692 (279h23m0.094037607s) [noise=true , address=89.149.201.147:4023 , piece_id=467JDE525L72U4ECNQCVIX3HVMKZMTHVD3UORBL5CTORRPHQ5GTA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.393391392 (279h23m0.094336307s) [noise=true , address=81.171.14.70:4027 , piece_id=RHYOWEQQPG74WO5UEGWZWJQ52CMUIRVOHWS4EGUQHC2TA46QOO3A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.414443489 (279h23m0.115388413s) [noise=true , address=185.167.204.205:4016 , piece_id=T4NYWMQN6HQ42KJLRXQI5RAOAQHPEHE77QZV6NQFF6ZX7GAOTJYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.430508192 (279h23m0.131453117s) [noise=true , address=81.171.14.70:4043 , piece_id=JCJDQC23FEMQD7BMMBBT5JDYZQK625JEIECNHYP7ZDYOC3HVCS7A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.597476928 (279h23m0.298421833s) [noise=true , address=89.149.201.147:4011 , piece_id=X5SLJKZWOULVX2E7VUDLZJOMRNOLD3Y435JZ2PEE4MBDI54QDSSQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.612057700 (279h23m0.313002585s) [noise=true , address=81.171.14.70:4039 , piece_id=KXU77JYEYKIMYHG4FN3MVLQO6X6LOOFFIJNPCTQIDQZOJBKIZJVQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.666480222 (279h23m0.367425107s) [noise=true , address=185.167.204.205:4018 , piece_id=BAK75WKDOWWOIUI2VMY4WDDJ3WCPV3JJN4MRKM3WKRHB2AM2UWOQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.697527110 (279h23m0.398472026s) [noise=true , address=185.167.204.205:4031 , piece_id=4NNQC3SE567HAZ2MNFZMFI66AMLFLJF4JZEEJDQ5DQU7S5PM336Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.710777848 (279h23m0.411722732s) [noise=true , address=185.167.204.205:4022 , piece_id=6O5BQSMEEKGOEMI5DECFBKP6GTRT65TG6LCULOKF7GG2WGOBCM4A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.718960532 (279h23m0.419905417s) [noise=true , address=89.149.201.147:4001 , piece_id=BKU4YOLRMPMLZ7VTILYYDUZRD6GQYPF32BQW52Y22DXOWCNXYWFQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.736675280 (279h23m0.437620175s) [noise=true , address=81.171.14.70:4036 , piece_id=ASMJARU62BVKMAYZH25Y3XQA7DSDSO3F7Q2Q4LYESWUJ7R2ZPKQA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.745484559 (279h23m0.446429475s) [noise=true , address=89.149.201.147:4019 , piece_id=LAC2Z3BCKSYV5633FAV4SCQN7CUWDNBM7J4SBEYUHACPU2OXZRSA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.792172848 (279h23m0.493117773s) [noise=true , address=185.167.204.206:4052 , piece_id=H2SGAMQCHP7D3TJZ7JVTRKDUN6GDETYGGJDERHDKW77ABGQYCNNA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.882300244 (279h23m0.583245159s) [noise=true , address=89.149.201.147:4015 , piece_id=JCUNNNBOQD63WANO4IJ66G2CU3JPKF3QBKTT3LZUYU2FDXJNH2EQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.882422533 (279h23m0.583367458s) [noise=true , address=89.149.201.147:4008 , piece_id=XJ4ZCMNZC2OPYADR336HWEPCONZVNZ5FHF3MQGFU7QCLIWMORI6Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.055108491 (279h23m0.756053405s) [noise=true , address=89.149.201.147:4002 , piece_id=4CRT7EN5VCVOJGFHAUS7IUNHBVEVYMMOSDN5AX55OLCX653HTB5Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.056869553 (279h23m0.757814448s) [noise=true , address=185.167.204.206:4063 , piece_id=BB7LAYPJSHDHBRZ5F2UHIGJ7NF3AER6CFZBDIAAMDVRLMNRCVZYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.149590521 (279h23m0.850535407s) [noise=true , address=89.149.201.147:4004 , piece_id=3TBMRJXLGWGHGFI4ESTECAXNVQFXMVJCL2CW4OXJVTRJ63LLEANA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.194848258 (279h23m0.895793143s) [noise=true , address=89.149.201.147:4024 , piece_id=6M3F7DNT77O2C5ZVKBJJXFGFS2YS3U4OVNHE7FTBIDEPV3C6IMYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.264483305 (279h23m0.9654282s) [noise=true , address=81.171.14.70:4033 , piece_id=IU2OGUYHLH4HGAYNCW5YOEBLQOVBYVVHVBP4WL5NCAJBR43WTV3Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.404092968 (279h23m1.105037863s) [noise=true , address=81.171.14.70:4048 , piece_id=PCZSFPJISXMAKRI3V45CT4NW7ATBTTGUJEDN36WBU44NGB5H4XAA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.523649388 (279h23m1.224594283s) [noise=true , address=81.171.14.70:4037 , piece_id=AGIAS66YNGY7SSTLLP2P3RBUPHEGL264FEW5XUGO7T5Y666N44AA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.537799893 (279h23m1.238744788s) [noise=true , address=81.171.14.70:4029 , piece_id=MCFEOJYVUQOUZVOPJHP2WQBUXEVI2H5CPJD7HMHWI7E7KJUUPTXA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.537821714 (279h23m1.238766609s) [seg_pos={0 0}, upload=245855]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:36:34.537934015 (279h23m1.23887891s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YTf9jvAKd4gVTxTZC6gGLdXC17ygbrqvqoKtmPbtHyc65YjDU): protocol: expected piece hash; context canceled; EOF
Nov 8 02:36:34.537944835 (279h23m1.23888973s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Long tail cancellation due to optimal threshold
Nov 8 02:36:34.537951658 (279h23m1.238896553s) [noise=true , address=81.171.14.70:4041 , piece_id=UC6CSGXSORAM2T5I3PFQ7GEXPZCDAYWNVNZTP235KKKXGBPDITOQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF
Nov 8 02:36:34.537959432 (279h23m1.238904327s) [noise=true , address=81.171.14.70:4041 , piece_id=UC6CSGXSORAM2T5I3PFQ7GEXPZCDAYWNVNZTP235KKKXGBPDITOQ, seg_pos={0 0}, upload=245855]: Long tail cancellation due to optimal threshold
Nov 8 02:36:34.537986714 (279h23m1.238931609s) [seg_pos={0 0}, upload=245855]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:36:34.538068697 (279h23m1.239013593s) [upload=245855]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:36:34.538073657 (279h23m1.239018552s) [upload=245855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:36:34.689738324 (279h23m1.390683219s) [upload=245855]: Done uploading segments...
Nov 8 02:36:34.689752591 (279h23m1.390697486s) [upload=245855]: Upload finished. err: <nil>
Duration: 5.16061151s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.827525462s
FAIL (2025-11-08 02:42:57 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.827543846s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [...................X...X.........X........X..........X......] duration:
36.692802759s
FAIL (2025-11-08 02:42:31 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
HF3MQGFU7QCLIWMORI6Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.642492581 (279h22m59.343437496s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.642886229 (279h22m59.343831144s) [noise=true , address=81.171.14.70:4047 , piece_id=HBWAER3WH6335N4VF5A4NIFHULT5VDQQCT3SMT6V3572OPJG5X7Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.643335311 (279h22m59.344280227s) [noise=true , address=81.171.14.70:4037 , piece_id=AGIAS66YNGY7SSTLLP2P3RBUPHEGL264FEW5XUGO7T5Y666N44AA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.643721315 (279h22m59.344666231s) [noise=true , address=185.167.204.206:4063 , piece_id=BB7LAYPJSHDHBRZ5F2UHIGJ7NF3AER6CFZBDIAAMDVRLMNRCVZYA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644141734 (279h22m59.345086649s) [noise=true , address=81.171.14.70:4043 , piece_id=JCJDQC23FEMQD7BMMBBT5JDYZQK625JEIECNHYP7ZDYOC3HVCS7A, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644597609 (279h22m59.345542524s) [noise=true , address=89.149.201.147:4002 , piece_id=4CRT7EN5VCVOJGFHAUS7IUNHBVEVYMMOSDN5AX55OLCX653HTB5Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644997908 (279h22m59.345942824s) [noise=true , address=81.171.14.70:4029 , piece_id=MCFEOJYVUQOUZVOPJHP2WQBUXEVI2H5CPJD7HMHWI7E7KJUUPTXA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.645425491 (279h22m59.346370405s) [noise=true , address=89.149.201.147:4004 , piece_id=3TBMRJXLGWGHGFI4ESTECAXNVQFXMVJCL2CW4OXJVTRJ63LLEANA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.645875675 (279h22m59.3468206s) [noise=true , address=185.167.204.205:4031 , piece_id=4NNQC3SE567HAZ2MNFZMFI66AMLFLJF4JZEEJDQ5DQU7S5PM336Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.646310170 (279h22m59.347255085s) [noise=true , address=185.167.204.205:4018 , piece_id=BAK75WKDOWWOIUI2VMY4WDDJ3WCPV3JJN4MRKM3WKRHB2AM2UWOQ, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:33.135570941 (279h22m59.836515837s) [upload=245855]: Next returned nil segment
Nov 8 02:36:33.135581582 (279h22m59.836526477s) [upload=245855]: Waiting for error group managing segments...
Nov 8 02:36:33.354304295 (279h23m0.055249181s) [noise=true , address=81.171.14.70:4038 , piece_id=JY2WHLXDL7L5MN3LTJJGYQNL6BN4TWS4PHTWQ34N42AUETO4YKQQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.375512945 (279h23m0.076457841s) [noise=true , address=81.171.14.70:4044 , piece_id=PWITFUVXJQXHBEVZBYJQL5ZY6JWCAHEWJ5N63U35YPUUADSICL7A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.383322430 (279h23m0.084267315s) [noise=true , address=81.171.14.70:4047 , piece_id=HBWAER3WH6335N4VF5A4NIFHULT5VDQQCT3SMT6V3572OPJG5X7Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.393092692 (279h23m0.094037607s) [noise=true , address=89.149.201.147:4023 , piece_id=467JDE525L72U4ECNQCVIX3HVMKZMTHVD3UORBL5CTORRPHQ5GTA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.393391392 (279h23m0.094336307s) [noise=true , address=81.171.14.70:4027 , piece_id=RHYOWEQQPG74WO5UEGWZWJQ52CMUIRVOHWS4EGUQHC2TA46QOO3A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.414443489 (279h23m0.115388413s) [noise=true , address=185.167.204.205:4016 , piece_id=T4NYWMQN6HQ42KJLRXQI5RAOAQHPEHE77QZV6NQFF6ZX7GAOTJYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.430508192 (279h23m0.131453117s) [noise=true , address=81.171.14.70:4043 , piece_id=JCJDQC23FEMQD7BMMBBT5JDYZQK625JEIECNHYP7ZDYOC3HVCS7A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.597476928 (279h23m0.298421833s) [noise=true , address=89.149.201.147:4011 , piece_id=X5SLJKZWOULVX2E7VUDLZJOMRNOLD3Y435JZ2PEE4MBDI54QDSSQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.612057700 (279h23m0.313002585s) [noise=true , address=81.171.14.70:4039 , piece_id=KXU77JYEYKIMYHG4FN3MVLQO6X6LOOFFIJNPCTQIDQZOJBKIZJVQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.666480222 (279h23m0.367425107s) [noise=true , address=185.167.204.205:4018 , piece_id=BAK75WKDOWWOIUI2VMY4WDDJ3WCPV3JJN4MRKM3WKRHB2AM2UWOQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.697527110 (279h23m0.398472026s) [noise=true , address=185.167.204.205:4031 , piece_id=4NNQC3SE567HAZ2MNFZMFI66AMLFLJF4JZEEJDQ5DQU7S5PM336Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.710777848 (279h23m0.411722732s) [noise=true , address=185.167.204.205:4022 , piece_id=6O5BQSMEEKGOEMI5DECFBKP6GTRT65TG6LCULOKF7GG2WGOBCM4A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.718960532 (279h23m0.419905417s) [noise=true , address=89.149.201.147:4001 , piece_id=BKU4YOLRMPMLZ7VTILYYDUZRD6GQYPF32BQW52Y22DXOWCNXYWFQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.736675280 (279h23m0.437620175s) [noise=true , address=81.171.14.70:4036 , piece_id=ASMJARU62BVKMAYZH25Y3XQA7DSDSO3F7Q2Q4LYESWUJ7R2ZPKQA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.745484559 (279h23m0.446429475s) [noise=true , address=89.149.201.147:4019 , piece_id=LAC2Z3BCKSYV5633FAV4SCQN7CUWDNBM7J4SBEYUHACPU2OXZRSA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.792172848 (279h23m0.493117773s) [noise=true , address=185.167.204.206:4052 , piece_id=H2SGAMQCHP7D3TJZ7JVTRKDUN6GDETYGGJDERHDKW77ABGQYCNNA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.882300244 (279h23m0.583245159s) [noise=true , address=89.149.201.147:4015 , piece_id=JCUNNNBOQD63WANO4IJ66G2CU3JPKF3QBKTT3LZUYU2FDXJNH2EQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.882422533 (279h23m0.583367458s) [noise=true , address=89.149.201.147:4008 , piece_id=XJ4ZCMNZC2OPYADR336HWEPCONZVNZ5FHF3MQGFU7QCLIWMORI6Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.055108491 (279h23m0.756053405s) [noise=true , address=89.149.201.147:4002 , piece_id=4CRT7EN5VCVOJGFHAUS7IUNHBVEVYMMOSDN5AX55OLCX653HTB5Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.056869553 (279h23m0.757814448s) [noise=true , address=185.167.204.206:4063 , piece_id=BB7LAYPJSHDHBRZ5F2UHIGJ7NF3AER6CFZBDIAAMDVRLMNRCVZYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.149590521 (279h23m0.850535407s) [noise=true , address=89.149.201.147:4004 , piece_id=3TBMRJXLGWGHGFI4ESTECAXNVQFXMVJCL2CW4OXJVTRJ63LLEANA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.194848258 (279h23m0.895793143s) [noise=true , address=89.149.201.147:4024 , piece_id=6M3F7DNT77O2C5ZVKBJJXFGFS2YS3U4OVNHE7FTBIDEPV3C6IMYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.264483305 (279h23m0.9654282s) [noise=true , address=81.171.14.70:4033 , piece_id=IU2OGUYHLH4HGAYNCW5YOEBLQOVBYVVHVBP4WL5NCAJBR43WTV3Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.404092968 (279h23m1.105037863s) [noise=true , address=81.171.14.70:4048 , piece_id=PCZSFPJISXMAKRI3V45CT4NW7ATBTTGUJEDN36WBU44NGB5H4XAA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.523649388 (279h23m1.224594283s) [noise=true , address=81.171.14.70:4037 , piece_id=AGIAS66YNGY7SSTLLP2P3RBUPHEGL264FEW5XUGO7T5Y666N44AA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.537799893 (279h23m1.238744788s) [noise=true , address=81.171.14.70:4029 , piece_id=MCFEOJYVUQOUZVOPJHP2WQBUXEVI2H5CPJD7HMHWI7E7KJUUPTXA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.537821714 (279h23m1.238766609s) [seg_pos={0 0}, upload=245855]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:36:34.537934015 (279h23m1.23887891s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YTf9jvAKd4gVTxTZC6gGLdXC17ygbrqvqoKtmPbtHyc65YjDU): protocol: expected piece hash; context canceled; EOF
Nov 8 02:36:34.537944835 (279h23m1.23888973s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Long tail cancellation due to optimal threshold
Nov 8 02:36:34.537951658 (279h23m1.238896553s) [noise=true , address=81.171.14.70:4041 , piece_id=UC6CSGXSORAM2T5I3PFQ7GEXPZCDAYWNVNZTP235KKKXGBPDITOQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF
Nov 8 02:36:34.537959432 (279h23m1.238904327s) [noise=true , address=81.171.14.70:4041 , piece_id=UC6CSGXSORAM2T5I3PFQ7GEXPZCDAYWNVNZTP235KKKXGBPDITOQ, seg_pos={0 0}, upload=245855]: Long tail cancellation due to optimal threshold
Nov 8 02:36:34.537986714 (279h23m1.238931609s) [seg_pos={0 0}, upload=245855]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:36:34.538068697 (279h23m1.239013593s) [upload=245855]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:36:34.538073657 (279h23m1.239018552s) [upload=245855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:36:34.689738324 (279h23m1.390683219s) [upload=245855]: Done uploading segments...
Nov 8 02:36:34.689752591 (279h23m1.390697486s) [upload=245855]: Upload finished. err: <nil>
Duration: 36.692823568s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.742715185s
FAIL (2025-11-08 02:42:17 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.742776531s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.771019263s
FAIL (2025-11-08 02:41:23 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.771039872s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
3.025279965s
FAIL (2025-11-08 02:40:52 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.025297227s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [....................X...X.........X........X..........X.....] duration:
5.199402689s
FAIL (2025-11-08 02:40:50 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
HF3MQGFU7QCLIWMORI6Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.642492581 (279h22m59.343437496s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.642886229 (279h22m59.343831144s) [noise=true , address=81.171.14.70:4047 , piece_id=HBWAER3WH6335N4VF5A4NIFHULT5VDQQCT3SMT6V3572OPJG5X7Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.643335311 (279h22m59.344280227s) [noise=true , address=81.171.14.70:4037 , piece_id=AGIAS66YNGY7SSTLLP2P3RBUPHEGL264FEW5XUGO7T5Y666N44AA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.643721315 (279h22m59.344666231s) [noise=true , address=185.167.204.206:4063 , piece_id=BB7LAYPJSHDHBRZ5F2UHIGJ7NF3AER6CFZBDIAAMDVRLMNRCVZYA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644141734 (279h22m59.345086649s) [noise=true , address=81.171.14.70:4043 , piece_id=JCJDQC23FEMQD7BMMBBT5JDYZQK625JEIECNHYP7ZDYOC3HVCS7A, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644597609 (279h22m59.345542524s) [noise=true , address=89.149.201.147:4002 , piece_id=4CRT7EN5VCVOJGFHAUS7IUNHBVEVYMMOSDN5AX55OLCX653HTB5Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644997908 (279h22m59.345942824s) [noise=true , address=81.171.14.70:4029 , piece_id=MCFEOJYVUQOUZVOPJHP2WQBUXEVI2H5CPJD7HMHWI7E7KJUUPTXA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.645425491 (279h22m59.346370405s) [noise=true , address=89.149.201.147:4004 , piece_id=3TBMRJXLGWGHGFI4ESTECAXNVQFXMVJCL2CW4OXJVTRJ63LLEANA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.645875675 (279h22m59.3468206s) [noise=true , address=185.167.204.205:4031 , piece_id=4NNQC3SE567HAZ2MNFZMFI66AMLFLJF4JZEEJDQ5DQU7S5PM336Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.646310170 (279h22m59.347255085s) [noise=true , address=185.167.204.205:4018 , piece_id=BAK75WKDOWWOIUI2VMY4WDDJ3WCPV3JJN4MRKM3WKRHB2AM2UWOQ, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:33.135570941 (279h22m59.836515837s) [upload=245855]: Next returned nil segment
Nov 8 02:36:33.135581582 (279h22m59.836526477s) [upload=245855]: Waiting for error group managing segments...
Nov 8 02:36:33.354304295 (279h23m0.055249181s) [noise=true , address=81.171.14.70:4038 , piece_id=JY2WHLXDL7L5MN3LTJJGYQNL6BN4TWS4PHTWQ34N42AUETO4YKQQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.375512945 (279h23m0.076457841s) [noise=true , address=81.171.14.70:4044 , piece_id=PWITFUVXJQXHBEVZBYJQL5ZY6JWCAHEWJ5N63U35YPUUADSICL7A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.383322430 (279h23m0.084267315s) [noise=true , address=81.171.14.70:4047 , piece_id=HBWAER3WH6335N4VF5A4NIFHULT5VDQQCT3SMT6V3572OPJG5X7Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.393092692 (279h23m0.094037607s) [noise=true , address=89.149.201.147:4023 , piece_id=467JDE525L72U4ECNQCVIX3HVMKZMTHVD3UORBL5CTORRPHQ5GTA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.393391392 (279h23m0.094336307s) [noise=true , address=81.171.14.70:4027 , piece_id=RHYOWEQQPG74WO5UEGWZWJQ52CMUIRVOHWS4EGUQHC2TA46QOO3A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.414443489 (279h23m0.115388413s) [noise=true , address=185.167.204.205:4016 , piece_id=T4NYWMQN6HQ42KJLRXQI5RAOAQHPEHE77QZV6NQFF6ZX7GAOTJYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.430508192 (279h23m0.131453117s) [noise=true , address=81.171.14.70:4043 , piece_id=JCJDQC23FEMQD7BMMBBT5JDYZQK625JEIECNHYP7ZDYOC3HVCS7A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.597476928 (279h23m0.298421833s) [noise=true , address=89.149.201.147:4011 , piece_id=X5SLJKZWOULVX2E7VUDLZJOMRNOLD3Y435JZ2PEE4MBDI54QDSSQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.612057700 (279h23m0.313002585s) [noise=true , address=81.171.14.70:4039 , piece_id=KXU77JYEYKIMYHG4FN3MVLQO6X6LOOFFIJNPCTQIDQZOJBKIZJVQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.666480222 (279h23m0.367425107s) [noise=true , address=185.167.204.205:4018 , piece_id=BAK75WKDOWWOIUI2VMY4WDDJ3WCPV3JJN4MRKM3WKRHB2AM2UWOQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.697527110 (279h23m0.398472026s) [noise=true , address=185.167.204.205:4031 , piece_id=4NNQC3SE567HAZ2MNFZMFI66AMLFLJF4JZEEJDQ5DQU7S5PM336Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.710777848 (279h23m0.411722732s) [noise=true , address=185.167.204.205:4022 , piece_id=6O5BQSMEEKGOEMI5DECFBKP6GTRT65TG6LCULOKF7GG2WGOBCM4A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.718960532 (279h23m0.419905417s) [noise=true , address=89.149.201.147:4001 , piece_id=BKU4YOLRMPMLZ7VTILYYDUZRD6GQYPF32BQW52Y22DXOWCNXYWFQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.736675280 (279h23m0.437620175s) [noise=true , address=81.171.14.70:4036 , piece_id=ASMJARU62BVKMAYZH25Y3XQA7DSDSO3F7Q2Q4LYESWUJ7R2ZPKQA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.745484559 (279h23m0.446429475s) [noise=true , address=89.149.201.147:4019 , piece_id=LAC2Z3BCKSYV5633FAV4SCQN7CUWDNBM7J4SBEYUHACPU2OXZRSA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.792172848 (279h23m0.493117773s) [noise=true , address=185.167.204.206:4052 , piece_id=H2SGAMQCHP7D3TJZ7JVTRKDUN6GDETYGGJDERHDKW77ABGQYCNNA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.882300244 (279h23m0.583245159s) [noise=true , address=89.149.201.147:4015 , piece_id=JCUNNNBOQD63WANO4IJ66G2CU3JPKF3QBKTT3LZUYU2FDXJNH2EQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.882422533 (279h23m0.583367458s) [noise=true , address=89.149.201.147:4008 , piece_id=XJ4ZCMNZC2OPYADR336HWEPCONZVNZ5FHF3MQGFU7QCLIWMORI6Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.055108491 (279h23m0.756053405s) [noise=true , address=89.149.201.147:4002 , piece_id=4CRT7EN5VCVOJGFHAUS7IUNHBVEVYMMOSDN5AX55OLCX653HTB5Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.056869553 (279h23m0.757814448s) [noise=true , address=185.167.204.206:4063 , piece_id=BB7LAYPJSHDHBRZ5F2UHIGJ7NF3AER6CFZBDIAAMDVRLMNRCVZYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.149590521 (279h23m0.850535407s) [noise=true , address=89.149.201.147:4004 , piece_id=3TBMRJXLGWGHGFI4ESTECAXNVQFXMVJCL2CW4OXJVTRJ63LLEANA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.194848258 (279h23m0.895793143s) [noise=true , address=89.149.201.147:4024 , piece_id=6M3F7DNT77O2C5ZVKBJJXFGFS2YS3U4OVNHE7FTBIDEPV3C6IMYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.264483305 (279h23m0.9654282s) [noise=true , address=81.171.14.70:4033 , piece_id=IU2OGUYHLH4HGAYNCW5YOEBLQOVBYVVHVBP4WL5NCAJBR43WTV3Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.404092968 (279h23m1.105037863s) [noise=true , address=81.171.14.70:4048 , piece_id=PCZSFPJISXMAKRI3V45CT4NW7ATBTTGUJEDN36WBU44NGB5H4XAA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.523649388 (279h23m1.224594283s) [noise=true , address=81.171.14.70:4037 , piece_id=AGIAS66YNGY7SSTLLP2P3RBUPHEGL264FEW5XUGO7T5Y666N44AA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.537799893 (279h23m1.238744788s) [noise=true , address=81.171.14.70:4029 , piece_id=MCFEOJYVUQOUZVOPJHP2WQBUXEVI2H5CPJD7HMHWI7E7KJUUPTXA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.537821714 (279h23m1.238766609s) [seg_pos={0 0}, upload=245855]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:36:34.537934015 (279h23m1.23887891s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YTf9jvAKd4gVTxTZC6gGLdXC17ygbrqvqoKtmPbtHyc65YjDU): protocol: expected piece hash; context canceled; EOF
Nov 8 02:36:34.537944835 (279h23m1.23888973s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Long tail cancellation due to optimal threshold
Nov 8 02:36:34.537951658 (279h23m1.238896553s) [noise=true , address=81.171.14.70:4041 , piece_id=UC6CSGXSORAM2T5I3PFQ7GEXPZCDAYWNVNZTP235KKKXGBPDITOQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF
Nov 8 02:36:34.537959432 (279h23m1.238904327s) [noise=true , address=81.171.14.70:4041 , piece_id=UC6CSGXSORAM2T5I3PFQ7GEXPZCDAYWNVNZTP235KKKXGBPDITOQ, seg_pos={0 0}, upload=245855]: Long tail cancellation due to optimal threshold
Nov 8 02:36:34.537986714 (279h23m1.238931609s) [seg_pos={0 0}, upload=245855]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:36:34.538068697 (279h23m1.239013593s) [upload=245855]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:36:34.538073657 (279h23m1.239018552s) [upload=245855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:36:34.689738324 (279h23m1.390683219s) [upload=245855]: Done uploading segments...
Nov 8 02:36:34.689752591 (279h23m1.390697486s) [upload=245855]: Upload finished. err: <nil>
Duration: 5.199421684s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
3.57679592s
FAIL (2025-11-08 02:40:19 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.576820356s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [.....................X...X.........X........X..........X....] duration:
4.505294285s
FAIL (2025-11-08 02:39:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
HF3MQGFU7QCLIWMORI6Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.642492581 (279h22m59.343437496s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.642886229 (279h22m59.343831144s) [noise=true , address=81.171.14.70:4047 , piece_id=HBWAER3WH6335N4VF5A4NIFHULT5VDQQCT3SMT6V3572OPJG5X7Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.643335311 (279h22m59.344280227s) [noise=true , address=81.171.14.70:4037 , piece_id=AGIAS66YNGY7SSTLLP2P3RBUPHEGL264FEW5XUGO7T5Y666N44AA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.643721315 (279h22m59.344666231s) [noise=true , address=185.167.204.206:4063 , piece_id=BB7LAYPJSHDHBRZ5F2UHIGJ7NF3AER6CFZBDIAAMDVRLMNRCVZYA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644141734 (279h22m59.345086649s) [noise=true , address=81.171.14.70:4043 , piece_id=JCJDQC23FEMQD7BMMBBT5JDYZQK625JEIECNHYP7ZDYOC3HVCS7A, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644597609 (279h22m59.345542524s) [noise=true , address=89.149.201.147:4002 , piece_id=4CRT7EN5VCVOJGFHAUS7IUNHBVEVYMMOSDN5AX55OLCX653HTB5Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644997908 (279h22m59.345942824s) [noise=true , address=81.171.14.70:4029 , piece_id=MCFEOJYVUQOUZVOPJHP2WQBUXEVI2H5CPJD7HMHWI7E7KJUUPTXA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.645425491 (279h22m59.346370405s) [noise=true , address=89.149.201.147:4004 , piece_id=3TBMRJXLGWGHGFI4ESTECAXNVQFXMVJCL2CW4OXJVTRJ63LLEANA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.645875675 (279h22m59.3468206s) [noise=true , address=185.167.204.205:4031 , piece_id=4NNQC3SE567HAZ2MNFZMFI66AMLFLJF4JZEEJDQ5DQU7S5PM336Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.646310170 (279h22m59.347255085s) [noise=true , address=185.167.204.205:4018 , piece_id=BAK75WKDOWWOIUI2VMY4WDDJ3WCPV3JJN4MRKM3WKRHB2AM2UWOQ, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:33.135570941 (279h22m59.836515837s) [upload=245855]: Next returned nil segment
Nov 8 02:36:33.135581582 (279h22m59.836526477s) [upload=245855]: Waiting for error group managing segments...
Nov 8 02:36:33.354304295 (279h23m0.055249181s) [noise=true , address=81.171.14.70:4038 , piece_id=JY2WHLXDL7L5MN3LTJJGYQNL6BN4TWS4PHTWQ34N42AUETO4YKQQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.375512945 (279h23m0.076457841s) [noise=true , address=81.171.14.70:4044 , piece_id=PWITFUVXJQXHBEVZBYJQL5ZY6JWCAHEWJ5N63U35YPUUADSICL7A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.383322430 (279h23m0.084267315s) [noise=true , address=81.171.14.70:4047 , piece_id=HBWAER3WH6335N4VF5A4NIFHULT5VDQQCT3SMT6V3572OPJG5X7Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.393092692 (279h23m0.094037607s) [noise=true , address=89.149.201.147:4023 , piece_id=467JDE525L72U4ECNQCVIX3HVMKZMTHVD3UORBL5CTORRPHQ5GTA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.393391392 (279h23m0.094336307s) [noise=true , address=81.171.14.70:4027 , piece_id=RHYOWEQQPG74WO5UEGWZWJQ52CMUIRVOHWS4EGUQHC2TA46QOO3A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.414443489 (279h23m0.115388413s) [noise=true , address=185.167.204.205:4016 , piece_id=T4NYWMQN6HQ42KJLRXQI5RAOAQHPEHE77QZV6NQFF6ZX7GAOTJYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.430508192 (279h23m0.131453117s) [noise=true , address=81.171.14.70:4043 , piece_id=JCJDQC23FEMQD7BMMBBT5JDYZQK625JEIECNHYP7ZDYOC3HVCS7A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.597476928 (279h23m0.298421833s) [noise=true , address=89.149.201.147:4011 , piece_id=X5SLJKZWOULVX2E7VUDLZJOMRNOLD3Y435JZ2PEE4MBDI54QDSSQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.612057700 (279h23m0.313002585s) [noise=true , address=81.171.14.70:4039 , piece_id=KXU77JYEYKIMYHG4FN3MVLQO6X6LOOFFIJNPCTQIDQZOJBKIZJVQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.666480222 (279h23m0.367425107s) [noise=true , address=185.167.204.205:4018 , piece_id=BAK75WKDOWWOIUI2VMY4WDDJ3WCPV3JJN4MRKM3WKRHB2AM2UWOQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.697527110 (279h23m0.398472026s) [noise=true , address=185.167.204.205:4031 , piece_id=4NNQC3SE567HAZ2MNFZMFI66AMLFLJF4JZEEJDQ5DQU7S5PM336Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.710777848 (279h23m0.411722732s) [noise=true , address=185.167.204.205:4022 , piece_id=6O5BQSMEEKGOEMI5DECFBKP6GTRT65TG6LCULOKF7GG2WGOBCM4A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.718960532 (279h23m0.419905417s) [noise=true , address=89.149.201.147:4001 , piece_id=BKU4YOLRMPMLZ7VTILYYDUZRD6GQYPF32BQW52Y22DXOWCNXYWFQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.736675280 (279h23m0.437620175s) [noise=true , address=81.171.14.70:4036 , piece_id=ASMJARU62BVKMAYZH25Y3XQA7DSDSO3F7Q2Q4LYESWUJ7R2ZPKQA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.745484559 (279h23m0.446429475s) [noise=true , address=89.149.201.147:4019 , piece_id=LAC2Z3BCKSYV5633FAV4SCQN7CUWDNBM7J4SBEYUHACPU2OXZRSA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.792172848 (279h23m0.493117773s) [noise=true , address=185.167.204.206:4052 , piece_id=H2SGAMQCHP7D3TJZ7JVTRKDUN6GDETYGGJDERHDKW77ABGQYCNNA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.882300244 (279h23m0.583245159s) [noise=true , address=89.149.201.147:4015 , piece_id=JCUNNNBOQD63WANO4IJ66G2CU3JPKF3QBKTT3LZUYU2FDXJNH2EQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.882422533 (279h23m0.583367458s) [noise=true , address=89.149.201.147:4008 , piece_id=XJ4ZCMNZC2OPYADR336HWEPCONZVNZ5FHF3MQGFU7QCLIWMORI6Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.055108491 (279h23m0.756053405s) [noise=true , address=89.149.201.147:4002 , piece_id=4CRT7EN5VCVOJGFHAUS7IUNHBVEVYMMOSDN5AX55OLCX653HTB5Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.056869553 (279h23m0.757814448s) [noise=true , address=185.167.204.206:4063 , piece_id=BB7LAYPJSHDHBRZ5F2UHIGJ7NF3AER6CFZBDIAAMDVRLMNRCVZYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.149590521 (279h23m0.850535407s) [noise=true , address=89.149.201.147:4004 , piece_id=3TBMRJXLGWGHGFI4ESTECAXNVQFXMVJCL2CW4OXJVTRJ63LLEANA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.194848258 (279h23m0.895793143s) [noise=true , address=89.149.201.147:4024 , piece_id=6M3F7DNT77O2C5ZVKBJJXFGFS2YS3U4OVNHE7FTBIDEPV3C6IMYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.264483305 (279h23m0.9654282s) [noise=true , address=81.171.14.70:4033 , piece_id=IU2OGUYHLH4HGAYNCW5YOEBLQOVBYVVHVBP4WL5NCAJBR43WTV3Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.404092968 (279h23m1.105037863s) [noise=true , address=81.171.14.70:4048 , piece_id=PCZSFPJISXMAKRI3V45CT4NW7ATBTTGUJEDN36WBU44NGB5H4XAA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.523649388 (279h23m1.224594283s) [noise=true , address=81.171.14.70:4037 , piece_id=AGIAS66YNGY7SSTLLP2P3RBUPHEGL264FEW5XUGO7T5Y666N44AA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.537799893 (279h23m1.238744788s) [noise=true , address=81.171.14.70:4029 , piece_id=MCFEOJYVUQOUZVOPJHP2WQBUXEVI2H5CPJD7HMHWI7E7KJUUPTXA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.537821714 (279h23m1.238766609s) [seg_pos={0 0}, upload=245855]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:36:34.537934015 (279h23m1.23887891s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YTf9jvAKd4gVTxTZC6gGLdXC17ygbrqvqoKtmPbtHyc65YjDU): protocol: expected piece hash; context canceled; EOF
Nov 8 02:36:34.537944835 (279h23m1.23888973s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Long tail cancellation due to optimal threshold
Nov 8 02:36:34.537951658 (279h23m1.238896553s) [noise=true , address=81.171.14.70:4041 , piece_id=UC6CSGXSORAM2T5I3PFQ7GEXPZCDAYWNVNZTP235KKKXGBPDITOQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF
Nov 8 02:36:34.537959432 (279h23m1.238904327s) [noise=true , address=81.171.14.70:4041 , piece_id=UC6CSGXSORAM2T5I3PFQ7GEXPZCDAYWNVNZTP235KKKXGBPDITOQ, seg_pos={0 0}, upload=245855]: Long tail cancellation due to optimal threshold
Nov 8 02:36:34.537986714 (279h23m1.238931609s) [seg_pos={0 0}, upload=245855]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:36:34.538068697 (279h23m1.239013593s) [upload=245855]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:36:34.538073657 (279h23m1.239018552s) [upload=245855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:36:34.689738324 (279h23m1.390683219s) [upload=245855]: Done uploading segments...
Nov 8 02:36:34.689752591 (279h23m1.390697486s) [upload=245855]: Upload finished. err: <nil>
Duration: 4.505313772s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.969600838s
FAIL (2025-11-08 02:39:13 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.969618762s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [......................X...X.........X........X..........X...] duration:
25.254566998s
FAIL (2025-11-08 02:39:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
HF3MQGFU7QCLIWMORI6Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.642492581 (279h22m59.343437496s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.642886229 (279h22m59.343831144s) [noise=true , address=81.171.14.70:4047 , piece_id=HBWAER3WH6335N4VF5A4NIFHULT5VDQQCT3SMT6V3572OPJG5X7Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.643335311 (279h22m59.344280227s) [noise=true , address=81.171.14.70:4037 , piece_id=AGIAS66YNGY7SSTLLP2P3RBUPHEGL264FEW5XUGO7T5Y666N44AA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.643721315 (279h22m59.344666231s) [noise=true , address=185.167.204.206:4063 , piece_id=BB7LAYPJSHDHBRZ5F2UHIGJ7NF3AER6CFZBDIAAMDVRLMNRCVZYA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644141734 (279h22m59.345086649s) [noise=true , address=81.171.14.70:4043 , piece_id=JCJDQC23FEMQD7BMMBBT5JDYZQK625JEIECNHYP7ZDYOC3HVCS7A, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644597609 (279h22m59.345542524s) [noise=true , address=89.149.201.147:4002 , piece_id=4CRT7EN5VCVOJGFHAUS7IUNHBVEVYMMOSDN5AX55OLCX653HTB5Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644997908 (279h22m59.345942824s) [noise=true , address=81.171.14.70:4029 , piece_id=MCFEOJYVUQOUZVOPJHP2WQBUXEVI2H5CPJD7HMHWI7E7KJUUPTXA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.645425491 (279h22m59.346370405s) [noise=true , address=89.149.201.147:4004 , piece_id=3TBMRJXLGWGHGFI4ESTECAXNVQFXMVJCL2CW4OXJVTRJ63LLEANA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.645875675 (279h22m59.3468206s) [noise=true , address=185.167.204.205:4031 , piece_id=4NNQC3SE567HAZ2MNFZMFI66AMLFLJF4JZEEJDQ5DQU7S5PM336Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.646310170 (279h22m59.347255085s) [noise=true , address=185.167.204.205:4018 , piece_id=BAK75WKDOWWOIUI2VMY4WDDJ3WCPV3JJN4MRKM3WKRHB2AM2UWOQ, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:33.135570941 (279h22m59.836515837s) [upload=245855]: Next returned nil segment
Nov 8 02:36:33.135581582 (279h22m59.836526477s) [upload=245855]: Waiting for error group managing segments...
Nov 8 02:36:33.354304295 (279h23m0.055249181s) [noise=true , address=81.171.14.70:4038 , piece_id=JY2WHLXDL7L5MN3LTJJGYQNL6BN4TWS4PHTWQ34N42AUETO4YKQQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.375512945 (279h23m0.076457841s) [noise=true , address=81.171.14.70:4044 , piece_id=PWITFUVXJQXHBEVZBYJQL5ZY6JWCAHEWJ5N63U35YPUUADSICL7A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.383322430 (279h23m0.084267315s) [noise=true , address=81.171.14.70:4047 , piece_id=HBWAER3WH6335N4VF5A4NIFHULT5VDQQCT3SMT6V3572OPJG5X7Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.393092692 (279h23m0.094037607s) [noise=true , address=89.149.201.147:4023 , piece_id=467JDE525L72U4ECNQCVIX3HVMKZMTHVD3UORBL5CTORRPHQ5GTA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.393391392 (279h23m0.094336307s) [noise=true , address=81.171.14.70:4027 , piece_id=RHYOWEQQPG74WO5UEGWZWJQ52CMUIRVOHWS4EGUQHC2TA46QOO3A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.414443489 (279h23m0.115388413s) [noise=true , address=185.167.204.205:4016 , piece_id=T4NYWMQN6HQ42KJLRXQI5RAOAQHPEHE77QZV6NQFF6ZX7GAOTJYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.430508192 (279h23m0.131453117s) [noise=true , address=81.171.14.70:4043 , piece_id=JCJDQC23FEMQD7BMMBBT5JDYZQK625JEIECNHYP7ZDYOC3HVCS7A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.597476928 (279h23m0.298421833s) [noise=true , address=89.149.201.147:4011 , piece_id=X5SLJKZWOULVX2E7VUDLZJOMRNOLD3Y435JZ2PEE4MBDI54QDSSQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.612057700 (279h23m0.313002585s) [noise=true , address=81.171.14.70:4039 , piece_id=KXU77JYEYKIMYHG4FN3MVLQO6X6LOOFFIJNPCTQIDQZOJBKIZJVQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.666480222 (279h23m0.367425107s) [noise=true , address=185.167.204.205:4018 , piece_id=BAK75WKDOWWOIUI2VMY4WDDJ3WCPV3JJN4MRKM3WKRHB2AM2UWOQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.697527110 (279h23m0.398472026s) [noise=true , address=185.167.204.205:4031 , piece_id=4NNQC3SE567HAZ2MNFZMFI66AMLFLJF4JZEEJDQ5DQU7S5PM336Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.710777848 (279h23m0.411722732s) [noise=true , address=185.167.204.205:4022 , piece_id=6O5BQSMEEKGOEMI5DECFBKP6GTRT65TG6LCULOKF7GG2WGOBCM4A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.718960532 (279h23m0.419905417s) [noise=true , address=89.149.201.147:4001 , piece_id=BKU4YOLRMPMLZ7VTILYYDUZRD6GQYPF32BQW52Y22DXOWCNXYWFQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.736675280 (279h23m0.437620175s) [noise=true , address=81.171.14.70:4036 , piece_id=ASMJARU62BVKMAYZH25Y3XQA7DSDSO3F7Q2Q4LYESWUJ7R2ZPKQA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.745484559 (279h23m0.446429475s) [noise=true , address=89.149.201.147:4019 , piece_id=LAC2Z3BCKSYV5633FAV4SCQN7CUWDNBM7J4SBEYUHACPU2OXZRSA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.792172848 (279h23m0.493117773s) [noise=true , address=185.167.204.206:4052 , piece_id=H2SGAMQCHP7D3TJZ7JVTRKDUN6GDETYGGJDERHDKW77ABGQYCNNA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.882300244 (279h23m0.583245159s) [noise=true , address=89.149.201.147:4015 , piece_id=JCUNNNBOQD63WANO4IJ66G2CU3JPKF3QBKTT3LZUYU2FDXJNH2EQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.882422533 (279h23m0.583367458s) [noise=true , address=89.149.201.147:4008 , piece_id=XJ4ZCMNZC2OPYADR336HWEPCONZVNZ5FHF3MQGFU7QCLIWMORI6Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.055108491 (279h23m0.756053405s) [noise=true , address=89.149.201.147:4002 , piece_id=4CRT7EN5VCVOJGFHAUS7IUNHBVEVYMMOSDN5AX55OLCX653HTB5Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.056869553 (279h23m0.757814448s) [noise=true , address=185.167.204.206:4063 , piece_id=BB7LAYPJSHDHBRZ5F2UHIGJ7NF3AER6CFZBDIAAMDVRLMNRCVZYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.149590521 (279h23m0.850535407s) [noise=true , address=89.149.201.147:4004 , piece_id=3TBMRJXLGWGHGFI4ESTECAXNVQFXMVJCL2CW4OXJVTRJ63LLEANA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.194848258 (279h23m0.895793143s) [noise=true , address=89.149.201.147:4024 , piece_id=6M3F7DNT77O2C5ZVKBJJXFGFS2YS3U4OVNHE7FTBIDEPV3C6IMYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.264483305 (279h23m0.9654282s) [noise=true , address=81.171.14.70:4033 , piece_id=IU2OGUYHLH4HGAYNCW5YOEBLQOVBYVVHVBP4WL5NCAJBR43WTV3Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.404092968 (279h23m1.105037863s) [noise=true , address=81.171.14.70:4048 , piece_id=PCZSFPJISXMAKRI3V45CT4NW7ATBTTGUJEDN36WBU44NGB5H4XAA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.523649388 (279h23m1.224594283s) [noise=true , address=81.171.14.70:4037 , piece_id=AGIAS66YNGY7SSTLLP2P3RBUPHEGL264FEW5XUGO7T5Y666N44AA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.537799893 (279h23m1.238744788s) [noise=true , address=81.171.14.70:4029 , piece_id=MCFEOJYVUQOUZVOPJHP2WQBUXEVI2H5CPJD7HMHWI7E7KJUUPTXA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.537821714 (279h23m1.238766609s) [seg_pos={0 0}, upload=245855]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:36:34.537934015 (279h23m1.23887891s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YTf9jvAKd4gVTxTZC6gGLdXC17ygbrqvqoKtmPbtHyc65YjDU): protocol: expected piece hash; context canceled; EOF
Nov 8 02:36:34.537944835 (279h23m1.23888973s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Long tail cancellation due to optimal threshold
Nov 8 02:36:34.537951658 (279h23m1.238896553s) [noise=true , address=81.171.14.70:4041 , piece_id=UC6CSGXSORAM2T5I3PFQ7GEXPZCDAYWNVNZTP235KKKXGBPDITOQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF
Nov 8 02:36:34.537959432 (279h23m1.238904327s) [noise=true , address=81.171.14.70:4041 , piece_id=UC6CSGXSORAM2T5I3PFQ7GEXPZCDAYWNVNZTP235KKKXGBPDITOQ, seg_pos={0 0}, upload=245855]: Long tail cancellation due to optimal threshold
Nov 8 02:36:34.537986714 (279h23m1.238931609s) [seg_pos={0 0}, upload=245855]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:36:34.538068697 (279h23m1.239013593s) [upload=245855]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:36:34.538073657 (279h23m1.239018552s) [upload=245855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:36:34.689738324 (279h23m1.390683219s) [upload=245855]: Done uploading segments...
Nov 8 02:36:34.689752591 (279h23m1.390697486s) [upload=245855]: Upload finished. err: <nil>
Duration: 25.254592216s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.836133543s
FAIL (2025-11-08 02:38:36 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.836170392s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [.......................X...X.........X........X..........X..] duration:
13.873766121s
FAIL (2025-11-08 02:38:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
HF3MQGFU7QCLIWMORI6Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.642492581 (279h22m59.343437496s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.642886229 (279h22m59.343831144s) [noise=true , address=81.171.14.70:4047 , piece_id=HBWAER3WH6335N4VF5A4NIFHULT5VDQQCT3SMT6V3572OPJG5X7Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.643335311 (279h22m59.344280227s) [noise=true , address=81.171.14.70:4037 , piece_id=AGIAS66YNGY7SSTLLP2P3RBUPHEGL264FEW5XUGO7T5Y666N44AA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.643721315 (279h22m59.344666231s) [noise=true , address=185.167.204.206:4063 , piece_id=BB7LAYPJSHDHBRZ5F2UHIGJ7NF3AER6CFZBDIAAMDVRLMNRCVZYA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644141734 (279h22m59.345086649s) [noise=true , address=81.171.14.70:4043 , piece_id=JCJDQC23FEMQD7BMMBBT5JDYZQK625JEIECNHYP7ZDYOC3HVCS7A, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644597609 (279h22m59.345542524s) [noise=true , address=89.149.201.147:4002 , piece_id=4CRT7EN5VCVOJGFHAUS7IUNHBVEVYMMOSDN5AX55OLCX653HTB5Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644997908 (279h22m59.345942824s) [noise=true , address=81.171.14.70:4029 , piece_id=MCFEOJYVUQOUZVOPJHP2WQBUXEVI2H5CPJD7HMHWI7E7KJUUPTXA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.645425491 (279h22m59.346370405s) [noise=true , address=89.149.201.147:4004 , piece_id=3TBMRJXLGWGHGFI4ESTECAXNVQFXMVJCL2CW4OXJVTRJ63LLEANA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.645875675 (279h22m59.3468206s) [noise=true , address=185.167.204.205:4031 , piece_id=4NNQC3SE567HAZ2MNFZMFI66AMLFLJF4JZEEJDQ5DQU7S5PM336Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.646310170 (279h22m59.347255085s) [noise=true , address=185.167.204.205:4018 , piece_id=BAK75WKDOWWOIUI2VMY4WDDJ3WCPV3JJN4MRKM3WKRHB2AM2UWOQ, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:33.135570941 (279h22m59.836515837s) [upload=245855]: Next returned nil segment
Nov 8 02:36:33.135581582 (279h22m59.836526477s) [upload=245855]: Waiting for error group managing segments...
Nov 8 02:36:33.354304295 (279h23m0.055249181s) [noise=true , address=81.171.14.70:4038 , piece_id=JY2WHLXDL7L5MN3LTJJGYQNL6BN4TWS4PHTWQ34N42AUETO4YKQQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.375512945 (279h23m0.076457841s) [noise=true , address=81.171.14.70:4044 , piece_id=PWITFUVXJQXHBEVZBYJQL5ZY6JWCAHEWJ5N63U35YPUUADSICL7A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.383322430 (279h23m0.084267315s) [noise=true , address=81.171.14.70:4047 , piece_id=HBWAER3WH6335N4VF5A4NIFHULT5VDQQCT3SMT6V3572OPJG5X7Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.393092692 (279h23m0.094037607s) [noise=true , address=89.149.201.147:4023 , piece_id=467JDE525L72U4ECNQCVIX3HVMKZMTHVD3UORBL5CTORRPHQ5GTA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.393391392 (279h23m0.094336307s) [noise=true , address=81.171.14.70:4027 , piece_id=RHYOWEQQPG74WO5UEGWZWJQ52CMUIRVOHWS4EGUQHC2TA46QOO3A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.414443489 (279h23m0.115388413s) [noise=true , address=185.167.204.205:4016 , piece_id=T4NYWMQN6HQ42KJLRXQI5RAOAQHPEHE77QZV6NQFF6ZX7GAOTJYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.430508192 (279h23m0.131453117s) [noise=true , address=81.171.14.70:4043 , piece_id=JCJDQC23FEMQD7BMMBBT5JDYZQK625JEIECNHYP7ZDYOC3HVCS7A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.597476928 (279h23m0.298421833s) [noise=true , address=89.149.201.147:4011 , piece_id=X5SLJKZWOULVX2E7VUDLZJOMRNOLD3Y435JZ2PEE4MBDI54QDSSQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.612057700 (279h23m0.313002585s) [noise=true , address=81.171.14.70:4039 , piece_id=KXU77JYEYKIMYHG4FN3MVLQO6X6LOOFFIJNPCTQIDQZOJBKIZJVQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.666480222 (279h23m0.367425107s) [noise=true , address=185.167.204.205:4018 , piece_id=BAK75WKDOWWOIUI2VMY4WDDJ3WCPV3JJN4MRKM3WKRHB2AM2UWOQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.697527110 (279h23m0.398472026s) [noise=true , address=185.167.204.205:4031 , piece_id=4NNQC3SE567HAZ2MNFZMFI66AMLFLJF4JZEEJDQ5DQU7S5PM336Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.710777848 (279h23m0.411722732s) [noise=true , address=185.167.204.205:4022 , piece_id=6O5BQSMEEKGOEMI5DECFBKP6GTRT65TG6LCULOKF7GG2WGOBCM4A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.718960532 (279h23m0.419905417s) [noise=true , address=89.149.201.147:4001 , piece_id=BKU4YOLRMPMLZ7VTILYYDUZRD6GQYPF32BQW52Y22DXOWCNXYWFQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.736675280 (279h23m0.437620175s) [noise=true , address=81.171.14.70:4036 , piece_id=ASMJARU62BVKMAYZH25Y3XQA7DSDSO3F7Q2Q4LYESWUJ7R2ZPKQA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.745484559 (279h23m0.446429475s) [noise=true , address=89.149.201.147:4019 , piece_id=LAC2Z3BCKSYV5633FAV4SCQN7CUWDNBM7J4SBEYUHACPU2OXZRSA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.792172848 (279h23m0.493117773s) [noise=true , address=185.167.204.206:4052 , piece_id=H2SGAMQCHP7D3TJZ7JVTRKDUN6GDETYGGJDERHDKW77ABGQYCNNA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.882300244 (279h23m0.583245159s) [noise=true , address=89.149.201.147:4015 , piece_id=JCUNNNBOQD63WANO4IJ66G2CU3JPKF3QBKTT3LZUYU2FDXJNH2EQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.882422533 (279h23m0.583367458s) [noise=true , address=89.149.201.147:4008 , piece_id=XJ4ZCMNZC2OPYADR336HWEPCONZVNZ5FHF3MQGFU7QCLIWMORI6Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.055108491 (279h23m0.756053405s) [noise=true , address=89.149.201.147:4002 , piece_id=4CRT7EN5VCVOJGFHAUS7IUNHBVEVYMMOSDN5AX55OLCX653HTB5Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.056869553 (279h23m0.757814448s) [noise=true , address=185.167.204.206:4063 , piece_id=BB7LAYPJSHDHBRZ5F2UHIGJ7NF3AER6CFZBDIAAMDVRLMNRCVZYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.149590521 (279h23m0.850535407s) [noise=true , address=89.149.201.147:4004 , piece_id=3TBMRJXLGWGHGFI4ESTECAXNVQFXMVJCL2CW4OXJVTRJ63LLEANA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.194848258 (279h23m0.895793143s) [noise=true , address=89.149.201.147:4024 , piece_id=6M3F7DNT77O2C5ZVKBJJXFGFS2YS3U4OVNHE7FTBIDEPV3C6IMYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.264483305 (279h23m0.9654282s) [noise=true , address=81.171.14.70:4033 , piece_id=IU2OGUYHLH4HGAYNCW5YOEBLQOVBYVVHVBP4WL5NCAJBR43WTV3Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.404092968 (279h23m1.105037863s) [noise=true , address=81.171.14.70:4048 , piece_id=PCZSFPJISXMAKRI3V45CT4NW7ATBTTGUJEDN36WBU44NGB5H4XAA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.523649388 (279h23m1.224594283s) [noise=true , address=81.171.14.70:4037 , piece_id=AGIAS66YNGY7SSTLLP2P3RBUPHEGL264FEW5XUGO7T5Y666N44AA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.537799893 (279h23m1.238744788s) [noise=true , address=81.171.14.70:4029 , piece_id=MCFEOJYVUQOUZVOPJHP2WQBUXEVI2H5CPJD7HMHWI7E7KJUUPTXA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.537821714 (279h23m1.238766609s) [seg_pos={0 0}, upload=245855]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:36:34.537934015 (279h23m1.23887891s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YTf9jvAKd4gVTxTZC6gGLdXC17ygbrqvqoKtmPbtHyc65YjDU): protocol: expected piece hash; context canceled; EOF
Nov 8 02:36:34.537944835 (279h23m1.23888973s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Long tail cancellation due to optimal threshold
Nov 8 02:36:34.537951658 (279h23m1.238896553s) [noise=true , address=81.171.14.70:4041 , piece_id=UC6CSGXSORAM2T5I3PFQ7GEXPZCDAYWNVNZTP235KKKXGBPDITOQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF
Nov 8 02:36:34.537959432 (279h23m1.238904327s) [noise=true , address=81.171.14.70:4041 , piece_id=UC6CSGXSORAM2T5I3PFQ7GEXPZCDAYWNVNZTP235KKKXGBPDITOQ, seg_pos={0 0}, upload=245855]: Long tail cancellation due to optimal threshold
Nov 8 02:36:34.537986714 (279h23m1.238931609s) [seg_pos={0 0}, upload=245855]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:36:34.538068697 (279h23m1.239013593s) [upload=245855]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:36:34.538073657 (279h23m1.239018552s) [upload=245855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:36:34.689738324 (279h23m1.390683219s) [upload=245855]: Done uploading segments...
Nov 8 02:36:34.689752591 (279h23m1.390697486s) [upload=245855]: Upload finished. err: <nil>
Duration: 13.873783533s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [........................X...X.........X........X..........X.] duration:
4.847227366s
FAIL (2025-11-08 02:37:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
HF3MQGFU7QCLIWMORI6Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.642492581 (279h22m59.343437496s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.642886229 (279h22m59.343831144s) [noise=true , address=81.171.14.70:4047 , piece_id=HBWAER3WH6335N4VF5A4NIFHULT5VDQQCT3SMT6V3572OPJG5X7Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.643335311 (279h22m59.344280227s) [noise=true , address=81.171.14.70:4037 , piece_id=AGIAS66YNGY7SSTLLP2P3RBUPHEGL264FEW5XUGO7T5Y666N44AA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.643721315 (279h22m59.344666231s) [noise=true , address=185.167.204.206:4063 , piece_id=BB7LAYPJSHDHBRZ5F2UHIGJ7NF3AER6CFZBDIAAMDVRLMNRCVZYA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644141734 (279h22m59.345086649s) [noise=true , address=81.171.14.70:4043 , piece_id=JCJDQC23FEMQD7BMMBBT5JDYZQK625JEIECNHYP7ZDYOC3HVCS7A, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644597609 (279h22m59.345542524s) [noise=true , address=89.149.201.147:4002 , piece_id=4CRT7EN5VCVOJGFHAUS7IUNHBVEVYMMOSDN5AX55OLCX653HTB5Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644997908 (279h22m59.345942824s) [noise=true , address=81.171.14.70:4029 , piece_id=MCFEOJYVUQOUZVOPJHP2WQBUXEVI2H5CPJD7HMHWI7E7KJUUPTXA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.645425491 (279h22m59.346370405s) [noise=true , address=89.149.201.147:4004 , piece_id=3TBMRJXLGWGHGFI4ESTECAXNVQFXMVJCL2CW4OXJVTRJ63LLEANA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.645875675 (279h22m59.3468206s) [noise=true , address=185.167.204.205:4031 , piece_id=4NNQC3SE567HAZ2MNFZMFI66AMLFLJF4JZEEJDQ5DQU7S5PM336Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.646310170 (279h22m59.347255085s) [noise=true , address=185.167.204.205:4018 , piece_id=BAK75WKDOWWOIUI2VMY4WDDJ3WCPV3JJN4MRKM3WKRHB2AM2UWOQ, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:33.135570941 (279h22m59.836515837s) [upload=245855]: Next returned nil segment
Nov 8 02:36:33.135581582 (279h22m59.836526477s) [upload=245855]: Waiting for error group managing segments...
Nov 8 02:36:33.354304295 (279h23m0.055249181s) [noise=true , address=81.171.14.70:4038 , piece_id=JY2WHLXDL7L5MN3LTJJGYQNL6BN4TWS4PHTWQ34N42AUETO4YKQQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.375512945 (279h23m0.076457841s) [noise=true , address=81.171.14.70:4044 , piece_id=PWITFUVXJQXHBEVZBYJQL5ZY6JWCAHEWJ5N63U35YPUUADSICL7A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.383322430 (279h23m0.084267315s) [noise=true , address=81.171.14.70:4047 , piece_id=HBWAER3WH6335N4VF5A4NIFHULT5VDQQCT3SMT6V3572OPJG5X7Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.393092692 (279h23m0.094037607s) [noise=true , address=89.149.201.147:4023 , piece_id=467JDE525L72U4ECNQCVIX3HVMKZMTHVD3UORBL5CTORRPHQ5GTA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.393391392 (279h23m0.094336307s) [noise=true , address=81.171.14.70:4027 , piece_id=RHYOWEQQPG74WO5UEGWZWJQ52CMUIRVOHWS4EGUQHC2TA46QOO3A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.414443489 (279h23m0.115388413s) [noise=true , address=185.167.204.205:4016 , piece_id=T4NYWMQN6HQ42KJLRXQI5RAOAQHPEHE77QZV6NQFF6ZX7GAOTJYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.430508192 (279h23m0.131453117s) [noise=true , address=81.171.14.70:4043 , piece_id=JCJDQC23FEMQD7BMMBBT5JDYZQK625JEIECNHYP7ZDYOC3HVCS7A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.597476928 (279h23m0.298421833s) [noise=true , address=89.149.201.147:4011 , piece_id=X5SLJKZWOULVX2E7VUDLZJOMRNOLD3Y435JZ2PEE4MBDI54QDSSQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.612057700 (279h23m0.313002585s) [noise=true , address=81.171.14.70:4039 , piece_id=KXU77JYEYKIMYHG4FN3MVLQO6X6LOOFFIJNPCTQIDQZOJBKIZJVQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.666480222 (279h23m0.367425107s) [noise=true , address=185.167.204.205:4018 , piece_id=BAK75WKDOWWOIUI2VMY4WDDJ3WCPV3JJN4MRKM3WKRHB2AM2UWOQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.697527110 (279h23m0.398472026s) [noise=true , address=185.167.204.205:4031 , piece_id=4NNQC3SE567HAZ2MNFZMFI66AMLFLJF4JZEEJDQ5DQU7S5PM336Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.710777848 (279h23m0.411722732s) [noise=true , address=185.167.204.205:4022 , piece_id=6O5BQSMEEKGOEMI5DECFBKP6GTRT65TG6LCULOKF7GG2WGOBCM4A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.718960532 (279h23m0.419905417s) [noise=true , address=89.149.201.147:4001 , piece_id=BKU4YOLRMPMLZ7VTILYYDUZRD6GQYPF32BQW52Y22DXOWCNXYWFQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.736675280 (279h23m0.437620175s) [noise=true , address=81.171.14.70:4036 , piece_id=ASMJARU62BVKMAYZH25Y3XQA7DSDSO3F7Q2Q4LYESWUJ7R2ZPKQA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.745484559 (279h23m0.446429475s) [noise=true , address=89.149.201.147:4019 , piece_id=LAC2Z3BCKSYV5633FAV4SCQN7CUWDNBM7J4SBEYUHACPU2OXZRSA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.792172848 (279h23m0.493117773s) [noise=true , address=185.167.204.206:4052 , piece_id=H2SGAMQCHP7D3TJZ7JVTRKDUN6GDETYGGJDERHDKW77ABGQYCNNA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.882300244 (279h23m0.583245159s) [noise=true , address=89.149.201.147:4015 , piece_id=JCUNNNBOQD63WANO4IJ66G2CU3JPKF3QBKTT3LZUYU2FDXJNH2EQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.882422533 (279h23m0.583367458s) [noise=true , address=89.149.201.147:4008 , piece_id=XJ4ZCMNZC2OPYADR336HWEPCONZVNZ5FHF3MQGFU7QCLIWMORI6Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.055108491 (279h23m0.756053405s) [noise=true , address=89.149.201.147:4002 , piece_id=4CRT7EN5VCVOJGFHAUS7IUNHBVEVYMMOSDN5AX55OLCX653HTB5Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.056869553 (279h23m0.757814448s) [noise=true , address=185.167.204.206:4063 , piece_id=BB7LAYPJSHDHBRZ5F2UHIGJ7NF3AER6CFZBDIAAMDVRLMNRCVZYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.149590521 (279h23m0.850535407s) [noise=true , address=89.149.201.147:4004 , piece_id=3TBMRJXLGWGHGFI4ESTECAXNVQFXMVJCL2CW4OXJVTRJ63LLEANA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.194848258 (279h23m0.895793143s) [noise=true , address=89.149.201.147:4024 , piece_id=6M3F7DNT77O2C5ZVKBJJXFGFS2YS3U4OVNHE7FTBIDEPV3C6IMYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.264483305 (279h23m0.9654282s) [noise=true , address=81.171.14.70:4033 , piece_id=IU2OGUYHLH4HGAYNCW5YOEBLQOVBYVVHVBP4WL5NCAJBR43WTV3Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.404092968 (279h23m1.105037863s) [noise=true , address=81.171.14.70:4048 , piece_id=PCZSFPJISXMAKRI3V45CT4NW7ATBTTGUJEDN36WBU44NGB5H4XAA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.523649388 (279h23m1.224594283s) [noise=true , address=81.171.14.70:4037 , piece_id=AGIAS66YNGY7SSTLLP2P3RBUPHEGL264FEW5XUGO7T5Y666N44AA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.537799893 (279h23m1.238744788s) [noise=true , address=81.171.14.70:4029 , piece_id=MCFEOJYVUQOUZVOPJHP2WQBUXEVI2H5CPJD7HMHWI7E7KJUUPTXA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.537821714 (279h23m1.238766609s) [seg_pos={0 0}, upload=245855]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:36:34.537934015 (279h23m1.23887891s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YTf9jvAKd4gVTxTZC6gGLdXC17ygbrqvqoKtmPbtHyc65YjDU): protocol: expected piece hash; context canceled; EOF
Nov 8 02:36:34.537944835 (279h23m1.23888973s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Long tail cancellation due to optimal threshold
Nov 8 02:36:34.537951658 (279h23m1.238896553s) [noise=true , address=81.171.14.70:4041 , piece_id=UC6CSGXSORAM2T5I3PFQ7GEXPZCDAYWNVNZTP235KKKXGBPDITOQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF
Nov 8 02:36:34.537959432 (279h23m1.238904327s) [noise=true , address=81.171.14.70:4041 , piece_id=UC6CSGXSORAM2T5I3PFQ7GEXPZCDAYWNVNZTP235KKKXGBPDITOQ, seg_pos={0 0}, upload=245855]: Long tail cancellation due to optimal threshold
Nov 8 02:36:34.537986714 (279h23m1.238931609s) [seg_pos={0 0}, upload=245855]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:36:34.538068697 (279h23m1.239013593s) [upload=245855]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:36:34.538073657 (279h23m1.239018552s) [upload=245855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:36:34.689738324 (279h23m1.390683219s) [upload=245855]: Done uploading segments...
Nov 8 02:36:34.689752591 (279h23m1.390697486s) [upload=245855]: Upload finished. err: <nil>
Duration: 4.847258524s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.751948341s
FAIL (2025-11-08 02:37:41 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.751968047s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
3.041542392s
FAIL (2025-11-08 02:37:16 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.041563101s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [.........................X...X.........X........X..........X] duration:
30.891841839s
FAIL (2025-11-08 02:37:03 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
HF3MQGFU7QCLIWMORI6Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.642492581 (279h22m59.343437496s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.642886229 (279h22m59.343831144s) [noise=true , address=81.171.14.70:4047 , piece_id=HBWAER3WH6335N4VF5A4NIFHULT5VDQQCT3SMT6V3572OPJG5X7Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.643335311 (279h22m59.344280227s) [noise=true , address=81.171.14.70:4037 , piece_id=AGIAS66YNGY7SSTLLP2P3RBUPHEGL264FEW5XUGO7T5Y666N44AA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.643721315 (279h22m59.344666231s) [noise=true , address=185.167.204.206:4063 , piece_id=BB7LAYPJSHDHBRZ5F2UHIGJ7NF3AER6CFZBDIAAMDVRLMNRCVZYA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644141734 (279h22m59.345086649s) [noise=true , address=81.171.14.70:4043 , piece_id=JCJDQC23FEMQD7BMMBBT5JDYZQK625JEIECNHYP7ZDYOC3HVCS7A, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644597609 (279h22m59.345542524s) [noise=true , address=89.149.201.147:4002 , piece_id=4CRT7EN5VCVOJGFHAUS7IUNHBVEVYMMOSDN5AX55OLCX653HTB5Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.644997908 (279h22m59.345942824s) [noise=true , address=81.171.14.70:4029 , piece_id=MCFEOJYVUQOUZVOPJHP2WQBUXEVI2H5CPJD7HMHWI7E7KJUUPTXA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.645425491 (279h22m59.346370405s) [noise=true , address=89.149.201.147:4004 , piece_id=3TBMRJXLGWGHGFI4ESTECAXNVQFXMVJCL2CW4OXJVTRJ63LLEANA, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.645875675 (279h22m59.3468206s) [noise=true , address=185.167.204.205:4031 , piece_id=4NNQC3SE567HAZ2MNFZMFI66AMLFLJF4JZEEJDQ5DQU7S5PM336Q, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:32.646310170 (279h22m59.347255085s) [noise=true , address=185.167.204.205:4018 , piece_id=BAK75WKDOWWOIUI2VMY4WDDJ3WCPV3JJN4MRKM3WKRHB2AM2UWOQ, seg_pos={0 0}, upload=245855]: Uploading piece...
Nov 8 02:36:33.135570941 (279h22m59.836515837s) [upload=245855]: Next returned nil segment
Nov 8 02:36:33.135581582 (279h22m59.836526477s) [upload=245855]: Waiting for error group managing segments...
Nov 8 02:36:33.354304295 (279h23m0.055249181s) [noise=true , address=81.171.14.70:4038 , piece_id=JY2WHLXDL7L5MN3LTJJGYQNL6BN4TWS4PHTWQ34N42AUETO4YKQQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.375512945 (279h23m0.076457841s) [noise=true , address=81.171.14.70:4044 , piece_id=PWITFUVXJQXHBEVZBYJQL5ZY6JWCAHEWJ5N63U35YPUUADSICL7A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.383322430 (279h23m0.084267315s) [noise=true , address=81.171.14.70:4047 , piece_id=HBWAER3WH6335N4VF5A4NIFHULT5VDQQCT3SMT6V3572OPJG5X7Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.393092692 (279h23m0.094037607s) [noise=true , address=89.149.201.147:4023 , piece_id=467JDE525L72U4ECNQCVIX3HVMKZMTHVD3UORBL5CTORRPHQ5GTA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.393391392 (279h23m0.094336307s) [noise=true , address=81.171.14.70:4027 , piece_id=RHYOWEQQPG74WO5UEGWZWJQ52CMUIRVOHWS4EGUQHC2TA46QOO3A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.414443489 (279h23m0.115388413s) [noise=true , address=185.167.204.205:4016 , piece_id=T4NYWMQN6HQ42KJLRXQI5RAOAQHPEHE77QZV6NQFF6ZX7GAOTJYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.430508192 (279h23m0.131453117s) [noise=true , address=81.171.14.70:4043 , piece_id=JCJDQC23FEMQD7BMMBBT5JDYZQK625JEIECNHYP7ZDYOC3HVCS7A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.597476928 (279h23m0.298421833s) [noise=true , address=89.149.201.147:4011 , piece_id=X5SLJKZWOULVX2E7VUDLZJOMRNOLD3Y435JZ2PEE4MBDI54QDSSQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.612057700 (279h23m0.313002585s) [noise=true , address=81.171.14.70:4039 , piece_id=KXU77JYEYKIMYHG4FN3MVLQO6X6LOOFFIJNPCTQIDQZOJBKIZJVQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.666480222 (279h23m0.367425107s) [noise=true , address=185.167.204.205:4018 , piece_id=BAK75WKDOWWOIUI2VMY4WDDJ3WCPV3JJN4MRKM3WKRHB2AM2UWOQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.697527110 (279h23m0.398472026s) [noise=true , address=185.167.204.205:4031 , piece_id=4NNQC3SE567HAZ2MNFZMFI66AMLFLJF4JZEEJDQ5DQU7S5PM336Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.710777848 (279h23m0.411722732s) [noise=true , address=185.167.204.205:4022 , piece_id=6O5BQSMEEKGOEMI5DECFBKP6GTRT65TG6LCULOKF7GG2WGOBCM4A, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.718960532 (279h23m0.419905417s) [noise=true , address=89.149.201.147:4001 , piece_id=BKU4YOLRMPMLZ7VTILYYDUZRD6GQYPF32BQW52Y22DXOWCNXYWFQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.736675280 (279h23m0.437620175s) [noise=true , address=81.171.14.70:4036 , piece_id=ASMJARU62BVKMAYZH25Y3XQA7DSDSO3F7Q2Q4LYESWUJ7R2ZPKQA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.745484559 (279h23m0.446429475s) [noise=true , address=89.149.201.147:4019 , piece_id=LAC2Z3BCKSYV5633FAV4SCQN7CUWDNBM7J4SBEYUHACPU2OXZRSA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.792172848 (279h23m0.493117773s) [noise=true , address=185.167.204.206:4052 , piece_id=H2SGAMQCHP7D3TJZ7JVTRKDUN6GDETYGGJDERHDKW77ABGQYCNNA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.882300244 (279h23m0.583245159s) [noise=true , address=89.149.201.147:4015 , piece_id=JCUNNNBOQD63WANO4IJ66G2CU3JPKF3QBKTT3LZUYU2FDXJNH2EQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:33.882422533 (279h23m0.583367458s) [noise=true , address=89.149.201.147:4008 , piece_id=XJ4ZCMNZC2OPYADR336HWEPCONZVNZ5FHF3MQGFU7QCLIWMORI6Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.055108491 (279h23m0.756053405s) [noise=true , address=89.149.201.147:4002 , piece_id=4CRT7EN5VCVOJGFHAUS7IUNHBVEVYMMOSDN5AX55OLCX653HTB5Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.056869553 (279h23m0.757814448s) [noise=true , address=185.167.204.206:4063 , piece_id=BB7LAYPJSHDHBRZ5F2UHIGJ7NF3AER6CFZBDIAAMDVRLMNRCVZYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.149590521 (279h23m0.850535407s) [noise=true , address=89.149.201.147:4004 , piece_id=3TBMRJXLGWGHGFI4ESTECAXNVQFXMVJCL2CW4OXJVTRJ63LLEANA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.194848258 (279h23m0.895793143s) [noise=true , address=89.149.201.147:4024 , piece_id=6M3F7DNT77O2C5ZVKBJJXFGFS2YS3U4OVNHE7FTBIDEPV3C6IMYA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.264483305 (279h23m0.9654282s) [noise=true , address=81.171.14.70:4033 , piece_id=IU2OGUYHLH4HGAYNCW5YOEBLQOVBYVVHVBP4WL5NCAJBR43WTV3Q, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.404092968 (279h23m1.105037863s) [noise=true , address=81.171.14.70:4048 , piece_id=PCZSFPJISXMAKRI3V45CT4NW7ATBTTGUJEDN36WBU44NGB5H4XAA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.523649388 (279h23m1.224594283s) [noise=true , address=81.171.14.70:4037 , piece_id=AGIAS66YNGY7SSTLLP2P3RBUPHEGL264FEW5XUGO7T5Y666N44AA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.537799893 (279h23m1.238744788s) [noise=true , address=81.171.14.70:4029 , piece_id=MCFEOJYVUQOUZVOPJHP2WQBUXEVI2H5CPJD7HMHWI7E7KJUUPTXA, seg_pos={0 0}, upload=245855]: Done uploading piece. err: <nil>
Nov 8 02:36:34.537821714 (279h23m1.238766609s) [seg_pos={0 0}, upload=245855]: Segment reached optimal threshold of 26 pieces.
Nov 8 02:36:34.537934015 (279h23m1.23887891s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YTf9jvAKd4gVTxTZC6gGLdXC17ygbrqvqoKtmPbtHyc65YjDU): protocol: expected piece hash; context canceled; EOF
Nov 8 02:36:34.537944835 (279h23m1.23888973s) [noise=true , address=89.149.201.147:4006 , piece_id=32JJGJA3UXPKUNPV47CWJWLRYX4S3VNQWNDGGLKAKSR4YU2O7EPQ, seg_pos={0 0}, upload=245855]: Long tail cancellation due to optimal threshold
Nov 8 02:36:34.537951658 (279h23m1.238896553s) [noise=true , address=81.171.14.70:4041 , piece_id=UC6CSGXSORAM2T5I3PFQ7GEXPZCDAYWNVNZTP235KKKXGBPDITOQ, seg_pos={0 0}, upload=245855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF
Nov 8 02:36:34.537959432 (279h23m1.238904327s) [noise=true , address=81.171.14.70:4041 , piece_id=UC6CSGXSORAM2T5I3PFQ7GEXPZCDAYWNVNZTP235KKKXGBPDITOQ, seg_pos={0 0}, upload=245855]: Long tail cancellation due to optimal threshold
Nov 8 02:36:34.537986714 (279h23m1.238931609s) [seg_pos={0 0}, upload=245855]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Nov 8 02:36:34.538068697 (279h23m1.239013593s) [upload=245855]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Nov 8 02:36:34.538073657 (279h23m1.239018552s) [upload=245855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Nov 8 02:36:34.689738324 (279h23m1.390683219s) [upload=245855]: Done uploading segments...
Nov 8 02:36:34.689752591 (279h23m1.390697486s) [upload=245855]: Upload finished. err: <nil>
Duration: 30.891895079s
core
uplink
eu-select-1
eu1-placement-15
|