Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X............X.............................] duration:
1.181762889s trace:
https://jaeger.dev.storj.io/trace/23c020470652f818
FAIL (2025-12-13 15:27:56 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.181858428s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
285.136178ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/6598ec51ef681cee
FAIL (2025-12-13 15:27:49 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 285.155093ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X...............................X......................] duration:
2.934939296s trace:
https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331
FAIL (2025-12-13 15:27:26 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.934960276s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X...............................X.....................] duration:
3.063803036s trace:
https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331
FAIL (2025-12-13 15:27:07 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.063826158s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
273.720162ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/6598ec51ef681cee
FAIL (2025-12-13 15:27:07 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 273.732966ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.636136569s trace:
https://jaeger.dev.storj.io/trace/14622253dbc6efdb
FAIL (2025-12-13 15:27:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment
Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments...
Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces.
Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments...
Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.636156935s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X............X............................] duration:
889.408737ms trace:
https://jaeger.dev.storj.io/trace/23c020470652f818
FAIL (2025-12-13 15:26:54 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 889.424096ms
core
uplink
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
305.769464ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/6598ec51ef681cee
FAIL (2025-12-13 15:26:48 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 305.795322ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
299.977795ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/6598ec51ef681cee
FAIL (2025-12-13 15:26:31 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 299.999684ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X............X...........................] duration:
940.828133ms trace:
https://jaeger.dev.storj.io/trace/23c020470652f818
FAIL (2025-12-13 15:26:18 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 940.857858ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.285512485s trace:
https://jaeger.dev.storj.io/trace/14622253dbc6efdb
FAIL (2025-12-13 15:26:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment
Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments...
Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces.
Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments...
Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.285534055s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X...............................X....................] duration:
2.811987832s trace:
https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331
FAIL (2025-12-13 15:25:54 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.812013962s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
288.292814ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/6598ec51ef681cee
FAIL (2025-12-13 15:25:53 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 288.308463ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.21610784s trace:
https://jaeger.dev.storj.io/trace/14622253dbc6efdb
FAIL (2025-12-13 15:25:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment
Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments...
Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces.
Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments...
Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.216129711s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.698263156s trace:
https://jaeger.dev.storj.io/trace/14622253dbc6efdb
FAIL (2025-12-13 15:25:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment
Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments...
Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces.
Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments...
Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.698280318s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X............X..........................] duration:
1.068024147s trace:
https://jaeger.dev.storj.io/trace/23c020470652f818
FAIL (2025-12-13 15:25:06 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.068044854s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X...............................X...................] duration:
2.912586912s trace:
https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331
FAIL (2025-12-13 15:25:00 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.912605227s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
286.841863ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/6598ec51ef681cee
FAIL (2025-12-13 15:24:45 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 286.881238ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X...............................X..................] duration:
2.7685239s trace:
https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331
FAIL (2025-12-13 15:24:36 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.768544809s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.763615611s trace:
https://jaeger.dev.storj.io/trace/14622253dbc6efdb
FAIL (2025-12-13 15:24:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment
Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments...
Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces.
Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments...
Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.76363678s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X...............................X.................] duration:
2.840046691s trace:
https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331
FAIL (2025-12-13 15:24:21 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.840073159s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X............X.........................] duration:
1.090491518s trace:
https://jaeger.dev.storj.io/trace/23c020470652f818
FAIL (2025-12-13 15:24:16 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.090515844s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
622.466818ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/6598ec51ef681cee
FAIL (2025-12-13 15:24:02 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 622.490564ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
3 out of 60 is failed (threshold=3) [X..........X...............................X................] duration:
2.770251717s trace:
https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331
FAIL (2025-12-13 15:23:51 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.770278779s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X............X........................] duration:
1.196177177s trace:
https://jaeger.dev.storj.io/trace/23c020470652f818
FAIL (2025-12-13 15:23:44 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.196199108s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.982992895s trace:
https://jaeger.dev.storj.io/trace/14622253dbc6efdb
FAIL (2025-12-13 15:23:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment
Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments...
Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces.
Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments...
Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.983007653s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
273.239896ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/6598ec51ef681cee
FAIL (2025-12-13 15:23:27 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 273.257177ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.67892968s trace:
https://jaeger.dev.storj.io/trace/14622253dbc6efdb
FAIL (2025-12-13 15:23:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment
Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments...
Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces.
Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments...
Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.678947693s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [XX..........X...............................X...............] duration:
3.121112623s trace:
https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331
FAIL (2025-12-13 15:23:16 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.121132159s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X............X.......................] duration:
1.449574533s trace:
https://jaeger.dev.storj.io/trace/23c020470652f818
FAIL (2025-12-13 15:22:52 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.44959401s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
286.799331ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/6598ec51ef681cee
FAIL (2025-12-13 15:22:43 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 286.824276ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X............X......................] duration:
904.375958ms trace:
https://jaeger.dev.storj.io/trace/23c020470652f818
FAIL (2025-12-13 15:22:12 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 904.400525ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.XX..........X...............................X..............] duration:
2.772446968s trace:
https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331
FAIL (2025-12-13 15:22:10 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.772467095s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.157605984s trace:
https://jaeger.dev.storj.io/trace/14622253dbc6efdb
FAIL (2025-12-13 15:22:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment
Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments...
Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces.
Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments...
Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.157624669s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
301.866462ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/6598ec51ef681cee
FAIL (2025-12-13 15:21:40 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 301.886359ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [..XX..........X...............................X.............] duration:
2.807193599s trace:
https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331
FAIL (2025-12-13 15:21:24 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.807272746s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X............X.....................] duration:
963.938927ms trace:
https://jaeger.dev.storj.io/trace/23c020470652f818
FAIL (2025-12-13 15:21:06 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 963.966007ms
core
uplink
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
284.231358ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/6598ec51ef681cee
FAIL (2025-12-13 15:21:01 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 284.240565ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.158031259s trace:
https://jaeger.dev.storj.io/trace/14622253dbc6efdb
FAIL (2025-12-13 15:20:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment
Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments...
Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces.
Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments...
Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.158051707s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
344.816225ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/6598ec51ef681cee
FAIL (2025-12-13 15:20:46 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 344.876136ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.615032364s trace:
https://jaeger.dev.storj.io/trace/14622253dbc6efdb
FAIL (2025-12-13 15:20:33 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment
Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments...
Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces.
Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments...
Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.61505696s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [...XX..........X...............................X............] duration:
3.624047838s trace:
https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331
FAIL (2025-12-13 15:20:25 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.624073877s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X............X....................] duration:
1.019191774s trace:
https://jaeger.dev.storj.io/trace/23c020470652f818
FAIL (2025-12-13 15:20:21 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.019235194s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [....XX..........X...............................X...........] duration:
2.710626713s trace:
https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331
FAIL (2025-12-13 15:19:51 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.710646981s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
271.011401ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/6598ec51ef681cee
FAIL (2025-12-13 15:19:44 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 271.027983ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.69027337s trace:
https://jaeger.dev.storj.io/trace/14622253dbc6efdb
FAIL (2025-12-13 15:19:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment
Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments...
Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces.
Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments...
Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.690291364s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X............X...................] duration:
976.098153ms trace:
https://jaeger.dev.storj.io/trace/23c020470652f818
FAIL (2025-12-13 15:19:08 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 976.114574ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.421897403s trace:
https://jaeger.dev.storj.io/trace/14622253dbc6efdb
FAIL (2025-12-13 15:19:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece...
Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment
Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments...
Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil>
Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces.
Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF
Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold
Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments...
Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.421909606s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....XX..........X...............................X..........] duration:
2.862676876s trace:
https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331
FAIL (2025-12-13 15:18:49 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.862700128s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
287.436886ms remote:
"tcp:35.207.121.91:443" target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/6598ec51ef681cee
FAIL (2025-12-13 15:18:41 UTC)
orbiter warning: Get "https://eu1.storj.io/login": EOF
Duration: 287.452415ms
core
satellite
eu1
|