Orbiter History

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 370.001204ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6598ec51ef681cee FAIL (2025-12-13 15:37:31 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 370.024216ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [....X............X..........................................] duration: 901.848225ms trace: https://jaeger.dev.storj.io/trace/23c020470652f818 FAIL (2025-12-13 15:37:27 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 901.876669ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.58485103s trace: https://jaeger.dev.storj.io/trace/14622253dbc6efdb FAIL (2025-12-13 15:37:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments... Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces. Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments... Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.584877218s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 3.040274711s trace: https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331 FAIL (2025-12-13 15:37:10 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.040298224s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....X............X.........................................] duration: 870.303058ms trace: https://jaeger.dev.storj.io/trace/23c020470652f818 FAIL (2025-12-13 15:37:02 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 870.323447ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 290.842618ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6598ec51ef681cee FAIL (2025-12-13 15:36:37 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 290.8651ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.726925792s trace: https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331 FAIL (2025-12-13 15:36:24 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.726946019s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X............X........................................] duration: 2.248871837s trace: https://jaeger.dev.storj.io/trace/23c020470652f818 FAIL (2025-12-13 15:36:22 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.248914767s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.205536953s trace: https://jaeger.dev.storj.io/trace/14622253dbc6efdb FAIL (2025-12-13 15:36:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments... Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces. Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments... Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.205555267s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.757725006s trace: https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331 FAIL (2025-12-13 15:35:53 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.757745614s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 291.64686ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6598ec51ef681cee FAIL (2025-12-13 15:35:42 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 291.663721ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......X............X.......................................] duration: 875.809284ms trace: https://jaeger.dev.storj.io/trace/23c020470652f818 FAIL (2025-12-13 15:35:24 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 875.824653ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.254956083s trace: https://jaeger.dev.storj.io/trace/14622253dbc6efdb FAIL (2025-12-13 15:35:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments... Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces. Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments... Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.254972514s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 307.076934ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6598ec51ef681cee FAIL (2025-12-13 15:35:05 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 307.097683ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X............X......................................] duration: 906.399411ms trace: https://jaeger.dev.storj.io/trace/23c020470652f818 FAIL (2025-12-13 15:35:01 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 906.493147ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.63020058s trace: https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331 FAIL (2025-12-13 15:34:54 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.630223513s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 324.410917ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6598ec51ef681cee FAIL (2025-12-13 15:34:49 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 324.437424ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.307946824s trace: https://jaeger.dev.storj.io/trace/14622253dbc6efdb FAIL (2025-12-13 15:34:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments... Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces. Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments... Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.307962863s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X............X.....................................] duration: 934.882677ms trace: https://jaeger.dev.storj.io/trace/23c020470652f818 FAIL (2025-12-13 15:34:25 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 934.9051ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.755961694s trace: https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331 FAIL (2025-12-13 15:34:11 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.755978534s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X............X....................................] duration: 897.683036ms trace: https://jaeger.dev.storj.io/trace/23c020470652f818 FAIL (2025-12-13 15:33:40 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 897.702532ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 276.225532ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6598ec51ef681cee FAIL (2025-12-13 15:33:39 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 276.247503ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.680736546s trace: https://jaeger.dev.storj.io/trace/14622253dbc6efdb FAIL (2025-12-13 15:33:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments... Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces. Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments... Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.680760492s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X............X...................................] duration: 909.342126ms trace: https://jaeger.dev.storj.io/trace/23c020470652f818 FAIL (2025-12-13 15:33:21 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 909.362494ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.682271723s trace: https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331 FAIL (2025-12-13 15:33:03 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.682284028s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 267.592294ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6598ec51ef681cee FAIL (2025-12-13 15:33:02 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 267.608615ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.19180433s trace: https://jaeger.dev.storj.io/trace/14622253dbc6efdb FAIL (2025-12-13 15:32:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments... Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces. Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments... Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.191825218s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.711537624s trace: https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331 FAIL (2025-12-13 15:32:14 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.711560026s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X............X..................................] duration: 941.20653ms trace: https://jaeger.dev.storj.io/trace/23c020470652f818 FAIL (2025-12-13 15:32:08 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 941.234623ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 297.240459ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6598ec51ef681cee FAIL (2025-12-13 15:32:02 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 297.257921ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [X...............................X...........................] duration: 2.745720581s trace: https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331 FAIL (2025-12-13 15:31:55 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.745736902s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.568230226s trace: https://jaeger.dev.storj.io/trace/14622253dbc6efdb FAIL (2025-12-13 15:31:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments... Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces. Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments... Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.568273226s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X...............................X..........................] duration: 3.384709996s trace: https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331 FAIL (2025-12-13 15:31:30 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.384724734s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X............X.................................] duration: 958.406792ms trace: https://jaeger.dev.storj.io/trace/23c020470652f818 FAIL (2025-12-13 15:31:13 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 958.452818ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 299.982462ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6598ec51ef681cee FAIL (2025-12-13 15:31:04 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 300.081687ms core satellite eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 305.251355ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6598ec51ef681cee FAIL (2025-12-13 15:30:34 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 305.270802ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.230357802s trace: https://jaeger.dev.storj.io/trace/14622253dbc6efdb FAIL (2025-12-13 15:30:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments... Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces. Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments... Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.230412343s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X...............................X.........................] duration: 3.15269356s trace: https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331 FAIL (2025-12-13 15:30:19 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.15271018s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X............X................................] duration: 1.231820952s trace: https://jaeger.dev.storj.io/trace/23c020470652f818 FAIL (2025-12-13 15:30:04 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.231838074s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 370.281366ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6598ec51ef681cee FAIL (2025-12-13 15:30:00 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 370.409396ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.634183249s trace: https://jaeger.dev.storj.io/trace/14622253dbc6efdb FAIL (2025-12-13 15:29:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments... Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces. Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments... Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.634208226s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 291.042552ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6598ec51ef681cee FAIL (2025-12-13 15:29:29 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 291.067357ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.594677501s trace: https://jaeger.dev.storj.io/trace/14622253dbc6efdb FAIL (2025-12-13 15:29:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments... Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces. Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments... Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.594708308s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X............X...............................] duration: 933.858875ms trace: https://jaeger.dev.storj.io/trace/23c020470652f818 FAIL (2025-12-13 15:29:20 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 933.878602ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X...............................X........................] duration: 2.709393008s trace: https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331 FAIL (2025-12-13 15:29:08 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.709411834s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 290.596529ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6598ec51ef681cee FAIL (2025-12-13 15:29:06 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 290.606958ms core satellite eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 281.520574ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6598ec51ef681cee FAIL (2025-12-13 15:28:51 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 281.545179ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X............X..............................] duration: 1.415566784s trace: https://jaeger.dev.storj.io/trace/23c020470652f818 FAIL (2025-12-13 15:28:42 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.415591429s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.307802666s trace: https://jaeger.dev.storj.io/trace/14622253dbc6efdb FAIL (2025-12-13 15:28:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments... Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces. Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments... Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.307822271s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X...............................X.......................] duration: 2.980856904s trace: https://jaeger.dev.storj.io/trace/4f719c7a9bbc2331 FAIL (2025-12-13 15:28:02 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.980879567s core uplink eu1

Orbiter Check History

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)