Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X............X.......] duration: 2.687801813s trace: https://jaeger.dev.storj.io/trace/23c020470652f818 FAIL (2025-12-13 15:09:07 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.687823174s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................................X............X......] duration: 1.41166733s trace: https://jaeger.dev.storj.io/trace/23c020470652f818 FAIL (2025-12-13 15:08:47 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.411686677s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.855013039s trace: https://jaeger.dev.storj.io/trace/14622253dbc6efdb FAIL (2025-12-13 15:08:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments... Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces. Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments... Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.855039257s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.426791747s remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6598ec51ef681cee FAIL (2025-12-13 15:08:31 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 2.426814778s core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X............X.....] duration: 4.385586487s trace: https://jaeger.dev.storj.io/trace/23c020470652f818 FAIL (2025-12-13 15:08:07 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 4.385605933s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.421125602s trace: https://jaeger.dev.storj.io/trace/14622253dbc6efdb FAIL (2025-12-13 15:07:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments... Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces. Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments... Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.421150889s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 289.415982ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6598ec51ef681cee FAIL (2025-12-13 15:07:26 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 289.436922ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.135951482s trace: https://jaeger.dev.storj.io/trace/14622253dbc6efdb FAIL (2025-12-13 15:07:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments... Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces. Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments... Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.135968624s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X............X....] duration: 991.472926ms trace: https://jaeger.dev.storj.io/trace/23c020470652f818 FAIL (2025-12-13 15:07:06 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 991.494947ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 393.844815ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6598ec51ef681cee FAIL (2025-12-13 15:07:03 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 393.864713ms core satellite eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 273.089013ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6598ec51ef681cee FAIL (2025-12-13 15:06:40 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 273.132293ms core satellite eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 285.290045ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6598ec51ef681cee FAIL (2025-12-13 15:06:20 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 285.31387ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.163770743s trace: https://jaeger.dev.storj.io/trace/14622253dbc6efdb FAIL (2025-12-13 15:06:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments... Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces. Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments... Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.163790089s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X............X...] duration: 946.925424ms trace: https://jaeger.dev.storj.io/trace/23c020470652f818 FAIL (2025-12-13 15:06:09 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 946.948718ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [............................................X............X..] duration: 864.558842ms trace: https://jaeger.dev.storj.io/trace/23c020470652f818 FAIL (2025-12-13 15:05:15 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 864.58389ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 289.800213ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6598ec51ef681cee FAIL (2025-12-13 15:05:15 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 289.820221ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.611915821s trace: https://jaeger.dev.storj.io/trace/14622253dbc6efdb FAIL (2025-12-13 15:05:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments... Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces. Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments... Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.611941579s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............................................X............X.] duration: 3.190443304s trace: https://jaeger.dev.storj.io/trace/23c020470652f818 FAIL (2025-12-13 15:05:00 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 3.190463962s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............................................X............X] duration: 30.000521666s trace: https://jaeger.dev.storj.io/trace/23c020470652f818 FAIL (2025-12-13 15:04:35 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 30.000543126s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 424.392941ms remote: "tcp:35.207.121.91:443" target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6598ec51ef681cee FAIL (2025-12-13 15:04:28 UTC) orbiter warning: Get "https://eu1.storj.io/login": EOF Duration: 424.40818ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 4.051524631s trace: https://jaeger.dev.storj.io/trace/14622253dbc6efdb FAIL (2025-12-13 15:03:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments... Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces. Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments... Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.051544519s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.193781912s trace: https://jaeger.dev.storj.io/trace/649cbc31a10395ef FAIL (2025-12-13 15:03:49 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.193816688s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 4.069969223s trace: https://jaeger.dev.storj.io/trace/14622253dbc6efdb FAIL (2025-12-13 15:03:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments... Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces. Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments... Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.069987667s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m11.034538551s trace: https://jaeger.dev.storj.io/trace/14622253dbc6efdb FAIL (2025-12-13 15:03:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397236439 (191h33m2.094804775s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.397697840 (191h33m2.095266176s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398098999 (191h33m2.095667335s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398516290 (191h33m2.096084626s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.398901249 (191h33m2.096469585s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399349426 (191h33m2.096917772s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.399780120 (191h33m2.097348457s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400239368 (191h33m2.097807714s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.400710047 (191h33m2.098278384s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.401206515 (191h33m2.098774861s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Uploading piece... Dec 13 15:02:14.848015889 (191h33m2.545584205s) [upload=168204]: Next returned nil segment Dec 13 15:02:14.848025377 (191h33m2.545593693s) [upload=168204]: Waiting for error group managing segments... Dec 13 15:02:15.025440187 (191h33m2.723008494s) [noise=true , address=185.167.204.206:4059 , piece_id=WML2V2RUF6QT6LLYNP77KFWVC2SH4MXGDBLBA4LY3EUHMRFR74TQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.027794957 (191h33m2.725363263s) [noise=true , address=185.167.204.206:4050 , piece_id=JNFQ6G7USXR2UKO2W57SPX3Y3YAEUAOVAZJQHOB425NWAV6HEQWA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.030907020 (191h33m2.728475336s) [noise=true , address=185.167.204.206:4066 , piece_id=UJ4J3SMKS6ESSGRPXAGBVSOPAEEVL366YUMMZ3EGH7G4IIM2RNMQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.032970905 (191h33m2.730539221s) [noise=true , address=185.167.204.206:4048 , piece_id=GYCNXQDLCA4BB6WOTHCMCGSUA5U3ZYVV3VLGDXM43WRDE5HNJA6Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033444410 (191h33m2.731012716s) [noise=true , address=185.167.204.205:4024 , piece_id=JAM2FIHPV7SUJLVOLFDHTDJSPH4QBNK4CZLP423X5WOAQ6CVDPIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.033758527 (191h33m2.731326833s) [noise=true , address=185.167.204.206:4064 , piece_id=MUDK2SWYOUUKWGDSL5DRGRMFVVOLYOFP3HZJWS2WKNTBMD4MERQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035391347 (191h33m2.732959653s) [noise=true , address=185.167.204.206:4045 , piece_id=XWEFE2NECAAZLEEZOSHTNZBRVQGK32HUVWBLESVPC4UURJBEHJWQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.035781556 (191h33m2.733349872s) [noise=true , address=185.167.204.205:4005 , piece_id=5ABNM7GBVAHC4BB3RUVHVUMCF67NNY7AF4YJSCF6CN25VIXAT2FQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.038416899 (191h33m2.735985205s) [noise=true , address=185.167.204.206:4062 , piece_id=PT7HWPUYTIECZ7ZG5KWBOOI7E27F6EIV3RBWOLJDXXRPG6EABJQA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.040786576 (191h33m2.738354882s) [noise=true , address=185.167.204.205:4009 , piece_id=7EAY5UU6GGKJBELLISHA3F4VNM2O7B3SAFD7TXEGZXSMRGSDHH4A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.042568415 (191h33m2.74013672s) [noise=true , address=185.167.204.206:4040 , piece_id=PPRUXTAMBIDINTBEDIUFGGE4F5HC4M7RG5KV4EUWPKY7C66ACTGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046607449 (191h33m2.744175756s) [noise=true , address=185.167.204.206:4068 , piece_id=FLQAHWYDXULYBJ5SPDV7MPDXMCX3OUFGIICCHDTB7K45WFN4TUOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046765915 (191h33m2.744334231s) [noise=true , address=185.167.204.206:4071 , piece_id=YMJ3METH6RDNJYAY2PHF7OVSYCOONHO2OW5LJLLEU3YUQOEPN3GQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.046989362 (191h33m2.744557679s) [noise=true , address=185.167.204.206:4039 , piece_id=5UEUNDHGNI5ZV36QCCIOEXZVSN4QP6RES3PEDQIDS7STZSKQSHOA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.048441836 (191h33m2.746010152s) [noise=true , address=185.167.204.205:4014 , piece_id=ULYGTMTOKUZ7CC6IKSDNZXOYWQEUEHZPONTZMUGO67ED3VXTAIEA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.055508828 (191h33m2.753077133s) [noise=true , address=185.167.204.206:4037 , piece_id=EV5E2GMI4JISHK3ZFNW5LGF2IZXBQ4B74O4TD2PUVHR7QSXRENCA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.066618411 (191h33m2.764186727s) [noise=true , address=185.167.204.205:4015 , piece_id=YJUVGBLDRD7AQOBQIVPE2K3X6AHUHFQSSK7EB7R25ACORG4IZBNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.067068913 (191h33m2.764637229s) [noise=true , address=81.171.14.70:4043 , piece_id=X4A6QEUECNDONWBLCHNIMVGCZG35JC7JTAJEY452EI26UJMZQFNQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.076043317 (191h33m2.773611633s) [noise=true , address=185.167.204.205:4019 , piece_id=I4VNRIR26EZLQKF7KIK7ELJIEUSINEG3ZJTUP3M2ERS3PFDBYEDQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.082812111 (191h33m2.780380417s) [noise=true , address=185.167.204.205:4017 , piece_id=TLRPMHXH74P3QCMEGXBFN3OUZBVDIFLFHVVJ7W5LQZUYLDH7JR3Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.083960938 (191h33m2.781529254s) [noise=true , address=185.167.204.206:4038 , piece_id=H6MLEL3M6TQSVDSTIA4CY7ABWYLKTTT5XIJ62HG2RYMVINLQASVQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.086052005 (191h33m2.78362031s) [noise=true , address=185.167.204.206:4070 , piece_id=OIZOGUH4YBEU3NA66WLIBR47OIARSC34HTBRNBSMSWDZJKEARWHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.088551092 (191h33m2.786119399s) [noise=true , address=185.167.204.206:4060 , piece_id=QKQ7TMRD4POXARODCW74FKY5MFUBQFG5FBUTKGKSLUCCNFQJNEIQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.099151304 (191h33m2.79671961s) [noise=true , address=89.149.201.147:4022 , piece_id=6MLWX2QOU3DRUDRMW2QW57AGH6EO5TRDQGXHQ3M3GL43BVIWAVGA, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.528534405 (191h33m3.226102711s) [noise=true , address=81.171.14.70:4026 , piece_id=2AOGSTG3MSDO6SPH2VNUTMLZ5WZKA2SX4YP24GTMQ73HPO76S63Q, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549687841 (191h33m3.247256157s) [noise=true , address=89.149.201.147:4004 , piece_id=5CP7SNZDCEBVDAP425EWLLZTX3NEBWWRA2BFOITH7WAQWXHRKJHQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: <nil> Dec 13 15:02:15.549699974 (191h33m3.24726829s) [seg_pos={0 0}, upload=168204]: Segment reached optimal threshold of 26 pieces. Dec 13 15:02:15.549894397 (191h33m3.247462713s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549900709 (191h33m3.247469025s) [noise=true , address=81.171.14.70:4029 , piece_id=WVGAO2KRPFTL6ZHRYFDW45CX4DVJNVCANI5ZGLSCQPVZ2QBCDJUQ, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549928931 (191h33m3.247497247s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX): protocol: expected piece hash; context canceled; EOF Dec 13 15:02:15.549936004 (191h33m3.24750431s) [noise=true , address=89.149.201.147:4003 , piece_id=JQ5OPSWWNIXNVTWO6MOST5XIMGCFDO3AV7MHGX6WNDCJ3R5TQB3A, seg_pos={0 0}, upload=168204]: Long tail cancellation due to optimal threshold Dec 13 15:02:15.549950060 (191h33m3.247518376s) [seg_pos={0 0}, upload=168204]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 15:02:15.550005885 (191h33m3.247574191s) [upload=168204]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 15:02:15.550009642 (191h33m3.247577958s) [upload=168204]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 15:03:23.733077169 (191h34m11.430645506s) [upload=168204]: Done uploading segments... Dec 13 15:03:23.733171866 (191h34m11.430740212s) [upload=168204]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m11.034556535s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 4.641447469s trace: https://jaeger.dev.storj.io/trace/649cbc31a10395ef FAIL (2025-12-13 15:02:58 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.641470271s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 4.919458609s trace: https://jaeger.dev.storj.io/trace/649cbc31a10395ef FAIL (2025-12-13 15:02:28 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.919519513s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.891336525s trace: https://jaeger.dev.storj.io/trace/649cbc31a10395ef FAIL (2025-12-13 15:01:59 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.891352425s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.447998863s trace: https://jaeger.dev.storj.io/trace/649cbc31a10395ef FAIL (2025-12-13 15:01:01 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.448025443s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 3.456877707s trace: https://jaeger.dev.storj.io/trace/649cbc31a10395ef FAIL (2025-12-13 14:59:59 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.456905831s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 3.856829309s trace: https://jaeger.dev.storj.io/trace/649cbc31a10395ef FAIL (2025-12-13 14:59:13 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.856854344s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 12.683763475s trace: https://jaeger.dev.storj.io/trace/649cbc31a10395ef FAIL (2025-12-13 14:59:02 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 12.683784703s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.175130183s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:58:43 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 2.175158174s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 3.476832403s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:58:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 3.476851268s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X.........XX..........X...............................] duration: 3.832056391s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:57:53 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.832079936s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 3.555936914s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:57:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 3.555958364s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.388097142s trace: https://jaeger.dev.storj.io/trace/649cbc31a10395ef FAIL (2025-12-13 14:57:39 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.388131966s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.497948697s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:57:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 2.497972561s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 48.896572023s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:57:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 48.896589424s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X.........XX..........X..............................] duration: 2.99099886s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:57:07 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.991016474s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 971.726829ms trace: https://jaeger.dev.storj.io/trace/649cbc31a10395ef FAIL (2025-12-13 14:56:53 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 971.745743ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X.........XX..........X.............................] duration: 2.922253181s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:56:28 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.922273979s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X.........XX..........X............................] duration: 3.03552629s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:56:10 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.035544913s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.142305396s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:55:49 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 2.142328459s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [X........................................................X..] duration: 891.330648ms trace: https://jaeger.dev.storj.io/trace/649cbc31a10395ef FAIL (2025-12-13 14:55:42 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 891.357647ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X.........XX..........X...........................] duration: 3.107595851s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:55:07 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.107622771s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.803362545s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:55:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 2.803409294s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X........................................................X.] duration: 957.949343ms trace: https://jaeger.dev.storj.io/trace/649cbc31a10395ef FAIL (2025-12-13 14:55:02 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 957.993023ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.320142523s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:54:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 2.320165817s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X........................................................X] duration: 30.001274867s trace: https://jaeger.dev.storj.io/trace/649cbc31a10395ef FAIL (2025-12-13 14:54:16 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 30.001291889s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X.........XX..........X..........................] duration: 12.699972713s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:54:13 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 12.69999808s core uplink eu1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)