Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 3.243390166s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:53:54 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.243407659s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.743526945s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:53:10 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.743553294s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.219787521s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:52:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.219813557s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.926878885s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:52:39 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.92689238s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.636931932s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:51:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.63695716s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 3.072017964s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:51:47 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.072048731s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.936434249s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:51:28 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.936450991s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.602823877s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:50:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.602847681s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.630245495s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:50:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.630262948s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 3.029405472s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:50:22 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.029423796s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.95698961s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:50:05 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.95701096s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.20573641s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:49:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.205758021s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.646755324s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:49:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.646772916s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.672433701s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:49:09 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.67245426s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.679089938s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:49:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.679121125s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.149160697s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:48:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.149177557s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.986961636s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:47:57 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.986986832s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.197603438s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:47:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.197627351s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 3.06944658s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:46:53 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.069472338s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 3.051799282s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:46:32 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.051871326s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 3.113366703s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:46:16 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.113384697s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.689739971s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:46:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.68976091s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 3.021559024s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:45:27 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.021576025s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.131602408s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:45:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.131625642s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.670876103s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:44:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.670896101s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.925000109s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:44:20 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.925025717s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.622309126s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:44:03 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.622328402s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.18753849s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:43:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.187562535s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.685503705s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:43:20 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.685641061s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.610241253s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:43:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.61026101s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.854200126s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:42:39 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.854224552s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.629774816s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:42:23 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.629798s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.656021803s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:41:57 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.656041821s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.647931731s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:41:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.647959453s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.896521431s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:41:07 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.896553631s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.200901218s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:40:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.200924622s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.103496585s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:40:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.103519898s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.709495184s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:40:12 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.709516815s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.72452572s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:39:46 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.724546239s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.667059039s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:39:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.66708039s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.958221932s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:39:12 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.958243901s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.629326434s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:38:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.629344237s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 3.113034325s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:38:40 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.113059562s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 3.023538585s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:37:51 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.023552241s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.213729889s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:37:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.213739866s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.774591196s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:36:49 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.77460451s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.645919761s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:36:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.645936263s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.865519501s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:36:23 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.865536794s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.167198107s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:36:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.167224276s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.8637158s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:36:01 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.863727703s core uplink eu1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)