Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.228827896s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 19:13:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.228845509s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.218732487s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 19:12:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.218757414s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.641220475s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 19:11:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.641240342s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.142978772s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 19:11:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.142996203s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.160182876s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 19:10:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.160207633s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.625638087s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 19:09:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.625660479s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.811132779s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 19:09:23 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.81118689s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.617291816s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 19:08:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.617310109s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 3.045828212s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 19:08:31 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.0458484s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.269919814s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 19:08:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.269940501s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 3.248798699s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 19:08:08 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.248822525s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 3.034160284s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 19:07:47 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.034180602s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.598495543s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 19:07:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.598517194s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 3.195647054s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 19:06:37 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.195667222s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.611905426s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 19:06:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.611927245s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.608120246s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 19:05:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.60813816s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 3.909069325s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 19:05:40 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.909089282s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.705993842s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 19:04:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.706009682s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.90639657s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 19:04:29 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.906456382s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.984584308s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 19:04:06 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.98461227s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.688845468s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 19:04:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.688865336s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.657208371s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 19:03:21 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.657229632s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.201116905s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 19:03:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.201134086s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 3.087936972s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 19:02:50 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.087954104s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.928815085s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 19:02:29 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.928835674s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.1703343s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 19:02:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.170357925s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.149738369s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 19:01:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.14975435s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 3.015797003s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 19:01:24 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.015820738s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.189346988s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 19:01:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.189377085s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 3.151794479s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 19:00:40 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.151817602s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.592944267s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 19:00:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.592958514s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.722070746s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 19:00:19 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.722091051s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.178382818s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 19:00:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.178413083s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.761274273s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:59:38 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.761290624s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.61599933s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:59:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.616016011s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.559359478s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:59:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.559380558s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 3.087172854s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:58:52 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.087193342s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.119348881s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:58:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.119373818s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.998874804s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:58:34 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.998904679s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.591149372s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:58:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.591167447s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.662251721s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:58:07 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.662280304s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 3.053611363s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:57:25 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.053634596s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 3.126970612s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:57:09 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.126991162s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.704666914s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:57:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.704677504s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.581701661s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:56:15 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.581716629s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.602901304s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:56:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.602918085s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.802562466s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:55:54 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.80258102s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.716071166s trace: https://jaeger.dev.storj.io/trace/373dcd1aa45f200e FAIL (2025-12-15 18:55:03 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.716090712s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.759446185s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:54:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.759464249s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.659146719s trace: https://jaeger.dev.storj.io/trace/69e0358420660331 FAIL (2025-12-15 18:53:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.459852640 (243h0m1.157420946s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460031273 (243h0m1.157599589s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460182977 (243h0m1.157751282s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460428956 (243h0m1.157997272s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.460765174 (243h0m1.15833348s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461076576 (243h0m1.158644892s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.461642794 (243h0m1.15921111s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462786149 (243h0m1.160354456s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.462862161 (243h0m1.160430477s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.463249855 (243h0m1.160818171s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Uploading piece... Dec 15 18:29:13.921820969 (243h0m1.619389305s) [upload=213590]: Next returned nil segment Dec 15 18:29:13.921835546 (243h0m1.619403882s) [upload=213590]: Waiting for error group managing segments... Dec 15 18:29:14.102209961 (243h0m1.799778297s) [noise=true , address=185.167.204.206:4041 , piece_id=JUCFJ7ECIFKWL3L5YFHQW3B5BW3LPWFSKJHQEL7R7U3UWLWIGCLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103304245 (243h0m1.800872581s) [noise=true , address=81.171.14.70:4035 , piece_id=GXWOGJ5PECLWO22Y47L5EFVWCHQQDL3T446O6CEPL4BWXEXDYZ6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.103991349 (243h0m1.801559684s) [noise=true , address=185.167.204.205:4031 , piece_id=MEX7UHVCMDZ4S5Z74ZWVO4MGSXAHF5W4WO2QDOWWTY5JJ72BGV6A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105066186 (243h0m1.802634523s) [noise=true , address=185.167.204.206:4059 , piece_id=7XUPDV4PMJK27J6WPZSE6ZG53TNSEVOMKKVOKMRQK5W333A7BUYQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105557644 (243h0m1.80312598s) [noise=true , address=185.167.204.206:4051 , piece_id=2WOO3SS36XVBB3NJI2YEYGA2AKRCGJNJIA2XBHANBBGYDZ54T2NQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.105945328 (243h0m1.803513664s) [noise=true , address=185.167.204.206:4038 , piece_id=NOGNEAEQJ2LD4GRQUSUBGTPBDP6SYPRJ7YTMEXVVBXEYDYQKMPDA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106594641 (243h0m1.804162978s) [noise=true , address=185.167.204.205:4030 , piece_id=ZGYHCOYSCSWT2QZLJCTU3KMO6LPLC7OKATECVQCVH7RVDGDJF5EQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.106626059 (243h0m1.804194396s) [noise=true , address=185.167.204.206:4048 , piece_id=OAYEAM4T72PSS4KUDQ3DLLVTP5MRNIYVPQPMJNOMDSBUYWDYEASA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.111587317 (243h0m1.809155664s) [noise=true , address=185.167.204.205:4006 , piece_id=LEAQGBFOGEOE23XECG53EJZLVD2PWV6CSUS4ARBJODJONRVUZMMA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.113881994 (243h0m1.81145033s) [noise=true , address=185.167.204.205:4004 , piece_id=5MHLK2CHAA7Y63VIGKP3EC2ELIDOFIHEJ7SCD3A2KSOM2ULOJGRQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.114057433 (243h0m1.811625778s) [noise=true , address=185.167.204.205:4014 , piece_id=LY26SU5P3B432UOQOTBPBJU52YF3CP4BOLFKY6FO53JJPUGBC4HA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.135505468 (243h0m1.833073804s) [noise=true , address=185.167.204.205:4015 , piece_id=CZ7JINWLX74OMXCTZ64NMATEGSOD3FXCMVCIY3DDMVL4SDQPITLQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.136080412 (243h0m1.833648758s) [noise=true , address=185.167.204.205:4020 , piece_id=QWXLNCKGCLMKQEC72VWVRDDF7GICOUVMA6HVWH26KCEGFGBO7YQA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.140861924 (243h0m1.83843027s) [noise=true , address=185.167.204.206:4057 , piece_id=Y742D5IJUNUZHM4M5573EJBUTVIF6E47POFKMX53UFNPFSWKBAPA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.144172197 (243h0m1.841740543s) [noise=true , address=185.167.204.205:4017 , piece_id=BV6DKYAOKGWIUJZ3LML4O6RH3EWWG4SIP2OTNNYKXLSBSCIV7KNQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.146741867 (243h0m1.844310204s) [noise=true , address=185.167.204.206:4064 , piece_id=OWPKXUWDAOKVEDKXM5VTLMRKMWR5CYCSIB623LFFOTH6O6YTWQ4A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.149631956 (243h0m1.847200293s) [noise=true , address=81.171.14.70:4039 , piece_id=YXDUZEKD34HEOW3DITW5R4DJRMBJXTZLQQKJQF6XB6EXA7J7R2OQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.150389200 (243h0m1.847957537s) [noise=true , address=89.149.201.147:4009 , piece_id=3H2AI33X3HXAZOWPRO4RWPD3O6PIWG7FP62JMOHEJDBDHINHT2BQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.153533434 (243h0m1.851101771s) [noise=true , address=185.167.204.206:4037 , piece_id=DKDBJBEHXCAUV2NP5APGI2AHE5J2TP5RGLQUAGOTMRF3R6I7WDAQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.155880729 (243h0m1.853449065s) [noise=true , address=185.167.204.206:4067 , piece_id=ZLCNDNR57WPIPI6MGYHC4VDO6HT6ITH67WF34G2SOBNBAYOQ7AUA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.156251001 (243h0m1.853819337s) [noise=true , address=89.149.201.147:4017 , piece_id=HR6F7NN36BWOLUOZJNWSJMRK7CBCRNFAI5K3SJNIFTS4DZFU5COA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.162011121 (243h0m1.859579457s) [noise=true , address=89.149.201.147:4024 , piece_id=75C23RDXZY2PHKV6H5OMEIUN6FA4G6BJIYQXDTQTITANCBI64XSQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.165282262 (243h0m1.862850598s) [noise=true , address=185.167.204.205:4034 , piece_id=UBBPTZUNSMPWAXP6APIEYNLVHOPD7V6B6O6J7SUR4G2UQH2WEZFA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.170533510 (243h0m1.868101847s) [noise=true , address=81.171.14.70:4040 , piece_id=DZXFOHUXZY5XEJZEOAX26D4SFHE24TXBGOENUMCXJVV5KC35HSIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.613159689 (243h0m2.310728024s) [noise=true , address=89.149.201.147:4001 , piece_id=UQ7WHXOFMYDIHHKAS7HKCGJ4DPKJQW5ATS2DJS4AHKKEYCSVOLIQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623817647 (243h0m2.321385983s) [noise=true , address=81.171.14.70:4030 , piece_id=FSUEDURKIR6SQXZ6ARAKUK5NUR7HVZAUYW4UIVOC3KT4U4TGXPZA, seg_pos={0 0}, upload=213590]: Done uploading piece. err: <nil> Dec 15 18:29:14.623840790 (243h0m2.321409127s) [seg_pos={0 0}, upload=213590]: Segment reached optimal threshold of 26 pieces. Dec 15 18:29:14.624285762 (243h0m2.321854098s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624301081 (243h0m2.321869427s) [noise=true , address=81.171.14.70:4028 , piece_id=6N6PZWXGV6ZH6EO5LT2N3XOWZORKYBLLNH6LR5WOLAAYEWDDMI7A, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624824528 (243h0m2.322392864s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv): protocol: expected piece hash; context canceled; EOF Dec 15 18:29:14.624839166 (243h0m2.322407502s) [noise=true , address=89.149.201.147:4012 , piece_id=B4RZ3EB4QK2KHUKNZYVFRSLNSQMTGYBOOTSO7BFV26XMMXYE5RGQ, seg_pos={0 0}, upload=213590]: Long tail cancellation due to optimal threshold Dec 15 18:29:14.624877788 (243h0m2.322446124s) [seg_pos={0 0}, upload=213590]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 15 18:29:14.624977574 (243h0m2.32254591s) [upload=213590]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 15 18:29:14.624988475 (243h0m2.322556811s) [upload=213590]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 15 18:30:36.176310366 (243h1m23.873878673s) [upload=213590]: Done uploading segments... Dec 15 18:30:36.176388972 (243h1m23.873957288s) [upload=213590]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.659164953s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)