Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 14 out of 60 is failed (threshold=3) [..X.....X.X.X...X...X..X.X..X......X..X.....X..........XX...] duration: 6.835757854s trace: https://jaeger.dev.storj.io/trace/62dd781a0b1ba679 FAIL (2025-12-09 01:49:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 01.147:4004 , piece_id=OCJIY6CWQK2RJI6VGGNU5LEGE2Z54OBOHEBETSOOIA6XA6RCCV6Q, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.493632881 (82h17m48.191201187s) [noise=true , address=89.149.201.147:4024 , piece_id=VVX6SZM7W6M2S2VHHDXOB5FFXIFU3VZUSQT3DM2Y5W36U5ZZZWKQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.494039881 (82h17m48.191608197s) [noise=true , address=81.171.14.70:4037 , piece_id=LPYVO6CAGXK2DKBALAKSGOANV33CXC6TKVH4JHNILNAEWJG3NAWQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.494374677 (82h17m48.191942993s) [noise=true , address=81.171.14.70:4047 , piece_id=PPADIK35752S6N6J73QMTPCL5ZOU4QMLMVNNCC5I2AEKWOARVQMA, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.495199778 (82h17m48.192768094s) [noise=true , address=81.171.14.70:4038 , piece_id=3IUASFH2HJFENWODDPQU2JD77RM63ASYVWP5UKUBOTBFWTJMMERQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.496159411 (82h17m48.193727717s) [noise=true , address=81.171.14.70:4045 , piece_id=3JQYWQLKWLVTK64XPLNPCAZZEZC5OG37EUYIO7TZKI5LGUO254XA, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.499456750 (82h17m48.197025055s) [noise=true , address=89.149.201.147:4002 , piece_id=KPXMZ5GGFPXNJ4TQ6JYS63BD5JSJLYL5IVPWUHNZCFYHWZ4EPHCQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.500529073 (82h17m48.198097378s) [noise=true , address=185.167.204.205:4026 , piece_id=Z462MSJBZDXLAUKTY4LDAQYORSHG73EYJ4ETGKGYZWIEBDBTQ4NQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.500918140 (82h17m48.198486456s) [noise=true , address=185.167.204.206:4046 , piece_id=4H7XDOT2QRX2SPBNNOL6EZB6NWGVBAQQ64OTNVFMJYX47K4R4W4Q, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.501235963 (82h17m48.198804279s) [noise=true , address=185.167.204.205:4032 , piece_id=UEBO56CSAMORAHRXBNUD6F2RSBNPWE2WAPTMAXUP7DTZ4BXANXHQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.501886809 (82h17m48.199455126s) [noise=true , address=81.171.14.70:4026 , piece_id=IDESMHDRGMALWFCYAJGK45EBXJBRE65YS6RDDOBX35QJFHYC2PMA, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.995932458 (82h17m48.693500774s) [upload=72218]: Next returned nil segment Dec 9 01:47:00.995944109 (82h17m48.693512416s) [upload=72218]: Waiting for error group managing segments... Dec 9 01:47:01.202665323 (82h17m48.900233639s) [noise=true , address=185.167.204.206:4044 , piece_id=TGGHW3I46HB3RNCSJAIT4YJRDVP5ZEDTDUG7L2GLQSOISX4IVCKA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.225967129 (82h17m48.923535445s) [noise=true , address=81.171.14.70:4036 , piece_id=Z74QD2RO5RFGPNIMBRRXMZIBCZJCINAUWVNKV56GIYXG7YRLBCIA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.227739570 (82h17m48.925307887s) [noise=true , address=81.171.14.70:4037 , piece_id=LPYVO6CAGXK2DKBALAKSGOANV33CXC6TKVH4JHNILNAEWJG3NAWQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.229673212 (82h17m48.927241529s) [noise=true , address=81.171.14.70:4045 , piece_id=3JQYWQLKWLVTK64XPLNPCAZZEZC5OG37EUYIO7TZKI5LGUO254XA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.231639726 (82h17m48.929208032s) [noise=true , address=185.167.204.206:4066 , piece_id=AIRJWETZWOE22EJ2DGMHLP6LPN6KCITOWVUQXBZ47RYCJQDSJMBA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.237470357 (82h17m48.935038673s) [noise=true , address=89.149.201.147:4004 , piece_id=OCJIY6CWQK2RJI6VGGNU5LEGE2Z54OBOHEBETSOOIA6XA6RCCV6Q, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.273184279 (82h17m48.970752595s) [noise=true , address=89.149.201.147:4024 , piece_id=VVX6SZM7W6M2S2VHHDXOB5FFXIFU3VZUSQT3DM2Y5W36U5ZZZWKQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.508726238 (82h17m49.206294574s) [noise=true , address=185.167.204.205:4003 , piece_id=2SN5T64LCCXX2TUW4UOXSBSI23TEZP3665NIAZ2DAOJIZKXZ67MA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.610559678 (82h17m49.308127994s) [noise=true , address=81.171.14.70:4041 , piece_id=3QEHVCZC2BIMFTNOLI4JSMDDRXNSNEYNG4NNRX6IRUPZVQ5O56AQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.615192150 (82h17m49.312760466s) [noise=true , address=89.149.201.147:4002 , piece_id=KPXMZ5GGFPXNJ4TQ6JYS63BD5JSJLYL5IVPWUHNZCFYHWZ4EPHCQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.619035289 (82h17m49.316603595s) [noise=true , address=89.149.201.147:4017 , piece_id=U4L67GWTCFAZ2R4YE7GFP3JAOO4AZLRVDW2DF3OYU7SEAQ43NJRA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.719169234 (82h17m49.41673755s) [noise=true , address=89.149.201.147:4010 , piece_id=WNBK7UIQ6HKCFL2EVEK4PD4KEF2NJJKZIAZZLZVIAW5QYDFQ6PCA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.720083040 (82h17m49.417651377s) [noise=true , address=185.167.204.206:4043 , piece_id=RBVEUBR6NUVX6S4WJFHHTXFLXQL7OK3TARGCEGIOA26N3WDCRZ6A, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.788662513 (82h17m49.486230859s) [noise=true , address=89.149.201.147:4016 , piece_id=OEGL5OZETOEFEWUBQLRBYKEETIGAFPCBRAXBB37FDQEONMNVCVOQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.792722657 (82h17m49.490290993s) [noise=true , address=185.167.204.205:4036 , piece_id=BXYGRN7SWWSHYQ6LLD7LRQ4PNCPEPLNIJRHBDG5MKEPJ7F5QQEWA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.836830187 (82h17m49.534398523s) [noise=true , address=81.171.14.70:4026 , piece_id=IDESMHDRGMALWFCYAJGK45EBXJBRE65YS6RDDOBX35QJFHYC2PMA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.838428573 (82h17m49.535996909s) [noise=true , address=89.149.201.147:4009 , piece_id=A6VZJPUUTCWLZLVCRDT63KL2NRTWJLEHTBCL7RHZG67UQD4ZLJ7Q, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.868943353 (82h17m49.566511689s) [noise=true , address=81.171.14.70:4043 , piece_id=ERJPTPLOON2EMPWBMZMXRRHFWY3KV6AQLCTAVR73TQ6K2SQGH4VA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.896454682 (82h17m49.594022998s) [noise=true , address=81.171.14.70:4047 , piece_id=PPADIK35752S6N6J73QMTPCL5ZOU4QMLMVNNCC5I2AEKWOARVQMA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.949977028 (82h17m49.647545334s) [noise=true , address=185.167.204.206:4046 , piece_id=4H7XDOT2QRX2SPBNNOL6EZB6NWGVBAQQ64OTNVFMJYX47K4R4W4Q, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.055403810 (82h17m49.752972126s) [noise=true , address=185.167.204.205:4032 , piece_id=UEBO56CSAMORAHRXBNUD6F2RSBNPWE2WAPTMAXUP7DTZ4BXANXHQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.066015913 (82h17m49.763584229s) [noise=true , address=81.171.14.70:4029 , piece_id=4H2N2KDVQ57EBQWBCNDNQT2H6A2T4MCLPJM3ULZLE6C244HIB3KQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.281258342 (82h17m49.978826648s) [noise=true , address=81.171.14.70:4028 , piece_id=HMFBTEBWJ3R64LYYEK7YM6TUZW42PMWMIYS3OG6NINGSCEBL3QMQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.345408540 (82h17m50.042976876s) [noise=true , address=81.171.14.70:4038 , piece_id=3IUASFH2HJFENWODDPQU2JD77RM63ASYVWP5UKUBOTBFWTJMMERQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.566764831 (82h17m50.264333137s) [noise=true , address=185.167.204.205:4011 , piece_id=4NQUAOEP6A2HMPDY7SKNYDCPV5IRDCMRD4NT3ZSB45EPNJJER72A, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.682771175 (82h17m50.380339491s) [noise=true , address=185.167.204.205:4026 , piece_id=Z462MSJBZDXLAUKTY4LDAQYORSHG73EYJ4ETGKGYZWIEBDBTQ4NQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.682787154 (82h17m50.380355461s) [seg_pos={0 0}, upload=72218]: Segment reached optimal threshold of 26 pieces. Dec 9 01:47:02.682939199 (82h17m50.380507515s) [noise=true , address=185.167.204.205:4004 , piece_id=G5XMIF5JJFP5EWANE5DAHA6GCZ63V5MG7SK437JTRTEQG2K5FJ5A, seg_pos={0 0}, upload=72218]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm): protocol: expected piece hash; context canceled; EOF Dec 9 01:47:02.682945440 (82h17m50.380513747s) [noise=true , address=185.167.204.205:4004 , piece_id=G5XMIF5JJFP5EWANE5DAHA6GCZ63V5MG7SK437JTRTEQG2K5FJ5A, seg_pos={0 0}, upload=72218]: Long tail cancellation due to optimal threshold Dec 9 01:47:02.683105520 (82h17m50.380673836s) [noise=true , address=81.171.14.70:4048 , piece_id=K3AYA6EC3YOX3PTL7QAIII2ZYZJQLHCI6P73O53ZEFBQMNYZUGJQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG): protocol: expected piece hash; context canceled; EOF Dec 9 01:47:02.683117823 (82h17m50.380686139s) [noise=true , address=81.171.14.70:4048 , piece_id=K3AYA6EC3YOX3PTL7QAIII2ZYZJQLHCI6P73O53ZEFBQMNYZUGJQ, seg_pos={0 0}, upload=72218]: Long tail cancellation due to optimal threshold Dec 9 01:47:02.683135676 (82h17m50.380703992s) [seg_pos={0 0}, upload=72218]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:47:02.683216667 (82h17m50.380784983s) [upload=72218]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:47:02.683221707 (82h17m50.380790023s) [upload=72218]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:47:02.837982582 (82h17m50.535550898s) [upload=72218]: Done uploading segments... Dec 9 01:47:02.837998332 (82h17m50.535566637s) [upload=72218]: Upload finished. err: <nil> Duration: 6.835777742s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 14 out of 60 is failed (threshold=3) [...X.....X.X.X...X...X..X.X..X......X..X.....X..........XX..] duration: 44.77358381s trace: https://jaeger.dev.storj.io/trace/62dd781a0b1ba679 FAIL (2025-12-09 01:49:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 01.147:4004 , piece_id=OCJIY6CWQK2RJI6VGGNU5LEGE2Z54OBOHEBETSOOIA6XA6RCCV6Q, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.493632881 (82h17m48.191201187s) [noise=true , address=89.149.201.147:4024 , piece_id=VVX6SZM7W6M2S2VHHDXOB5FFXIFU3VZUSQT3DM2Y5W36U5ZZZWKQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.494039881 (82h17m48.191608197s) [noise=true , address=81.171.14.70:4037 , piece_id=LPYVO6CAGXK2DKBALAKSGOANV33CXC6TKVH4JHNILNAEWJG3NAWQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.494374677 (82h17m48.191942993s) [noise=true , address=81.171.14.70:4047 , piece_id=PPADIK35752S6N6J73QMTPCL5ZOU4QMLMVNNCC5I2AEKWOARVQMA, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.495199778 (82h17m48.192768094s) [noise=true , address=81.171.14.70:4038 , piece_id=3IUASFH2HJFENWODDPQU2JD77RM63ASYVWP5UKUBOTBFWTJMMERQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.496159411 (82h17m48.193727717s) [noise=true , address=81.171.14.70:4045 , piece_id=3JQYWQLKWLVTK64XPLNPCAZZEZC5OG37EUYIO7TZKI5LGUO254XA, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.499456750 (82h17m48.197025055s) [noise=true , address=89.149.201.147:4002 , piece_id=KPXMZ5GGFPXNJ4TQ6JYS63BD5JSJLYL5IVPWUHNZCFYHWZ4EPHCQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.500529073 (82h17m48.198097378s) [noise=true , address=185.167.204.205:4026 , piece_id=Z462MSJBZDXLAUKTY4LDAQYORSHG73EYJ4ETGKGYZWIEBDBTQ4NQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.500918140 (82h17m48.198486456s) [noise=true , address=185.167.204.206:4046 , piece_id=4H7XDOT2QRX2SPBNNOL6EZB6NWGVBAQQ64OTNVFMJYX47K4R4W4Q, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.501235963 (82h17m48.198804279s) [noise=true , address=185.167.204.205:4032 , piece_id=UEBO56CSAMORAHRXBNUD6F2RSBNPWE2WAPTMAXUP7DTZ4BXANXHQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.501886809 (82h17m48.199455126s) [noise=true , address=81.171.14.70:4026 , piece_id=IDESMHDRGMALWFCYAJGK45EBXJBRE65YS6RDDOBX35QJFHYC2PMA, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.995932458 (82h17m48.693500774s) [upload=72218]: Next returned nil segment Dec 9 01:47:00.995944109 (82h17m48.693512416s) [upload=72218]: Waiting for error group managing segments... Dec 9 01:47:01.202665323 (82h17m48.900233639s) [noise=true , address=185.167.204.206:4044 , piece_id=TGGHW3I46HB3RNCSJAIT4YJRDVP5ZEDTDUG7L2GLQSOISX4IVCKA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.225967129 (82h17m48.923535445s) [noise=true , address=81.171.14.70:4036 , piece_id=Z74QD2RO5RFGPNIMBRRXMZIBCZJCINAUWVNKV56GIYXG7YRLBCIA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.227739570 (82h17m48.925307887s) [noise=true , address=81.171.14.70:4037 , piece_id=LPYVO6CAGXK2DKBALAKSGOANV33CXC6TKVH4JHNILNAEWJG3NAWQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.229673212 (82h17m48.927241529s) [noise=true , address=81.171.14.70:4045 , piece_id=3JQYWQLKWLVTK64XPLNPCAZZEZC5OG37EUYIO7TZKI5LGUO254XA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.231639726 (82h17m48.929208032s) [noise=true , address=185.167.204.206:4066 , piece_id=AIRJWETZWOE22EJ2DGMHLP6LPN6KCITOWVUQXBZ47RYCJQDSJMBA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.237470357 (82h17m48.935038673s) [noise=true , address=89.149.201.147:4004 , piece_id=OCJIY6CWQK2RJI6VGGNU5LEGE2Z54OBOHEBETSOOIA6XA6RCCV6Q, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.273184279 (82h17m48.970752595s) [noise=true , address=89.149.201.147:4024 , piece_id=VVX6SZM7W6M2S2VHHDXOB5FFXIFU3VZUSQT3DM2Y5W36U5ZZZWKQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.508726238 (82h17m49.206294574s) [noise=true , address=185.167.204.205:4003 , piece_id=2SN5T64LCCXX2TUW4UOXSBSI23TEZP3665NIAZ2DAOJIZKXZ67MA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.610559678 (82h17m49.308127994s) [noise=true , address=81.171.14.70:4041 , piece_id=3QEHVCZC2BIMFTNOLI4JSMDDRXNSNEYNG4NNRX6IRUPZVQ5O56AQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.615192150 (82h17m49.312760466s) [noise=true , address=89.149.201.147:4002 , piece_id=KPXMZ5GGFPXNJ4TQ6JYS63BD5JSJLYL5IVPWUHNZCFYHWZ4EPHCQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.619035289 (82h17m49.316603595s) [noise=true , address=89.149.201.147:4017 , piece_id=U4L67GWTCFAZ2R4YE7GFP3JAOO4AZLRVDW2DF3OYU7SEAQ43NJRA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.719169234 (82h17m49.41673755s) [noise=true , address=89.149.201.147:4010 , piece_id=WNBK7UIQ6HKCFL2EVEK4PD4KEF2NJJKZIAZZLZVIAW5QYDFQ6PCA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.720083040 (82h17m49.417651377s) [noise=true , address=185.167.204.206:4043 , piece_id=RBVEUBR6NUVX6S4WJFHHTXFLXQL7OK3TARGCEGIOA26N3WDCRZ6A, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.788662513 (82h17m49.486230859s) [noise=true , address=89.149.201.147:4016 , piece_id=OEGL5OZETOEFEWUBQLRBYKEETIGAFPCBRAXBB37FDQEONMNVCVOQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.792722657 (82h17m49.490290993s) [noise=true , address=185.167.204.205:4036 , piece_id=BXYGRN7SWWSHYQ6LLD7LRQ4PNCPEPLNIJRHBDG5MKEPJ7F5QQEWA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.836830187 (82h17m49.534398523s) [noise=true , address=81.171.14.70:4026 , piece_id=IDESMHDRGMALWFCYAJGK45EBXJBRE65YS6RDDOBX35QJFHYC2PMA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.838428573 (82h17m49.535996909s) [noise=true , address=89.149.201.147:4009 , piece_id=A6VZJPUUTCWLZLVCRDT63KL2NRTWJLEHTBCL7RHZG67UQD4ZLJ7Q, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.868943353 (82h17m49.566511689s) [noise=true , address=81.171.14.70:4043 , piece_id=ERJPTPLOON2EMPWBMZMXRRHFWY3KV6AQLCTAVR73TQ6K2SQGH4VA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.896454682 (82h17m49.594022998s) [noise=true , address=81.171.14.70:4047 , piece_id=PPADIK35752S6N6J73QMTPCL5ZOU4QMLMVNNCC5I2AEKWOARVQMA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.949977028 (82h17m49.647545334s) [noise=true , address=185.167.204.206:4046 , piece_id=4H7XDOT2QRX2SPBNNOL6EZB6NWGVBAQQ64OTNVFMJYX47K4R4W4Q, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.055403810 (82h17m49.752972126s) [noise=true , address=185.167.204.205:4032 , piece_id=UEBO56CSAMORAHRXBNUD6F2RSBNPWE2WAPTMAXUP7DTZ4BXANXHQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.066015913 (82h17m49.763584229s) [noise=true , address=81.171.14.70:4029 , piece_id=4H2N2KDVQ57EBQWBCNDNQT2H6A2T4MCLPJM3ULZLE6C244HIB3KQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.281258342 (82h17m49.978826648s) [noise=true , address=81.171.14.70:4028 , piece_id=HMFBTEBWJ3R64LYYEK7YM6TUZW42PMWMIYS3OG6NINGSCEBL3QMQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.345408540 (82h17m50.042976876s) [noise=true , address=81.171.14.70:4038 , piece_id=3IUASFH2HJFENWODDPQU2JD77RM63ASYVWP5UKUBOTBFWTJMMERQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.566764831 (82h17m50.264333137s) [noise=true , address=185.167.204.205:4011 , piece_id=4NQUAOEP6A2HMPDY7SKNYDCPV5IRDCMRD4NT3ZSB45EPNJJER72A, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.682771175 (82h17m50.380339491s) [noise=true , address=185.167.204.205:4026 , piece_id=Z462MSJBZDXLAUKTY4LDAQYORSHG73EYJ4ETGKGYZWIEBDBTQ4NQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.682787154 (82h17m50.380355461s) [seg_pos={0 0}, upload=72218]: Segment reached optimal threshold of 26 pieces. Dec 9 01:47:02.682939199 (82h17m50.380507515s) [noise=true , address=185.167.204.205:4004 , piece_id=G5XMIF5JJFP5EWANE5DAHA6GCZ63V5MG7SK437JTRTEQG2K5FJ5A, seg_pos={0 0}, upload=72218]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm): protocol: expected piece hash; context canceled; EOF Dec 9 01:47:02.682945440 (82h17m50.380513747s) [noise=true , address=185.167.204.205:4004 , piece_id=G5XMIF5JJFP5EWANE5DAHA6GCZ63V5MG7SK437JTRTEQG2K5FJ5A, seg_pos={0 0}, upload=72218]: Long tail cancellation due to optimal threshold Dec 9 01:47:02.683105520 (82h17m50.380673836s) [noise=true , address=81.171.14.70:4048 , piece_id=K3AYA6EC3YOX3PTL7QAIII2ZYZJQLHCI6P73O53ZEFBQMNYZUGJQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG): protocol: expected piece hash; context canceled; EOF Dec 9 01:47:02.683117823 (82h17m50.380686139s) [noise=true , address=81.171.14.70:4048 , piece_id=K3AYA6EC3YOX3PTL7QAIII2ZYZJQLHCI6P73O53ZEFBQMNYZUGJQ, seg_pos={0 0}, upload=72218]: Long tail cancellation due to optimal threshold Dec 9 01:47:02.683135676 (82h17m50.380703992s) [seg_pos={0 0}, upload=72218]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:47:02.683216667 (82h17m50.380784983s) [upload=72218]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:47:02.683221707 (82h17m50.380790023s) [upload=72218]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:47:02.837982582 (82h17m50.535550898s) [upload=72218]: Done uploading segments... Dec 9 01:47:02.837998332 (82h17m50.535566637s) [upload=72218]: Upload finished. err: <nil> Duration: 44.773629957s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 15 out of 60 is failed (threshold=3) [X...X.....X.X.X...X...X..X.X..X......X..X.....X..........XX.] duration: 4.710190279s trace: https://jaeger.dev.storj.io/trace/62dd781a0b1ba679 FAIL (2025-12-09 01:48:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 01.147:4004 , piece_id=OCJIY6CWQK2RJI6VGGNU5LEGE2Z54OBOHEBETSOOIA6XA6RCCV6Q, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.493632881 (82h17m48.191201187s) [noise=true , address=89.149.201.147:4024 , piece_id=VVX6SZM7W6M2S2VHHDXOB5FFXIFU3VZUSQT3DM2Y5W36U5ZZZWKQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.494039881 (82h17m48.191608197s) [noise=true , address=81.171.14.70:4037 , piece_id=LPYVO6CAGXK2DKBALAKSGOANV33CXC6TKVH4JHNILNAEWJG3NAWQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.494374677 (82h17m48.191942993s) [noise=true , address=81.171.14.70:4047 , piece_id=PPADIK35752S6N6J73QMTPCL5ZOU4QMLMVNNCC5I2AEKWOARVQMA, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.495199778 (82h17m48.192768094s) [noise=true , address=81.171.14.70:4038 , piece_id=3IUASFH2HJFENWODDPQU2JD77RM63ASYVWP5UKUBOTBFWTJMMERQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.496159411 (82h17m48.193727717s) [noise=true , address=81.171.14.70:4045 , piece_id=3JQYWQLKWLVTK64XPLNPCAZZEZC5OG37EUYIO7TZKI5LGUO254XA, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.499456750 (82h17m48.197025055s) [noise=true , address=89.149.201.147:4002 , piece_id=KPXMZ5GGFPXNJ4TQ6JYS63BD5JSJLYL5IVPWUHNZCFYHWZ4EPHCQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.500529073 (82h17m48.198097378s) [noise=true , address=185.167.204.205:4026 , piece_id=Z462MSJBZDXLAUKTY4LDAQYORSHG73EYJ4ETGKGYZWIEBDBTQ4NQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.500918140 (82h17m48.198486456s) [noise=true , address=185.167.204.206:4046 , piece_id=4H7XDOT2QRX2SPBNNOL6EZB6NWGVBAQQ64OTNVFMJYX47K4R4W4Q, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.501235963 (82h17m48.198804279s) [noise=true , address=185.167.204.205:4032 , piece_id=UEBO56CSAMORAHRXBNUD6F2RSBNPWE2WAPTMAXUP7DTZ4BXANXHQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.501886809 (82h17m48.199455126s) [noise=true , address=81.171.14.70:4026 , piece_id=IDESMHDRGMALWFCYAJGK45EBXJBRE65YS6RDDOBX35QJFHYC2PMA, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.995932458 (82h17m48.693500774s) [upload=72218]: Next returned nil segment Dec 9 01:47:00.995944109 (82h17m48.693512416s) [upload=72218]: Waiting for error group managing segments... Dec 9 01:47:01.202665323 (82h17m48.900233639s) [noise=true , address=185.167.204.206:4044 , piece_id=TGGHW3I46HB3RNCSJAIT4YJRDVP5ZEDTDUG7L2GLQSOISX4IVCKA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.225967129 (82h17m48.923535445s) [noise=true , address=81.171.14.70:4036 , piece_id=Z74QD2RO5RFGPNIMBRRXMZIBCZJCINAUWVNKV56GIYXG7YRLBCIA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.227739570 (82h17m48.925307887s) [noise=true , address=81.171.14.70:4037 , piece_id=LPYVO6CAGXK2DKBALAKSGOANV33CXC6TKVH4JHNILNAEWJG3NAWQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.229673212 (82h17m48.927241529s) [noise=true , address=81.171.14.70:4045 , piece_id=3JQYWQLKWLVTK64XPLNPCAZZEZC5OG37EUYIO7TZKI5LGUO254XA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.231639726 (82h17m48.929208032s) [noise=true , address=185.167.204.206:4066 , piece_id=AIRJWETZWOE22EJ2DGMHLP6LPN6KCITOWVUQXBZ47RYCJQDSJMBA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.237470357 (82h17m48.935038673s) [noise=true , address=89.149.201.147:4004 , piece_id=OCJIY6CWQK2RJI6VGGNU5LEGE2Z54OBOHEBETSOOIA6XA6RCCV6Q, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.273184279 (82h17m48.970752595s) [noise=true , address=89.149.201.147:4024 , piece_id=VVX6SZM7W6M2S2VHHDXOB5FFXIFU3VZUSQT3DM2Y5W36U5ZZZWKQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.508726238 (82h17m49.206294574s) [noise=true , address=185.167.204.205:4003 , piece_id=2SN5T64LCCXX2TUW4UOXSBSI23TEZP3665NIAZ2DAOJIZKXZ67MA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.610559678 (82h17m49.308127994s) [noise=true , address=81.171.14.70:4041 , piece_id=3QEHVCZC2BIMFTNOLI4JSMDDRXNSNEYNG4NNRX6IRUPZVQ5O56AQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.615192150 (82h17m49.312760466s) [noise=true , address=89.149.201.147:4002 , piece_id=KPXMZ5GGFPXNJ4TQ6JYS63BD5JSJLYL5IVPWUHNZCFYHWZ4EPHCQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.619035289 (82h17m49.316603595s) [noise=true , address=89.149.201.147:4017 , piece_id=U4L67GWTCFAZ2R4YE7GFP3JAOO4AZLRVDW2DF3OYU7SEAQ43NJRA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.719169234 (82h17m49.41673755s) [noise=true , address=89.149.201.147:4010 , piece_id=WNBK7UIQ6HKCFL2EVEK4PD4KEF2NJJKZIAZZLZVIAW5QYDFQ6PCA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.720083040 (82h17m49.417651377s) [noise=true , address=185.167.204.206:4043 , piece_id=RBVEUBR6NUVX6S4WJFHHTXFLXQL7OK3TARGCEGIOA26N3WDCRZ6A, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.788662513 (82h17m49.486230859s) [noise=true , address=89.149.201.147:4016 , piece_id=OEGL5OZETOEFEWUBQLRBYKEETIGAFPCBRAXBB37FDQEONMNVCVOQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.792722657 (82h17m49.490290993s) [noise=true , address=185.167.204.205:4036 , piece_id=BXYGRN7SWWSHYQ6LLD7LRQ4PNCPEPLNIJRHBDG5MKEPJ7F5QQEWA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.836830187 (82h17m49.534398523s) [noise=true , address=81.171.14.70:4026 , piece_id=IDESMHDRGMALWFCYAJGK45EBXJBRE65YS6RDDOBX35QJFHYC2PMA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.838428573 (82h17m49.535996909s) [noise=true , address=89.149.201.147:4009 , piece_id=A6VZJPUUTCWLZLVCRDT63KL2NRTWJLEHTBCL7RHZG67UQD4ZLJ7Q, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.868943353 (82h17m49.566511689s) [noise=true , address=81.171.14.70:4043 , piece_id=ERJPTPLOON2EMPWBMZMXRRHFWY3KV6AQLCTAVR73TQ6K2SQGH4VA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.896454682 (82h17m49.594022998s) [noise=true , address=81.171.14.70:4047 , piece_id=PPADIK35752S6N6J73QMTPCL5ZOU4QMLMVNNCC5I2AEKWOARVQMA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.949977028 (82h17m49.647545334s) [noise=true , address=185.167.204.206:4046 , piece_id=4H7XDOT2QRX2SPBNNOL6EZB6NWGVBAQQ64OTNVFMJYX47K4R4W4Q, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.055403810 (82h17m49.752972126s) [noise=true , address=185.167.204.205:4032 , piece_id=UEBO56CSAMORAHRXBNUD6F2RSBNPWE2WAPTMAXUP7DTZ4BXANXHQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.066015913 (82h17m49.763584229s) [noise=true , address=81.171.14.70:4029 , piece_id=4H2N2KDVQ57EBQWBCNDNQT2H6A2T4MCLPJM3ULZLE6C244HIB3KQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.281258342 (82h17m49.978826648s) [noise=true , address=81.171.14.70:4028 , piece_id=HMFBTEBWJ3R64LYYEK7YM6TUZW42PMWMIYS3OG6NINGSCEBL3QMQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.345408540 (82h17m50.042976876s) [noise=true , address=81.171.14.70:4038 , piece_id=3IUASFH2HJFENWODDPQU2JD77RM63ASYVWP5UKUBOTBFWTJMMERQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.566764831 (82h17m50.264333137s) [noise=true , address=185.167.204.205:4011 , piece_id=4NQUAOEP6A2HMPDY7SKNYDCPV5IRDCMRD4NT3ZSB45EPNJJER72A, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.682771175 (82h17m50.380339491s) [noise=true , address=185.167.204.205:4026 , piece_id=Z462MSJBZDXLAUKTY4LDAQYORSHG73EYJ4ETGKGYZWIEBDBTQ4NQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.682787154 (82h17m50.380355461s) [seg_pos={0 0}, upload=72218]: Segment reached optimal threshold of 26 pieces. Dec 9 01:47:02.682939199 (82h17m50.380507515s) [noise=true , address=185.167.204.205:4004 , piece_id=G5XMIF5JJFP5EWANE5DAHA6GCZ63V5MG7SK437JTRTEQG2K5FJ5A, seg_pos={0 0}, upload=72218]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm): protocol: expected piece hash; context canceled; EOF Dec 9 01:47:02.682945440 (82h17m50.380513747s) [noise=true , address=185.167.204.205:4004 , piece_id=G5XMIF5JJFP5EWANE5DAHA6GCZ63V5MG7SK437JTRTEQG2K5FJ5A, seg_pos={0 0}, upload=72218]: Long tail cancellation due to optimal threshold Dec 9 01:47:02.683105520 (82h17m50.380673836s) [noise=true , address=81.171.14.70:4048 , piece_id=K3AYA6EC3YOX3PTL7QAIII2ZYZJQLHCI6P73O53ZEFBQMNYZUGJQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG): protocol: expected piece hash; context canceled; EOF Dec 9 01:47:02.683117823 (82h17m50.380686139s) [noise=true , address=81.171.14.70:4048 , piece_id=K3AYA6EC3YOX3PTL7QAIII2ZYZJQLHCI6P73O53ZEFBQMNYZUGJQ, seg_pos={0 0}, upload=72218]: Long tail cancellation due to optimal threshold Dec 9 01:47:02.683135676 (82h17m50.380703992s) [seg_pos={0 0}, upload=72218]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:47:02.683216667 (82h17m50.380784983s) [upload=72218]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:47:02.683221707 (82h17m50.380790023s) [upload=72218]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:47:02.837982582 (82h17m50.535550898s) [upload=72218]: Done uploading segments... Dec 9 01:47:02.837998332 (82h17m50.535566637s) [upload=72218]: Upload finished. err: <nil> Duration: 4.710204647s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 15 out of 60 is failed (threshold=3) [.X...X.....X.X.X...X...X..X.X..X......X..X.....X..........XX] duration: 31.256776149s trace: https://jaeger.dev.storj.io/trace/62dd781a0b1ba679 FAIL (2025-12-09 01:47:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 01.147:4004 , piece_id=OCJIY6CWQK2RJI6VGGNU5LEGE2Z54OBOHEBETSOOIA6XA6RCCV6Q, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.493632881 (82h17m48.191201187s) [noise=true , address=89.149.201.147:4024 , piece_id=VVX6SZM7W6M2S2VHHDXOB5FFXIFU3VZUSQT3DM2Y5W36U5ZZZWKQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.494039881 (82h17m48.191608197s) [noise=true , address=81.171.14.70:4037 , piece_id=LPYVO6CAGXK2DKBALAKSGOANV33CXC6TKVH4JHNILNAEWJG3NAWQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.494374677 (82h17m48.191942993s) [noise=true , address=81.171.14.70:4047 , piece_id=PPADIK35752S6N6J73QMTPCL5ZOU4QMLMVNNCC5I2AEKWOARVQMA, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.495199778 (82h17m48.192768094s) [noise=true , address=81.171.14.70:4038 , piece_id=3IUASFH2HJFENWODDPQU2JD77RM63ASYVWP5UKUBOTBFWTJMMERQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.496159411 (82h17m48.193727717s) [noise=true , address=81.171.14.70:4045 , piece_id=3JQYWQLKWLVTK64XPLNPCAZZEZC5OG37EUYIO7TZKI5LGUO254XA, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.499456750 (82h17m48.197025055s) [noise=true , address=89.149.201.147:4002 , piece_id=KPXMZ5GGFPXNJ4TQ6JYS63BD5JSJLYL5IVPWUHNZCFYHWZ4EPHCQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.500529073 (82h17m48.198097378s) [noise=true , address=185.167.204.205:4026 , piece_id=Z462MSJBZDXLAUKTY4LDAQYORSHG73EYJ4ETGKGYZWIEBDBTQ4NQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.500918140 (82h17m48.198486456s) [noise=true , address=185.167.204.206:4046 , piece_id=4H7XDOT2QRX2SPBNNOL6EZB6NWGVBAQQ64OTNVFMJYX47K4R4W4Q, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.501235963 (82h17m48.198804279s) [noise=true , address=185.167.204.205:4032 , piece_id=UEBO56CSAMORAHRXBNUD6F2RSBNPWE2WAPTMAXUP7DTZ4BXANXHQ, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.501886809 (82h17m48.199455126s) [noise=true , address=81.171.14.70:4026 , piece_id=IDESMHDRGMALWFCYAJGK45EBXJBRE65YS6RDDOBX35QJFHYC2PMA, seg_pos={0 0}, upload=72218]: Uploading piece... Dec 9 01:47:00.995932458 (82h17m48.693500774s) [upload=72218]: Next returned nil segment Dec 9 01:47:00.995944109 (82h17m48.693512416s) [upload=72218]: Waiting for error group managing segments... Dec 9 01:47:01.202665323 (82h17m48.900233639s) [noise=true , address=185.167.204.206:4044 , piece_id=TGGHW3I46HB3RNCSJAIT4YJRDVP5ZEDTDUG7L2GLQSOISX4IVCKA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.225967129 (82h17m48.923535445s) [noise=true , address=81.171.14.70:4036 , piece_id=Z74QD2RO5RFGPNIMBRRXMZIBCZJCINAUWVNKV56GIYXG7YRLBCIA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.227739570 (82h17m48.925307887s) [noise=true , address=81.171.14.70:4037 , piece_id=LPYVO6CAGXK2DKBALAKSGOANV33CXC6TKVH4JHNILNAEWJG3NAWQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.229673212 (82h17m48.927241529s) [noise=true , address=81.171.14.70:4045 , piece_id=3JQYWQLKWLVTK64XPLNPCAZZEZC5OG37EUYIO7TZKI5LGUO254XA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.231639726 (82h17m48.929208032s) [noise=true , address=185.167.204.206:4066 , piece_id=AIRJWETZWOE22EJ2DGMHLP6LPN6KCITOWVUQXBZ47RYCJQDSJMBA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.237470357 (82h17m48.935038673s) [noise=true , address=89.149.201.147:4004 , piece_id=OCJIY6CWQK2RJI6VGGNU5LEGE2Z54OBOHEBETSOOIA6XA6RCCV6Q, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.273184279 (82h17m48.970752595s) [noise=true , address=89.149.201.147:4024 , piece_id=VVX6SZM7W6M2S2VHHDXOB5FFXIFU3VZUSQT3DM2Y5W36U5ZZZWKQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.508726238 (82h17m49.206294574s) [noise=true , address=185.167.204.205:4003 , piece_id=2SN5T64LCCXX2TUW4UOXSBSI23TEZP3665NIAZ2DAOJIZKXZ67MA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.610559678 (82h17m49.308127994s) [noise=true , address=81.171.14.70:4041 , piece_id=3QEHVCZC2BIMFTNOLI4JSMDDRXNSNEYNG4NNRX6IRUPZVQ5O56AQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.615192150 (82h17m49.312760466s) [noise=true , address=89.149.201.147:4002 , piece_id=KPXMZ5GGFPXNJ4TQ6JYS63BD5JSJLYL5IVPWUHNZCFYHWZ4EPHCQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.619035289 (82h17m49.316603595s) [noise=true , address=89.149.201.147:4017 , piece_id=U4L67GWTCFAZ2R4YE7GFP3JAOO4AZLRVDW2DF3OYU7SEAQ43NJRA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.719169234 (82h17m49.41673755s) [noise=true , address=89.149.201.147:4010 , piece_id=WNBK7UIQ6HKCFL2EVEK4PD4KEF2NJJKZIAZZLZVIAW5QYDFQ6PCA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.720083040 (82h17m49.417651377s) [noise=true , address=185.167.204.206:4043 , piece_id=RBVEUBR6NUVX6S4WJFHHTXFLXQL7OK3TARGCEGIOA26N3WDCRZ6A, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.788662513 (82h17m49.486230859s) [noise=true , address=89.149.201.147:4016 , piece_id=OEGL5OZETOEFEWUBQLRBYKEETIGAFPCBRAXBB37FDQEONMNVCVOQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.792722657 (82h17m49.490290993s) [noise=true , address=185.167.204.205:4036 , piece_id=BXYGRN7SWWSHYQ6LLD7LRQ4PNCPEPLNIJRHBDG5MKEPJ7F5QQEWA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.836830187 (82h17m49.534398523s) [noise=true , address=81.171.14.70:4026 , piece_id=IDESMHDRGMALWFCYAJGK45EBXJBRE65YS6RDDOBX35QJFHYC2PMA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.838428573 (82h17m49.535996909s) [noise=true , address=89.149.201.147:4009 , piece_id=A6VZJPUUTCWLZLVCRDT63KL2NRTWJLEHTBCL7RHZG67UQD4ZLJ7Q, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.868943353 (82h17m49.566511689s) [noise=true , address=81.171.14.70:4043 , piece_id=ERJPTPLOON2EMPWBMZMXRRHFWY3KV6AQLCTAVR73TQ6K2SQGH4VA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.896454682 (82h17m49.594022998s) [noise=true , address=81.171.14.70:4047 , piece_id=PPADIK35752S6N6J73QMTPCL5ZOU4QMLMVNNCC5I2AEKWOARVQMA, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:01.949977028 (82h17m49.647545334s) [noise=true , address=185.167.204.206:4046 , piece_id=4H7XDOT2QRX2SPBNNOL6EZB6NWGVBAQQ64OTNVFMJYX47K4R4W4Q, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.055403810 (82h17m49.752972126s) [noise=true , address=185.167.204.205:4032 , piece_id=UEBO56CSAMORAHRXBNUD6F2RSBNPWE2WAPTMAXUP7DTZ4BXANXHQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.066015913 (82h17m49.763584229s) [noise=true , address=81.171.14.70:4029 , piece_id=4H2N2KDVQ57EBQWBCNDNQT2H6A2T4MCLPJM3ULZLE6C244HIB3KQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.281258342 (82h17m49.978826648s) [noise=true , address=81.171.14.70:4028 , piece_id=HMFBTEBWJ3R64LYYEK7YM6TUZW42PMWMIYS3OG6NINGSCEBL3QMQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.345408540 (82h17m50.042976876s) [noise=true , address=81.171.14.70:4038 , piece_id=3IUASFH2HJFENWODDPQU2JD77RM63ASYVWP5UKUBOTBFWTJMMERQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.566764831 (82h17m50.264333137s) [noise=true , address=185.167.204.205:4011 , piece_id=4NQUAOEP6A2HMPDY7SKNYDCPV5IRDCMRD4NT3ZSB45EPNJJER72A, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.682771175 (82h17m50.380339491s) [noise=true , address=185.167.204.205:4026 , piece_id=Z462MSJBZDXLAUKTY4LDAQYORSHG73EYJ4ETGKGYZWIEBDBTQ4NQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: <nil> Dec 9 01:47:02.682787154 (82h17m50.380355461s) [seg_pos={0 0}, upload=72218]: Segment reached optimal threshold of 26 pieces. Dec 9 01:47:02.682939199 (82h17m50.380507515s) [noise=true , address=185.167.204.205:4004 , piece_id=G5XMIF5JJFP5EWANE5DAHA6GCZ63V5MG7SK437JTRTEQG2K5FJ5A, seg_pos={0 0}, upload=72218]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm): protocol: expected piece hash; context canceled; EOF Dec 9 01:47:02.682945440 (82h17m50.380513747s) [noise=true , address=185.167.204.205:4004 , piece_id=G5XMIF5JJFP5EWANE5DAHA6GCZ63V5MG7SK437JTRTEQG2K5FJ5A, seg_pos={0 0}, upload=72218]: Long tail cancellation due to optimal threshold Dec 9 01:47:02.683105520 (82h17m50.380673836s) [noise=true , address=81.171.14.70:4048 , piece_id=K3AYA6EC3YOX3PTL7QAIII2ZYZJQLHCI6P73O53ZEFBQMNYZUGJQ, seg_pos={0 0}, upload=72218]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG): protocol: expected piece hash; context canceled; EOF Dec 9 01:47:02.683117823 (82h17m50.380686139s) [noise=true , address=81.171.14.70:4048 , piece_id=K3AYA6EC3YOX3PTL7QAIII2ZYZJQLHCI6P73O53ZEFBQMNYZUGJQ, seg_pos={0 0}, upload=72218]: Long tail cancellation due to optimal threshold Dec 9 01:47:02.683135676 (82h17m50.380703992s) [seg_pos={0 0}, upload=72218]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:47:02.683216667 (82h17m50.380784983s) [upload=72218]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:47:02.683221707 (82h17m50.380790023s) [upload=72218]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:47:02.837982582 (82h17m50.535550898s) [upload=72218]: Done uploading segments... Dec 9 01:47:02.837998332 (82h17m50.535566637s) [upload=72218]: Upload finished. err: <nil> Duration: 31.256815234s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 14 out of 60 is failed (threshold=3) [..X...X.....X.X.X...X...X..X.X..X......X..X.....X..........X] duration: 34.121670946s trace: https://jaeger.dev.storj.io/trace/5305d4adb146c3b9 FAIL (2025-12-09 01:46:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== ress=81.171.14.70:4034 , piece_id=KZ3PZYREXTXAEGS36XRF74MECIVJYQFY7KIMU7CJ3NLOCNZQMCWQ, seg_pos={0 0}, upload=72202]: Uploading piece... Dec 9 01:45:59.333978817 (82h16m47.031547152s) [noise=true , address=185.167.204.206:4061 , piece_id=RFDO5HMM4OTYRS52JNO2BKRPXMS3KILRZI5LKCG3KXCWURXCR2VQ, seg_pos={0 0}, upload=72202]: Uploading piece... Dec 9 01:45:59.334161568 (82h16m47.031729915s) [noise=true , address=81.171.14.70:4043 , piece_id=Q5LCFJ5NXMWP77ELFZXMME754OQNDYGZYFF6UPQLHOJYNPL4MVMA, seg_pos={0 0}, upload=72202]: Uploading piece... Dec 9 01:45:59.334683673 (82h16m47.03225201s) [noise=true , address=185.167.204.205:4012 , piece_id=EBEBVLVU726RKYHP4GVTIIABMRKN3HK75EHLX3SKT6FMYCGFMSKQ, seg_pos={0 0}, upload=72202]: Uploading piece... Dec 9 01:45:59.334896421 (82h16m47.032464758s) [noise=true , address=81.171.14.70:4044 , piece_id=LJHV5LBEF7X4F75ZQ3ILA7GMKFQWTIITGSVFPBAFRICE2O6TAJ4A, seg_pos={0 0}, upload=72202]: Uploading piece... Dec 9 01:45:59.335401484 (82h16m47.032969821s) [noise=true , address=185.167.204.206:4063 , piece_id=NGLEMPSUASDHUJECO45INAFPYGUOEZDMUQKA4UI54IP6ZP6GIL7Q, seg_pos={0 0}, upload=72202]: Uploading piece... Dec 9 01:45:59.336011153 (82h16m47.03357949s) [noise=true , address=89.149.201.147:4013 , piece_id=ANCSJOXK5R5HQZPNGOT2HWZ3BXUAKPWTS2CHXBJ3GPYC6KDDPGXQ, seg_pos={0 0}, upload=72202]: Uploading piece... Dec 9 01:45:59.336567142 (82h16m47.034135478s) [noise=true , address=89.149.201.147:4012 , piece_id=K5V33JOZCGBSLNONKK2KRJJBBOEJECBQIOTXPEN6TM7MUP4ODW4Q, seg_pos={0 0}, upload=72202]: Uploading piece... Dec 9 01:45:59.337184264 (82h16m47.0347526s) [noise=true , address=185.167.204.205:4018 , piece_id=IGF54GLALEX6PDT6EIOKDOGH3RFCFR4FOMU5QKGUP7J3CSGEKZJA, seg_pos={0 0}, upload=72202]: Uploading piece... Dec 9 01:45:59.337756002 (82h16m47.035324348s) [noise=true , address=81.171.14.70:4048 , piece_id=36ELRSNM3W4EWSUV3FZIMRXFM7KQS6UYA36PMBRGOBN2VT2OI5RA, seg_pos={0 0}, upload=72202]: Uploading piece... Dec 9 01:45:59.338319034 (82h16m47.03588737s) [noise=true , address=185.167.204.205:4029 , piece_id=JDH6O6DGXOO2LRSKNYMAGOG736S3QTEUOUY2RJFVQXQH3J73ZJ3Q, seg_pos={0 0}, upload=72202]: Uploading piece... Dec 9 01:45:59.839758866 (82h16m47.537327172s) [upload=72202]: Next returned nil segment Dec 9 01:45:59.839766400 (82h16m47.537334706s) [upload=72202]: Waiting for error group managing segments... Dec 9 01:46:00.046234249 (82h16m47.743802586s) [noise=true , address=185.167.204.205:4036 , piece_id=BIINGSCE44H7LWZ7I5X3AGEJRCNAQXWKHDVPKAH524ZYEMMD23QA, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:00.046336241 (82h16m47.743904577s) [noise=true , address=185.167.204.205:4012 , piece_id=EBEBVLVU726RKYHP4GVTIIABMRKN3HK75EHLX3SKT6FMYCGFMSKQ, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:00.058560474 (82h16m47.756128811s) [noise=true , address=89.149.201.147:4013 , piece_id=ANCSJOXK5R5HQZPNGOT2HWZ3BXUAKPWTS2CHXBJ3GPYC6KDDPGXQ, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:00.065975596 (82h16m47.763543932s) [noise=true , address=185.167.204.206:4063 , piece_id=NGLEMPSUASDHUJECO45INAFPYGUOEZDMUQKA4UI54IP6ZP6GIL7Q, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:00.071816456 (82h16m47.769384792s) [noise=true , address=185.167.204.206:4061 , piece_id=RFDO5HMM4OTYRS52JNO2BKRPXMS3KILRZI5LKCG3KXCWURXCR2VQ, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:00.072118852 (82h16m47.769687197s) [noise=true , address=185.167.204.205:4029 , piece_id=JDH6O6DGXOO2LRSKNYMAGOG736S3QTEUOUY2RJFVQXQH3J73ZJ3Q, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:00.076285023 (82h16m47.77385336s) [noise=true , address=89.149.201.147:4005 , piece_id=MNDDVQUPXLBJS6LD47WU5TI7PJDCPXFDMG47HGQPQZYS6X2TX2NQ, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:00.081115285 (82h16m47.778683622s) [noise=true , address=81.171.14.70:4043 , piece_id=Q5LCFJ5NXMWP77ELFZXMME754OQNDYGZYFF6UPQLHOJYNPL4MVMA, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:00.114712233 (82h16m47.812280549s) [noise=true , address=81.171.14.70:4048 , piece_id=36ELRSNM3W4EWSUV3FZIMRXFM7KQS6UYA36PMBRGOBN2VT2OI5RA, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:00.151419129 (82h16m47.848987445s) [noise=true , address=81.171.14.70:4026 , piece_id=JYDKDELN3ZZ76DHLIARHOZ6E3SFDPYXJVNPTNZ6BZLZGI4BB45UQ, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:00.152459623 (82h16m47.85002796s) [noise=true , address=81.171.14.70:4045 , piece_id=X5EUXNZOASJ5RA4MROBFJAUIMGHCPQYV53236YBXW5Q64K2QCBYA, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:00.331408430 (82h16m48.028976736s) [noise=true , address=89.149.201.147:4012 , piece_id=K5V33JOZCGBSLNONKK2KRJJBBOEJECBQIOTXPEN6TM7MUP4ODW4Q, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:00.344377264 (82h16m48.041945571s) [noise=true , address=81.171.14.70:4033 , piece_id=NNWDXMVR7VDADGCD2SRVL4XN2TW5665WP2BXKPMWFFTG6V4X4O3A, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:00.456896315 (82h16m48.15446462s) [noise=true , address=81.171.14.70:4038 , piece_id=AQNU6OTIZAZCTQJR47PDSMCQP57EARHNHMAAFVW5P5ZF6O2XV4AQ, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:00.491983154 (82h16m48.18955146s) [noise=true , address=89.149.201.147:4006 , piece_id=BKG7QBMTDR4HW3IVVLRJ4ZUAGQZJNJETQB2N3RQKR7VNP3SOIJPA, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:00.494301284 (82h16m48.1918696s) [noise=true , address=81.171.14.70:4044 , piece_id=LJHV5LBEF7X4F75ZQ3ILA7GMKFQWTIITGSVFPBAFRICE2O6TAJ4A, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:00.517132701 (82h16m48.214701007s) [noise=true , address=89.149.201.147:4004 , piece_id=WM3UCICYCL63U2GTPAHJPCVBFPZJAG6XWYF4GANTG4BBUJSP3CCQ, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:00.552448349 (82h16m48.250016655s) [noise=true , address=81.171.14.70:4039 , piece_id=LRYJ46H36O7MPICIJL2ZCFP6AEKACOC3BZP56W5MTBKCBXYA7KGA, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:00.649979242 (82h16m48.347547558s) [noise=true , address=89.149.201.147:4021 , piece_id=FEE7ZSTN5EIWM3DZGA6GJVV4O6YBYSMTD5HGY2BJB72WZDDPNCQA, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:00.701287533 (82h16m48.398855839s) [noise=true , address=185.167.204.205:4027 , piece_id=O4I2HDWEGTMRZHBS62GDDWZTTTAKLD6BBVCDCLLOV4M4XUBLIYPQ, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:00.745627147 (82h16m48.443195463s) [noise=true , address=185.167.204.206:4065 , piece_id=XMYNB2XAKOWF3O4XBVPGRUQUWAI2E2GH3DN3GBRLYR7CXCC7HETQ, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:00.822542250 (82h16m48.520110556s) [noise=true , address=81.171.14.70:4047 , piece_id=7AGZIGF7D2XUAKXWFTGORZGQ2SSDDXZDLIC7BGWNSHPX4A43QFZA, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:00.825938153 (82h16m48.52350647s) [noise=true , address=185.167.204.206:4038 , piece_id=HWYHBUR5OUJP3XYXBTMOADKRFFZ6JPBJMJAFQDKJRYF2BFMFGZ3Q, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:01.028538640 (82h16m48.726106946s) [noise=true , address=81.171.14.70:4037 , piece_id=PF2BCWWT7NR5LRMFCNPTQ6NMMWXAE5AUWX32ZHMI2X7N2WILITHQ, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:01.213158219 (82h16m48.910726554s) [noise=true , address=89.149.201.147:4015 , piece_id=UVWS4AWTN4FDZG5KZV2BPHT6SXRLWH5AHESOMNATZQK4MD6NOYAQ, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:01.418375603 (82h16m49.115943909s) [noise=true , address=89.149.201.147:4018 , piece_id=FLHGJUPGIFRZRS6PQWKJESQYG7RT3KZB5ZWMADXJKXH2BDX7O7ZQ, seg_pos={0 0}, upload=72202]: Done uploading piece. err: <nil> Dec 9 01:46:01.418393997 (82h16m49.115962313s) [seg_pos={0 0}, upload=72202]: Segment reached optimal threshold of 26 pieces. Dec 9 01:46:01.418546763 (82h16m49.116115069s) [noise=true , address=81.171.14.70:4034 , piece_id=KZ3PZYREXTXAEGS36XRF74MECIVJYQFY7KIMU7CJ3NLOCNZQMCWQ, seg_pos={0 0}, upload=72202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN): protocol: expected piece hash; context canceled; EOF Dec 9 01:46:01.418553155 (82h16m49.116121461s) [noise=true , address=81.171.14.70:4034 , piece_id=KZ3PZYREXTXAEGS36XRF74MECIVJYQFY7KIMU7CJ3NLOCNZQMCWQ, seg_pos={0 0}, upload=72202]: Long tail cancellation due to optimal threshold Dec 9 01:46:01.418705269 (82h16m49.116273585s) [noise=true , address=185.167.204.205:4018 , piece_id=IGF54GLALEX6PDT6EIOKDOGH3RFCFR4FOMU5QKGUP7J3CSGEKZJA, seg_pos={0 0}, upload=72202]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS): protocol: expected piece hash; context canceled; EOF Dec 9 01:46:01.418710950 (82h16m49.116279256s) [noise=true , address=185.167.204.205:4018 , piece_id=IGF54GLALEX6PDT6EIOKDOGH3RFCFR4FOMU5QKGUP7J3CSGEKZJA, seg_pos={0 0}, upload=72202]: Long tail cancellation due to optimal threshold Dec 9 01:46:01.418725145 (82h16m49.116293461s) [seg_pos={0 0}, upload=72202]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:46:01.418783124 (82h16m49.11635143s) [upload=72202]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:46:01.418786591 (82h16m49.116354907s) [upload=72202]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:46:01.581756679 (82h16m49.279325006s) [upload=72202]: Done uploading segments... Dec 9 01:46:01.581775113 (82h16m49.27934343s) [upload=72202]: Upload finished. err: <nil> Duration: 34.12172632s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 13 out of 60 is failed (threshold=3) [...X...X.....X.X.X...X...X..X.X..X......X..X.....X..........] duration: 7.611263464s trace: https://jaeger.dev.storj.io/trace/7c6bdd8bee4bfc0e FAIL (2025-12-09 01:45:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 733831955 (82h9m45.431400291s) [noise=true , address=81.171.14.70:4033 , piece_id=JRVTZECOZWQGJJHTASK2G3BODS4AZ2XVE45YYXT2GPCMWFHSICCA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.734987704 (82h9m45.43255604s) [noise=true , address=185.167.204.205:4036 , piece_id=GQOYZKTDS3K3XGEOOINJTN767EQXG23JOFYF226DJYEJNETDJ2BQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.736018750 (82h9m45.433587077s) [noise=true , address=81.171.14.70:4028 , piece_id=SM75T7PBZ54GWI35ANTK343OL5B6VOVAIL77NPTKPMJO342JFHVA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.738080051 (82h9m45.435648377s) [noise=true , address=185.167.204.206:4047 , piece_id=NW47TPJDWAKL676HMJYU324HO75EEOIHMOPMS5PQYLEKYOMBWZUA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.740009845 (82h9m45.437578181s) [noise=true , address=185.167.204.205:4033 , piece_id=IPKHWYQBK33AEFC3UVAYGTS2VD3YY27P3NRZNWD7E2KGCECB3ERQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.740258349 (82h9m45.437826685s) [noise=true , address=89.149.201.147:4005 , piece_id=N5SDW7MVGXA27OYRAT6PRV3QZ7EGRAQWM56BIH6ELSUHJMG4VMUQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.741865852 (82h9m45.439434188s) [noise=true , address=185.167.204.205:4010 , piece_id=V54JRAIPTAHE5MCGQUNSBJUJ5TK5EXOJC2GC4AIHPXUYUMLGE2ZQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.742709749 (82h9m45.440278084s) [noise=true , address=185.167.204.205:4023 , piece_id=UPFQ4BTO3RXW2S2EPN5DCDAKX2FKVXT3GU5PN4C3CW43WFWRHUPQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.744997753 (82h9m45.442566079s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.746659848 (82h9m45.444228164s) [noise=true , address=81.171.14.70:4035 , piece_id=OWBJGEQGTSCR3FYNAOG424BCWICLOH6SUWPXOE7HHA454ZGM5JBA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.748622674 (82h9m45.446191s) [noise=true , address=89.149.201.147:4021 , piece_id=XVSL373IQK3EJ5ROTEA4ATRFTFS7YRRVUEHHN4V76MGSI32AC2EQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:58.224081322 (82h9m45.921649628s) [upload=72097]: Next returned nil segment Dec 9 01:38:58.224089837 (82h9m45.921658144s) [upload=72097]: Waiting for error group managing segments... Dec 9 01:38:58.431307515 (82h9m46.128875821s) [noise=true , address=89.149.201.147:4005 , piece_id=N5SDW7MVGXA27OYRAT6PRV3QZ7EGRAQWM56BIH6ELSUHJMG4VMUQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.431749651 (82h9m46.129317997s) [noise=true , address=81.171.14.70:4037 , piece_id=K2IE5MXBWGN5LIDT5EBAB42REHN7H4IIGA34NZWNYZXKQGEEMGRQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.490273164 (82h9m46.1878415s) [noise=true , address=89.149.201.147:4014 , piece_id=RMGYDI27Y4M7Z7VV5PTCP5TGCFYQVRFXRKDSKHN7J6HDQP5W3GFA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.502770258 (82h9m46.200338564s) [noise=true , address=89.149.201.147:4020 , piece_id=5LEKKWXSJDXKUYRK7XXK2NIAYEYD36VNCFKTQGJQWGNUKHWBQ7WQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.778274576 (82h9m46.475842912s) [noise=true , address=81.171.14.70:4029 , piece_id=QCPC46W4FFKFED4YRW7D2FPO3XZ4PTE4JWGLOZDDM6TGSXIJLKLA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.834300524 (82h9m46.53186887s) [noise=true , address=185.167.204.206:4056 , piece_id=UY6RJOJYQIMOXSJA6IF52U73TR3EXMXWA6NMZQPJZHT4KOK5ECCQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.904869168 (82h9m46.602437484s) [noise=true , address=81.171.14.70:4045 , piece_id=5MCTULWWE4YX7MIRQK4J6FTJDGW5XLPNPUZDQ2CBRC7MD4MV7AJQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.913844133 (82h9m46.61141248s) [noise=true , address=89.149.201.147:4021 , piece_id=XVSL373IQK3EJ5ROTEA4ATRFTFS7YRRVUEHHN4V76MGSI32AC2EQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.919030171 (82h9m46.616598477s) [noise=true , address=185.167.204.205:4036 , piece_id=GQOYZKTDS3K3XGEOOINJTN767EQXG23JOFYF226DJYEJNETDJ2BQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.932451492 (82h9m46.630019828s) [noise=true , address=185.167.204.205:4010 , piece_id=V54JRAIPTAHE5MCGQUNSBJUJ5TK5EXOJC2GC4AIHPXUYUMLGE2ZQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.943222923 (82h9m46.640791229s) [noise=true , address=89.149.201.147:4009 , piece_id=6UNPJCAZ5WYFTLWCRZU2FAPN4DVBV57ZP7KYXW26NMG2TSSVRUDA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.960077819 (82h9m46.657646155s) [noise=true , address=81.171.14.70:4032 , piece_id=SEPKDP35H3TQKSSXXKJKYL4ORU4TESWYCGLHPSGFHBBWW76WP5MA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.032398786 (82h9m46.729967102s) [noise=true , address=81.171.14.70:4028 , piece_id=SM75T7PBZ54GWI35ANTK343OL5B6VOVAIL77NPTKPMJO342JFHVA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.057203271 (82h9m46.754771587s) [noise=true , address=185.167.204.205:4023 , piece_id=UPFQ4BTO3RXW2S2EPN5DCDAKX2FKVXT3GU5PN4C3CW43WFWRHUPQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.081058494 (82h9m46.77862682s) [noise=true , address=185.167.204.206:4055 , piece_id=TK6CZLA3NXDZX5RLSK4H3GGEPNXZ2GDZ2CGI2OZ7B4TPP6AR7DHA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.112142418 (82h9m46.809710755s) [noise=true , address=185.167.204.205:4018 , piece_id=SNDUUOXX7WBTLKDHPB65A4WTFJ7PC6XRHPRENQ6KMOIPM4E5MSKA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.531727623 (82h9m47.229295959s) [noise=true , address=185.167.204.205:4012 , piece_id=4V2U6G2XVPFRZOEGLMVY6JNZFZ3BZ3QBIQWL47TXB3YK4DJIJ34A, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.534328111 (82h9m47.231896438s) [noise=true , address=89.149.201.147:4017 , piece_id=KA54SKQCIIIQSGHLZBBR7EWVKD5QJHX756BKLRXMPDJ6WDJR5YBQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.719679832 (82h9m47.417248168s) [noise=true , address=81.171.14.70:4035 , piece_id=OWBJGEQGTSCR3FYNAOG424BCWICLOH6SUWPXOE7HHA454ZGM5JBA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.724123352 (82h9m47.421691688s) [noise=true , address=89.149.201.147:4018 , piece_id=NHYZ3WXHU4QMPG37K4I3BH5K22GCY7WDUGXL7O4PEB225KKEC6HQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.786813169 (82h9m47.484381505s) [noise=true , address=81.171.14.70:4038 , piece_id=CCN4X2R6HMAC5IFPL5POH66QHXRZWHASDYWE2KEVVO64BIGD4OBA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.828658967 (82h9m47.526227304s) [noise=true , address=81.171.14.70:4033 , piece_id=JRVTZECOZWQGJJHTASK2G3BODS4AZ2XVE45YYXT2GPCMWFHSICCA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.250467174 (82h9m47.94803549s) [noise=true , address=185.167.204.205:4033 , piece_id=IPKHWYQBK33AEFC3UVAYGTS2VD3YY27P3NRZNWD7E2KGCECB3ERQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.328214947 (82h9m48.025783253s) [noise=true , address=81.171.14.70:4047 , piece_id=K66YL34O4IFTJV3RBEXZDERYJTAGAPXCNODECGD23QQNOAXVBM5A, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.360647713 (82h9m48.058216029s) [noise=true , address=185.167.204.206:4069 , piece_id=H6SQBPSIZ25KBJMBNIMDPZCXHEH7JQVXXGZQIDM2NUZDYRYO5QUA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.775238387 (82h9m48.472806723s) [noise=true , address=185.167.204.206:4047 , piece_id=NW47TPJDWAKL676HMJYU324HO75EEOIHMOPMS5PQYLEKYOMBWZUA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.775263474 (82h9m48.47283182s) [seg_pos={0 0}, upload=72097]: Segment reached optimal threshold of 26 pieces. Dec 9 01:39:00.775563294 (82h9m48.47313163s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61): protocol: expected piece hash; context canceled; EOF Dec 9 01:39:00.775653142 (82h9m48.473221478s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Long tail cancellation due to optimal threshold Dec 9 01:39:00.775734835 (82h9m48.473303141s) [noise=true , address=81.171.14.70:4039 , piece_id=74L4VSJSG47MCVTLP3CAU4PRQS5OSPKKTCNADR4T7HYJIOLTUQYQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 9 01:39:00.775749791 (82h9m48.473318108s) [noise=true , address=81.171.14.70:4039 , piece_id=74L4VSJSG47MCVTLP3CAU4PRQS5OSPKKTCNADR4T7HYJIOLTUQYQ, seg_pos={0 0}, upload=72097]: Long tail cancellation due to optimal threshold Dec 9 01:39:00.775771663 (82h9m48.473339969s) [seg_pos={0 0}, upload=72097]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:39:00.775860019 (82h9m48.473428335s) [upload=72097]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:39:00.775864196 (82h9m48.473432502s) [upload=72097]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:39:00.924498628 (82h9m48.622066934s) [upload=72097]: Done uploading segments... Dec 9 01:39:00.924511733 (82h9m48.622080038s) [upload=72097]: Upload finished. err: <nil> Duration: 7.611275817s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 13 out of 60 is failed (threshold=3) [....X...X.....X.X.X...X...X..X.X..X......X..X.....X.........] duration: 17.705477616s trace: https://jaeger.dev.storj.io/trace/7c6bdd8bee4bfc0e FAIL (2025-12-09 01:44:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 733831955 (82h9m45.431400291s) [noise=true , address=81.171.14.70:4033 , piece_id=JRVTZECOZWQGJJHTASK2G3BODS4AZ2XVE45YYXT2GPCMWFHSICCA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.734987704 (82h9m45.43255604s) [noise=true , address=185.167.204.205:4036 , piece_id=GQOYZKTDS3K3XGEOOINJTN767EQXG23JOFYF226DJYEJNETDJ2BQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.736018750 (82h9m45.433587077s) [noise=true , address=81.171.14.70:4028 , piece_id=SM75T7PBZ54GWI35ANTK343OL5B6VOVAIL77NPTKPMJO342JFHVA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.738080051 (82h9m45.435648377s) [noise=true , address=185.167.204.206:4047 , piece_id=NW47TPJDWAKL676HMJYU324HO75EEOIHMOPMS5PQYLEKYOMBWZUA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.740009845 (82h9m45.437578181s) [noise=true , address=185.167.204.205:4033 , piece_id=IPKHWYQBK33AEFC3UVAYGTS2VD3YY27P3NRZNWD7E2KGCECB3ERQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.740258349 (82h9m45.437826685s) [noise=true , address=89.149.201.147:4005 , piece_id=N5SDW7MVGXA27OYRAT6PRV3QZ7EGRAQWM56BIH6ELSUHJMG4VMUQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.741865852 (82h9m45.439434188s) [noise=true , address=185.167.204.205:4010 , piece_id=V54JRAIPTAHE5MCGQUNSBJUJ5TK5EXOJC2GC4AIHPXUYUMLGE2ZQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.742709749 (82h9m45.440278084s) [noise=true , address=185.167.204.205:4023 , piece_id=UPFQ4BTO3RXW2S2EPN5DCDAKX2FKVXT3GU5PN4C3CW43WFWRHUPQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.744997753 (82h9m45.442566079s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.746659848 (82h9m45.444228164s) [noise=true , address=81.171.14.70:4035 , piece_id=OWBJGEQGTSCR3FYNAOG424BCWICLOH6SUWPXOE7HHA454ZGM5JBA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.748622674 (82h9m45.446191s) [noise=true , address=89.149.201.147:4021 , piece_id=XVSL373IQK3EJ5ROTEA4ATRFTFS7YRRVUEHHN4V76MGSI32AC2EQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:58.224081322 (82h9m45.921649628s) [upload=72097]: Next returned nil segment Dec 9 01:38:58.224089837 (82h9m45.921658144s) [upload=72097]: Waiting for error group managing segments... Dec 9 01:38:58.431307515 (82h9m46.128875821s) [noise=true , address=89.149.201.147:4005 , piece_id=N5SDW7MVGXA27OYRAT6PRV3QZ7EGRAQWM56BIH6ELSUHJMG4VMUQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.431749651 (82h9m46.129317997s) [noise=true , address=81.171.14.70:4037 , piece_id=K2IE5MXBWGN5LIDT5EBAB42REHN7H4IIGA34NZWNYZXKQGEEMGRQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.490273164 (82h9m46.1878415s) [noise=true , address=89.149.201.147:4014 , piece_id=RMGYDI27Y4M7Z7VV5PTCP5TGCFYQVRFXRKDSKHN7J6HDQP5W3GFA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.502770258 (82h9m46.200338564s) [noise=true , address=89.149.201.147:4020 , piece_id=5LEKKWXSJDXKUYRK7XXK2NIAYEYD36VNCFKTQGJQWGNUKHWBQ7WQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.778274576 (82h9m46.475842912s) [noise=true , address=81.171.14.70:4029 , piece_id=QCPC46W4FFKFED4YRW7D2FPO3XZ4PTE4JWGLOZDDM6TGSXIJLKLA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.834300524 (82h9m46.53186887s) [noise=true , address=185.167.204.206:4056 , piece_id=UY6RJOJYQIMOXSJA6IF52U73TR3EXMXWA6NMZQPJZHT4KOK5ECCQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.904869168 (82h9m46.602437484s) [noise=true , address=81.171.14.70:4045 , piece_id=5MCTULWWE4YX7MIRQK4J6FTJDGW5XLPNPUZDQ2CBRC7MD4MV7AJQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.913844133 (82h9m46.61141248s) [noise=true , address=89.149.201.147:4021 , piece_id=XVSL373IQK3EJ5ROTEA4ATRFTFS7YRRVUEHHN4V76MGSI32AC2EQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.919030171 (82h9m46.616598477s) [noise=true , address=185.167.204.205:4036 , piece_id=GQOYZKTDS3K3XGEOOINJTN767EQXG23JOFYF226DJYEJNETDJ2BQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.932451492 (82h9m46.630019828s) [noise=true , address=185.167.204.205:4010 , piece_id=V54JRAIPTAHE5MCGQUNSBJUJ5TK5EXOJC2GC4AIHPXUYUMLGE2ZQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.943222923 (82h9m46.640791229s) [noise=true , address=89.149.201.147:4009 , piece_id=6UNPJCAZ5WYFTLWCRZU2FAPN4DVBV57ZP7KYXW26NMG2TSSVRUDA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.960077819 (82h9m46.657646155s) [noise=true , address=81.171.14.70:4032 , piece_id=SEPKDP35H3TQKSSXXKJKYL4ORU4TESWYCGLHPSGFHBBWW76WP5MA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.032398786 (82h9m46.729967102s) [noise=true , address=81.171.14.70:4028 , piece_id=SM75T7PBZ54GWI35ANTK343OL5B6VOVAIL77NPTKPMJO342JFHVA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.057203271 (82h9m46.754771587s) [noise=true , address=185.167.204.205:4023 , piece_id=UPFQ4BTO3RXW2S2EPN5DCDAKX2FKVXT3GU5PN4C3CW43WFWRHUPQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.081058494 (82h9m46.77862682s) [noise=true , address=185.167.204.206:4055 , piece_id=TK6CZLA3NXDZX5RLSK4H3GGEPNXZ2GDZ2CGI2OZ7B4TPP6AR7DHA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.112142418 (82h9m46.809710755s) [noise=true , address=185.167.204.205:4018 , piece_id=SNDUUOXX7WBTLKDHPB65A4WTFJ7PC6XRHPRENQ6KMOIPM4E5MSKA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.531727623 (82h9m47.229295959s) [noise=true , address=185.167.204.205:4012 , piece_id=4V2U6G2XVPFRZOEGLMVY6JNZFZ3BZ3QBIQWL47TXB3YK4DJIJ34A, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.534328111 (82h9m47.231896438s) [noise=true , address=89.149.201.147:4017 , piece_id=KA54SKQCIIIQSGHLZBBR7EWVKD5QJHX756BKLRXMPDJ6WDJR5YBQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.719679832 (82h9m47.417248168s) [noise=true , address=81.171.14.70:4035 , piece_id=OWBJGEQGTSCR3FYNAOG424BCWICLOH6SUWPXOE7HHA454ZGM5JBA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.724123352 (82h9m47.421691688s) [noise=true , address=89.149.201.147:4018 , piece_id=NHYZ3WXHU4QMPG37K4I3BH5K22GCY7WDUGXL7O4PEB225KKEC6HQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.786813169 (82h9m47.484381505s) [noise=true , address=81.171.14.70:4038 , piece_id=CCN4X2R6HMAC5IFPL5POH66QHXRZWHASDYWE2KEVVO64BIGD4OBA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.828658967 (82h9m47.526227304s) [noise=true , address=81.171.14.70:4033 , piece_id=JRVTZECOZWQGJJHTASK2G3BODS4AZ2XVE45YYXT2GPCMWFHSICCA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.250467174 (82h9m47.94803549s) [noise=true , address=185.167.204.205:4033 , piece_id=IPKHWYQBK33AEFC3UVAYGTS2VD3YY27P3NRZNWD7E2KGCECB3ERQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.328214947 (82h9m48.025783253s) [noise=true , address=81.171.14.70:4047 , piece_id=K66YL34O4IFTJV3RBEXZDERYJTAGAPXCNODECGD23QQNOAXVBM5A, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.360647713 (82h9m48.058216029s) [noise=true , address=185.167.204.206:4069 , piece_id=H6SQBPSIZ25KBJMBNIMDPZCXHEH7JQVXXGZQIDM2NUZDYRYO5QUA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.775238387 (82h9m48.472806723s) [noise=true , address=185.167.204.206:4047 , piece_id=NW47TPJDWAKL676HMJYU324HO75EEOIHMOPMS5PQYLEKYOMBWZUA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.775263474 (82h9m48.47283182s) [seg_pos={0 0}, upload=72097]: Segment reached optimal threshold of 26 pieces. Dec 9 01:39:00.775563294 (82h9m48.47313163s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61): protocol: expected piece hash; context canceled; EOF Dec 9 01:39:00.775653142 (82h9m48.473221478s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Long tail cancellation due to optimal threshold Dec 9 01:39:00.775734835 (82h9m48.473303141s) [noise=true , address=81.171.14.70:4039 , piece_id=74L4VSJSG47MCVTLP3CAU4PRQS5OSPKKTCNADR4T7HYJIOLTUQYQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 9 01:39:00.775749791 (82h9m48.473318108s) [noise=true , address=81.171.14.70:4039 , piece_id=74L4VSJSG47MCVTLP3CAU4PRQS5OSPKKTCNADR4T7HYJIOLTUQYQ, seg_pos={0 0}, upload=72097]: Long tail cancellation due to optimal threshold Dec 9 01:39:00.775771663 (82h9m48.473339969s) [seg_pos={0 0}, upload=72097]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:39:00.775860019 (82h9m48.473428335s) [upload=72097]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:39:00.775864196 (82h9m48.473432502s) [upload=72097]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:39:00.924498628 (82h9m48.622066934s) [upload=72097]: Done uploading segments... Dec 9 01:39:00.924511733 (82h9m48.622080038s) [upload=72097]: Upload finished. err: <nil> Duration: 17.705497794s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 13 out of 60 is failed (threshold=3) [.....X...X.....X.X.X...X...X..X.X..X......X..X.....X........] duration: 4.846734106s trace: https://jaeger.dev.storj.io/trace/7c6bdd8bee4bfc0e FAIL (2025-12-09 01:44:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 733831955 (82h9m45.431400291s) [noise=true , address=81.171.14.70:4033 , piece_id=JRVTZECOZWQGJJHTASK2G3BODS4AZ2XVE45YYXT2GPCMWFHSICCA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.734987704 (82h9m45.43255604s) [noise=true , address=185.167.204.205:4036 , piece_id=GQOYZKTDS3K3XGEOOINJTN767EQXG23JOFYF226DJYEJNETDJ2BQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.736018750 (82h9m45.433587077s) [noise=true , address=81.171.14.70:4028 , piece_id=SM75T7PBZ54GWI35ANTK343OL5B6VOVAIL77NPTKPMJO342JFHVA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.738080051 (82h9m45.435648377s) [noise=true , address=185.167.204.206:4047 , piece_id=NW47TPJDWAKL676HMJYU324HO75EEOIHMOPMS5PQYLEKYOMBWZUA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.740009845 (82h9m45.437578181s) [noise=true , address=185.167.204.205:4033 , piece_id=IPKHWYQBK33AEFC3UVAYGTS2VD3YY27P3NRZNWD7E2KGCECB3ERQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.740258349 (82h9m45.437826685s) [noise=true , address=89.149.201.147:4005 , piece_id=N5SDW7MVGXA27OYRAT6PRV3QZ7EGRAQWM56BIH6ELSUHJMG4VMUQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.741865852 (82h9m45.439434188s) [noise=true , address=185.167.204.205:4010 , piece_id=V54JRAIPTAHE5MCGQUNSBJUJ5TK5EXOJC2GC4AIHPXUYUMLGE2ZQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.742709749 (82h9m45.440278084s) [noise=true , address=185.167.204.205:4023 , piece_id=UPFQ4BTO3RXW2S2EPN5DCDAKX2FKVXT3GU5PN4C3CW43WFWRHUPQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.744997753 (82h9m45.442566079s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.746659848 (82h9m45.444228164s) [noise=true , address=81.171.14.70:4035 , piece_id=OWBJGEQGTSCR3FYNAOG424BCWICLOH6SUWPXOE7HHA454ZGM5JBA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.748622674 (82h9m45.446191s) [noise=true , address=89.149.201.147:4021 , piece_id=XVSL373IQK3EJ5ROTEA4ATRFTFS7YRRVUEHHN4V76MGSI32AC2EQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:58.224081322 (82h9m45.921649628s) [upload=72097]: Next returned nil segment Dec 9 01:38:58.224089837 (82h9m45.921658144s) [upload=72097]: Waiting for error group managing segments... Dec 9 01:38:58.431307515 (82h9m46.128875821s) [noise=true , address=89.149.201.147:4005 , piece_id=N5SDW7MVGXA27OYRAT6PRV3QZ7EGRAQWM56BIH6ELSUHJMG4VMUQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.431749651 (82h9m46.129317997s) [noise=true , address=81.171.14.70:4037 , piece_id=K2IE5MXBWGN5LIDT5EBAB42REHN7H4IIGA34NZWNYZXKQGEEMGRQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.490273164 (82h9m46.1878415s) [noise=true , address=89.149.201.147:4014 , piece_id=RMGYDI27Y4M7Z7VV5PTCP5TGCFYQVRFXRKDSKHN7J6HDQP5W3GFA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.502770258 (82h9m46.200338564s) [noise=true , address=89.149.201.147:4020 , piece_id=5LEKKWXSJDXKUYRK7XXK2NIAYEYD36VNCFKTQGJQWGNUKHWBQ7WQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.778274576 (82h9m46.475842912s) [noise=true , address=81.171.14.70:4029 , piece_id=QCPC46W4FFKFED4YRW7D2FPO3XZ4PTE4JWGLOZDDM6TGSXIJLKLA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.834300524 (82h9m46.53186887s) [noise=true , address=185.167.204.206:4056 , piece_id=UY6RJOJYQIMOXSJA6IF52U73TR3EXMXWA6NMZQPJZHT4KOK5ECCQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.904869168 (82h9m46.602437484s) [noise=true , address=81.171.14.70:4045 , piece_id=5MCTULWWE4YX7MIRQK4J6FTJDGW5XLPNPUZDQ2CBRC7MD4MV7AJQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.913844133 (82h9m46.61141248s) [noise=true , address=89.149.201.147:4021 , piece_id=XVSL373IQK3EJ5ROTEA4ATRFTFS7YRRVUEHHN4V76MGSI32AC2EQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.919030171 (82h9m46.616598477s) [noise=true , address=185.167.204.205:4036 , piece_id=GQOYZKTDS3K3XGEOOINJTN767EQXG23JOFYF226DJYEJNETDJ2BQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.932451492 (82h9m46.630019828s) [noise=true , address=185.167.204.205:4010 , piece_id=V54JRAIPTAHE5MCGQUNSBJUJ5TK5EXOJC2GC4AIHPXUYUMLGE2ZQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.943222923 (82h9m46.640791229s) [noise=true , address=89.149.201.147:4009 , piece_id=6UNPJCAZ5WYFTLWCRZU2FAPN4DVBV57ZP7KYXW26NMG2TSSVRUDA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.960077819 (82h9m46.657646155s) [noise=true , address=81.171.14.70:4032 , piece_id=SEPKDP35H3TQKSSXXKJKYL4ORU4TESWYCGLHPSGFHBBWW76WP5MA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.032398786 (82h9m46.729967102s) [noise=true , address=81.171.14.70:4028 , piece_id=SM75T7PBZ54GWI35ANTK343OL5B6VOVAIL77NPTKPMJO342JFHVA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.057203271 (82h9m46.754771587s) [noise=true , address=185.167.204.205:4023 , piece_id=UPFQ4BTO3RXW2S2EPN5DCDAKX2FKVXT3GU5PN4C3CW43WFWRHUPQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.081058494 (82h9m46.77862682s) [noise=true , address=185.167.204.206:4055 , piece_id=TK6CZLA3NXDZX5RLSK4H3GGEPNXZ2GDZ2CGI2OZ7B4TPP6AR7DHA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.112142418 (82h9m46.809710755s) [noise=true , address=185.167.204.205:4018 , piece_id=SNDUUOXX7WBTLKDHPB65A4WTFJ7PC6XRHPRENQ6KMOIPM4E5MSKA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.531727623 (82h9m47.229295959s) [noise=true , address=185.167.204.205:4012 , piece_id=4V2U6G2XVPFRZOEGLMVY6JNZFZ3BZ3QBIQWL47TXB3YK4DJIJ34A, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.534328111 (82h9m47.231896438s) [noise=true , address=89.149.201.147:4017 , piece_id=KA54SKQCIIIQSGHLZBBR7EWVKD5QJHX756BKLRXMPDJ6WDJR5YBQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.719679832 (82h9m47.417248168s) [noise=true , address=81.171.14.70:4035 , piece_id=OWBJGEQGTSCR3FYNAOG424BCWICLOH6SUWPXOE7HHA454ZGM5JBA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.724123352 (82h9m47.421691688s) [noise=true , address=89.149.201.147:4018 , piece_id=NHYZ3WXHU4QMPG37K4I3BH5K22GCY7WDUGXL7O4PEB225KKEC6HQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.786813169 (82h9m47.484381505s) [noise=true , address=81.171.14.70:4038 , piece_id=CCN4X2R6HMAC5IFPL5POH66QHXRZWHASDYWE2KEVVO64BIGD4OBA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.828658967 (82h9m47.526227304s) [noise=true , address=81.171.14.70:4033 , piece_id=JRVTZECOZWQGJJHTASK2G3BODS4AZ2XVE45YYXT2GPCMWFHSICCA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.250467174 (82h9m47.94803549s) [noise=true , address=185.167.204.205:4033 , piece_id=IPKHWYQBK33AEFC3UVAYGTS2VD3YY27P3NRZNWD7E2KGCECB3ERQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.328214947 (82h9m48.025783253s) [noise=true , address=81.171.14.70:4047 , piece_id=K66YL34O4IFTJV3RBEXZDERYJTAGAPXCNODECGD23QQNOAXVBM5A, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.360647713 (82h9m48.058216029s) [noise=true , address=185.167.204.206:4069 , piece_id=H6SQBPSIZ25KBJMBNIMDPZCXHEH7JQVXXGZQIDM2NUZDYRYO5QUA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.775238387 (82h9m48.472806723s) [noise=true , address=185.167.204.206:4047 , piece_id=NW47TPJDWAKL676HMJYU324HO75EEOIHMOPMS5PQYLEKYOMBWZUA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.775263474 (82h9m48.47283182s) [seg_pos={0 0}, upload=72097]: Segment reached optimal threshold of 26 pieces. Dec 9 01:39:00.775563294 (82h9m48.47313163s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61): protocol: expected piece hash; context canceled; EOF Dec 9 01:39:00.775653142 (82h9m48.473221478s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Long tail cancellation due to optimal threshold Dec 9 01:39:00.775734835 (82h9m48.473303141s) [noise=true , address=81.171.14.70:4039 , piece_id=74L4VSJSG47MCVTLP3CAU4PRQS5OSPKKTCNADR4T7HYJIOLTUQYQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 9 01:39:00.775749791 (82h9m48.473318108s) [noise=true , address=81.171.14.70:4039 , piece_id=74L4VSJSG47MCVTLP3CAU4PRQS5OSPKKTCNADR4T7HYJIOLTUQYQ, seg_pos={0 0}, upload=72097]: Long tail cancellation due to optimal threshold Dec 9 01:39:00.775771663 (82h9m48.473339969s) [seg_pos={0 0}, upload=72097]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:39:00.775860019 (82h9m48.473428335s) [upload=72097]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:39:00.775864196 (82h9m48.473432502s) [upload=72097]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:39:00.924498628 (82h9m48.622066934s) [upload=72097]: Done uploading segments... Dec 9 01:39:00.924511733 (82h9m48.622080038s) [upload=72097]: Upload finished. err: <nil> Duration: 4.846751949s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 13 out of 60 is failed (threshold=3) [......X...X.....X.X.X...X...X..X.X..X......X..X.....X.......] duration: 7.1585957s trace: https://jaeger.dev.storj.io/trace/7c6bdd8bee4bfc0e FAIL (2025-12-09 01:43:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 733831955 (82h9m45.431400291s) [noise=true , address=81.171.14.70:4033 , piece_id=JRVTZECOZWQGJJHTASK2G3BODS4AZ2XVE45YYXT2GPCMWFHSICCA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.734987704 (82h9m45.43255604s) [noise=true , address=185.167.204.205:4036 , piece_id=GQOYZKTDS3K3XGEOOINJTN767EQXG23JOFYF226DJYEJNETDJ2BQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.736018750 (82h9m45.433587077s) [noise=true , address=81.171.14.70:4028 , piece_id=SM75T7PBZ54GWI35ANTK343OL5B6VOVAIL77NPTKPMJO342JFHVA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.738080051 (82h9m45.435648377s) [noise=true , address=185.167.204.206:4047 , piece_id=NW47TPJDWAKL676HMJYU324HO75EEOIHMOPMS5PQYLEKYOMBWZUA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.740009845 (82h9m45.437578181s) [noise=true , address=185.167.204.205:4033 , piece_id=IPKHWYQBK33AEFC3UVAYGTS2VD3YY27P3NRZNWD7E2KGCECB3ERQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.740258349 (82h9m45.437826685s) [noise=true , address=89.149.201.147:4005 , piece_id=N5SDW7MVGXA27OYRAT6PRV3QZ7EGRAQWM56BIH6ELSUHJMG4VMUQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.741865852 (82h9m45.439434188s) [noise=true , address=185.167.204.205:4010 , piece_id=V54JRAIPTAHE5MCGQUNSBJUJ5TK5EXOJC2GC4AIHPXUYUMLGE2ZQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.742709749 (82h9m45.440278084s) [noise=true , address=185.167.204.205:4023 , piece_id=UPFQ4BTO3RXW2S2EPN5DCDAKX2FKVXT3GU5PN4C3CW43WFWRHUPQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.744997753 (82h9m45.442566079s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.746659848 (82h9m45.444228164s) [noise=true , address=81.171.14.70:4035 , piece_id=OWBJGEQGTSCR3FYNAOG424BCWICLOH6SUWPXOE7HHA454ZGM5JBA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.748622674 (82h9m45.446191s) [noise=true , address=89.149.201.147:4021 , piece_id=XVSL373IQK3EJ5ROTEA4ATRFTFS7YRRVUEHHN4V76MGSI32AC2EQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:58.224081322 (82h9m45.921649628s) [upload=72097]: Next returned nil segment Dec 9 01:38:58.224089837 (82h9m45.921658144s) [upload=72097]: Waiting for error group managing segments... Dec 9 01:38:58.431307515 (82h9m46.128875821s) [noise=true , address=89.149.201.147:4005 , piece_id=N5SDW7MVGXA27OYRAT6PRV3QZ7EGRAQWM56BIH6ELSUHJMG4VMUQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.431749651 (82h9m46.129317997s) [noise=true , address=81.171.14.70:4037 , piece_id=K2IE5MXBWGN5LIDT5EBAB42REHN7H4IIGA34NZWNYZXKQGEEMGRQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.490273164 (82h9m46.1878415s) [noise=true , address=89.149.201.147:4014 , piece_id=RMGYDI27Y4M7Z7VV5PTCP5TGCFYQVRFXRKDSKHN7J6HDQP5W3GFA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.502770258 (82h9m46.200338564s) [noise=true , address=89.149.201.147:4020 , piece_id=5LEKKWXSJDXKUYRK7XXK2NIAYEYD36VNCFKTQGJQWGNUKHWBQ7WQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.778274576 (82h9m46.475842912s) [noise=true , address=81.171.14.70:4029 , piece_id=QCPC46W4FFKFED4YRW7D2FPO3XZ4PTE4JWGLOZDDM6TGSXIJLKLA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.834300524 (82h9m46.53186887s) [noise=true , address=185.167.204.206:4056 , piece_id=UY6RJOJYQIMOXSJA6IF52U73TR3EXMXWA6NMZQPJZHT4KOK5ECCQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.904869168 (82h9m46.602437484s) [noise=true , address=81.171.14.70:4045 , piece_id=5MCTULWWE4YX7MIRQK4J6FTJDGW5XLPNPUZDQ2CBRC7MD4MV7AJQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.913844133 (82h9m46.61141248s) [noise=true , address=89.149.201.147:4021 , piece_id=XVSL373IQK3EJ5ROTEA4ATRFTFS7YRRVUEHHN4V76MGSI32AC2EQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.919030171 (82h9m46.616598477s) [noise=true , address=185.167.204.205:4036 , piece_id=GQOYZKTDS3K3XGEOOINJTN767EQXG23JOFYF226DJYEJNETDJ2BQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.932451492 (82h9m46.630019828s) [noise=true , address=185.167.204.205:4010 , piece_id=V54JRAIPTAHE5MCGQUNSBJUJ5TK5EXOJC2GC4AIHPXUYUMLGE2ZQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.943222923 (82h9m46.640791229s) [noise=true , address=89.149.201.147:4009 , piece_id=6UNPJCAZ5WYFTLWCRZU2FAPN4DVBV57ZP7KYXW26NMG2TSSVRUDA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.960077819 (82h9m46.657646155s) [noise=true , address=81.171.14.70:4032 , piece_id=SEPKDP35H3TQKSSXXKJKYL4ORU4TESWYCGLHPSGFHBBWW76WP5MA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.032398786 (82h9m46.729967102s) [noise=true , address=81.171.14.70:4028 , piece_id=SM75T7PBZ54GWI35ANTK343OL5B6VOVAIL77NPTKPMJO342JFHVA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.057203271 (82h9m46.754771587s) [noise=true , address=185.167.204.205:4023 , piece_id=UPFQ4BTO3RXW2S2EPN5DCDAKX2FKVXT3GU5PN4C3CW43WFWRHUPQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.081058494 (82h9m46.77862682s) [noise=true , address=185.167.204.206:4055 , piece_id=TK6CZLA3NXDZX5RLSK4H3GGEPNXZ2GDZ2CGI2OZ7B4TPP6AR7DHA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.112142418 (82h9m46.809710755s) [noise=true , address=185.167.204.205:4018 , piece_id=SNDUUOXX7WBTLKDHPB65A4WTFJ7PC6XRHPRENQ6KMOIPM4E5MSKA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.531727623 (82h9m47.229295959s) [noise=true , address=185.167.204.205:4012 , piece_id=4V2U6G2XVPFRZOEGLMVY6JNZFZ3BZ3QBIQWL47TXB3YK4DJIJ34A, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.534328111 (82h9m47.231896438s) [noise=true , address=89.149.201.147:4017 , piece_id=KA54SKQCIIIQSGHLZBBR7EWVKD5QJHX756BKLRXMPDJ6WDJR5YBQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.719679832 (82h9m47.417248168s) [noise=true , address=81.171.14.70:4035 , piece_id=OWBJGEQGTSCR3FYNAOG424BCWICLOH6SUWPXOE7HHA454ZGM5JBA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.724123352 (82h9m47.421691688s) [noise=true , address=89.149.201.147:4018 , piece_id=NHYZ3WXHU4QMPG37K4I3BH5K22GCY7WDUGXL7O4PEB225KKEC6HQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.786813169 (82h9m47.484381505s) [noise=true , address=81.171.14.70:4038 , piece_id=CCN4X2R6HMAC5IFPL5POH66QHXRZWHASDYWE2KEVVO64BIGD4OBA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.828658967 (82h9m47.526227304s) [noise=true , address=81.171.14.70:4033 , piece_id=JRVTZECOZWQGJJHTASK2G3BODS4AZ2XVE45YYXT2GPCMWFHSICCA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.250467174 (82h9m47.94803549s) [noise=true , address=185.167.204.205:4033 , piece_id=IPKHWYQBK33AEFC3UVAYGTS2VD3YY27P3NRZNWD7E2KGCECB3ERQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.328214947 (82h9m48.025783253s) [noise=true , address=81.171.14.70:4047 , piece_id=K66YL34O4IFTJV3RBEXZDERYJTAGAPXCNODECGD23QQNOAXVBM5A, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.360647713 (82h9m48.058216029s) [noise=true , address=185.167.204.206:4069 , piece_id=H6SQBPSIZ25KBJMBNIMDPZCXHEH7JQVXXGZQIDM2NUZDYRYO5QUA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.775238387 (82h9m48.472806723s) [noise=true , address=185.167.204.206:4047 , piece_id=NW47TPJDWAKL676HMJYU324HO75EEOIHMOPMS5PQYLEKYOMBWZUA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.775263474 (82h9m48.47283182s) [seg_pos={0 0}, upload=72097]: Segment reached optimal threshold of 26 pieces. Dec 9 01:39:00.775563294 (82h9m48.47313163s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61): protocol: expected piece hash; context canceled; EOF Dec 9 01:39:00.775653142 (82h9m48.473221478s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Long tail cancellation due to optimal threshold Dec 9 01:39:00.775734835 (82h9m48.473303141s) [noise=true , address=81.171.14.70:4039 , piece_id=74L4VSJSG47MCVTLP3CAU4PRQS5OSPKKTCNADR4T7HYJIOLTUQYQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 9 01:39:00.775749791 (82h9m48.473318108s) [noise=true , address=81.171.14.70:4039 , piece_id=74L4VSJSG47MCVTLP3CAU4PRQS5OSPKKTCNADR4T7HYJIOLTUQYQ, seg_pos={0 0}, upload=72097]: Long tail cancellation due to optimal threshold Dec 9 01:39:00.775771663 (82h9m48.473339969s) [seg_pos={0 0}, upload=72097]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:39:00.775860019 (82h9m48.473428335s) [upload=72097]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:39:00.775864196 (82h9m48.473432502s) [upload=72097]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:39:00.924498628 (82h9m48.622066934s) [upload=72097]: Done uploading segments... Dec 9 01:39:00.924511733 (82h9m48.622080038s) [upload=72097]: Upload finished. err: <nil> Duration: 7.158618242s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 13 out of 60 is failed (threshold=3) [.......X...X.....X.X.X...X...X..X.X..X......X..X.....X......] duration: 6.813879386s trace: https://jaeger.dev.storj.io/trace/7c6bdd8bee4bfc0e FAIL (2025-12-09 01:42:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 733831955 (82h9m45.431400291s) [noise=true , address=81.171.14.70:4033 , piece_id=JRVTZECOZWQGJJHTASK2G3BODS4AZ2XVE45YYXT2GPCMWFHSICCA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.734987704 (82h9m45.43255604s) [noise=true , address=185.167.204.205:4036 , piece_id=GQOYZKTDS3K3XGEOOINJTN767EQXG23JOFYF226DJYEJNETDJ2BQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.736018750 (82h9m45.433587077s) [noise=true , address=81.171.14.70:4028 , piece_id=SM75T7PBZ54GWI35ANTK343OL5B6VOVAIL77NPTKPMJO342JFHVA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.738080051 (82h9m45.435648377s) [noise=true , address=185.167.204.206:4047 , piece_id=NW47TPJDWAKL676HMJYU324HO75EEOIHMOPMS5PQYLEKYOMBWZUA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.740009845 (82h9m45.437578181s) [noise=true , address=185.167.204.205:4033 , piece_id=IPKHWYQBK33AEFC3UVAYGTS2VD3YY27P3NRZNWD7E2KGCECB3ERQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.740258349 (82h9m45.437826685s) [noise=true , address=89.149.201.147:4005 , piece_id=N5SDW7MVGXA27OYRAT6PRV3QZ7EGRAQWM56BIH6ELSUHJMG4VMUQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.741865852 (82h9m45.439434188s) [noise=true , address=185.167.204.205:4010 , piece_id=V54JRAIPTAHE5MCGQUNSBJUJ5TK5EXOJC2GC4AIHPXUYUMLGE2ZQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.742709749 (82h9m45.440278084s) [noise=true , address=185.167.204.205:4023 , piece_id=UPFQ4BTO3RXW2S2EPN5DCDAKX2FKVXT3GU5PN4C3CW43WFWRHUPQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.744997753 (82h9m45.442566079s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.746659848 (82h9m45.444228164s) [noise=true , address=81.171.14.70:4035 , piece_id=OWBJGEQGTSCR3FYNAOG424BCWICLOH6SUWPXOE7HHA454ZGM5JBA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.748622674 (82h9m45.446191s) [noise=true , address=89.149.201.147:4021 , piece_id=XVSL373IQK3EJ5ROTEA4ATRFTFS7YRRVUEHHN4V76MGSI32AC2EQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:58.224081322 (82h9m45.921649628s) [upload=72097]: Next returned nil segment Dec 9 01:38:58.224089837 (82h9m45.921658144s) [upload=72097]: Waiting for error group managing segments... Dec 9 01:38:58.431307515 (82h9m46.128875821s) [noise=true , address=89.149.201.147:4005 , piece_id=N5SDW7MVGXA27OYRAT6PRV3QZ7EGRAQWM56BIH6ELSUHJMG4VMUQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.431749651 (82h9m46.129317997s) [noise=true , address=81.171.14.70:4037 , piece_id=K2IE5MXBWGN5LIDT5EBAB42REHN7H4IIGA34NZWNYZXKQGEEMGRQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.490273164 (82h9m46.1878415s) [noise=true , address=89.149.201.147:4014 , piece_id=RMGYDI27Y4M7Z7VV5PTCP5TGCFYQVRFXRKDSKHN7J6HDQP5W3GFA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.502770258 (82h9m46.200338564s) [noise=true , address=89.149.201.147:4020 , piece_id=5LEKKWXSJDXKUYRK7XXK2NIAYEYD36VNCFKTQGJQWGNUKHWBQ7WQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.778274576 (82h9m46.475842912s) [noise=true , address=81.171.14.70:4029 , piece_id=QCPC46W4FFKFED4YRW7D2FPO3XZ4PTE4JWGLOZDDM6TGSXIJLKLA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.834300524 (82h9m46.53186887s) [noise=true , address=185.167.204.206:4056 , piece_id=UY6RJOJYQIMOXSJA6IF52U73TR3EXMXWA6NMZQPJZHT4KOK5ECCQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.904869168 (82h9m46.602437484s) [noise=true , address=81.171.14.70:4045 , piece_id=5MCTULWWE4YX7MIRQK4J6FTJDGW5XLPNPUZDQ2CBRC7MD4MV7AJQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.913844133 (82h9m46.61141248s) [noise=true , address=89.149.201.147:4021 , piece_id=XVSL373IQK3EJ5ROTEA4ATRFTFS7YRRVUEHHN4V76MGSI32AC2EQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.919030171 (82h9m46.616598477s) [noise=true , address=185.167.204.205:4036 , piece_id=GQOYZKTDS3K3XGEOOINJTN767EQXG23JOFYF226DJYEJNETDJ2BQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.932451492 (82h9m46.630019828s) [noise=true , address=185.167.204.205:4010 , piece_id=V54JRAIPTAHE5MCGQUNSBJUJ5TK5EXOJC2GC4AIHPXUYUMLGE2ZQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.943222923 (82h9m46.640791229s) [noise=true , address=89.149.201.147:4009 , piece_id=6UNPJCAZ5WYFTLWCRZU2FAPN4DVBV57ZP7KYXW26NMG2TSSVRUDA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.960077819 (82h9m46.657646155s) [noise=true , address=81.171.14.70:4032 , piece_id=SEPKDP35H3TQKSSXXKJKYL4ORU4TESWYCGLHPSGFHBBWW76WP5MA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.032398786 (82h9m46.729967102s) [noise=true , address=81.171.14.70:4028 , piece_id=SM75T7PBZ54GWI35ANTK343OL5B6VOVAIL77NPTKPMJO342JFHVA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.057203271 (82h9m46.754771587s) [noise=true , address=185.167.204.205:4023 , piece_id=UPFQ4BTO3RXW2S2EPN5DCDAKX2FKVXT3GU5PN4C3CW43WFWRHUPQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.081058494 (82h9m46.77862682s) [noise=true , address=185.167.204.206:4055 , piece_id=TK6CZLA3NXDZX5RLSK4H3GGEPNXZ2GDZ2CGI2OZ7B4TPP6AR7DHA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.112142418 (82h9m46.809710755s) [noise=true , address=185.167.204.205:4018 , piece_id=SNDUUOXX7WBTLKDHPB65A4WTFJ7PC6XRHPRENQ6KMOIPM4E5MSKA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.531727623 (82h9m47.229295959s) [noise=true , address=185.167.204.205:4012 , piece_id=4V2U6G2XVPFRZOEGLMVY6JNZFZ3BZ3QBIQWL47TXB3YK4DJIJ34A, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.534328111 (82h9m47.231896438s) [noise=true , address=89.149.201.147:4017 , piece_id=KA54SKQCIIIQSGHLZBBR7EWVKD5QJHX756BKLRXMPDJ6WDJR5YBQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.719679832 (82h9m47.417248168s) [noise=true , address=81.171.14.70:4035 , piece_id=OWBJGEQGTSCR3FYNAOG424BCWICLOH6SUWPXOE7HHA454ZGM5JBA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.724123352 (82h9m47.421691688s) [noise=true , address=89.149.201.147:4018 , piece_id=NHYZ3WXHU4QMPG37K4I3BH5K22GCY7WDUGXL7O4PEB225KKEC6HQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.786813169 (82h9m47.484381505s) [noise=true , address=81.171.14.70:4038 , piece_id=CCN4X2R6HMAC5IFPL5POH66QHXRZWHASDYWE2KEVVO64BIGD4OBA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.828658967 (82h9m47.526227304s) [noise=true , address=81.171.14.70:4033 , piece_id=JRVTZECOZWQGJJHTASK2G3BODS4AZ2XVE45YYXT2GPCMWFHSICCA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.250467174 (82h9m47.94803549s) [noise=true , address=185.167.204.205:4033 , piece_id=IPKHWYQBK33AEFC3UVAYGTS2VD3YY27P3NRZNWD7E2KGCECB3ERQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.328214947 (82h9m48.025783253s) [noise=true , address=81.171.14.70:4047 , piece_id=K66YL34O4IFTJV3RBEXZDERYJTAGAPXCNODECGD23QQNOAXVBM5A, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.360647713 (82h9m48.058216029s) [noise=true , address=185.167.204.206:4069 , piece_id=H6SQBPSIZ25KBJMBNIMDPZCXHEH7JQVXXGZQIDM2NUZDYRYO5QUA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.775238387 (82h9m48.472806723s) [noise=true , address=185.167.204.206:4047 , piece_id=NW47TPJDWAKL676HMJYU324HO75EEOIHMOPMS5PQYLEKYOMBWZUA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.775263474 (82h9m48.47283182s) [seg_pos={0 0}, upload=72097]: Segment reached optimal threshold of 26 pieces. Dec 9 01:39:00.775563294 (82h9m48.47313163s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61): protocol: expected piece hash; context canceled; EOF Dec 9 01:39:00.775653142 (82h9m48.473221478s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Long tail cancellation due to optimal threshold Dec 9 01:39:00.775734835 (82h9m48.473303141s) [noise=true , address=81.171.14.70:4039 , piece_id=74L4VSJSG47MCVTLP3CAU4PRQS5OSPKKTCNADR4T7HYJIOLTUQYQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 9 01:39:00.775749791 (82h9m48.473318108s) [noise=true , address=81.171.14.70:4039 , piece_id=74L4VSJSG47MCVTLP3CAU4PRQS5OSPKKTCNADR4T7HYJIOLTUQYQ, seg_pos={0 0}, upload=72097]: Long tail cancellation due to optimal threshold Dec 9 01:39:00.775771663 (82h9m48.473339969s) [seg_pos={0 0}, upload=72097]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:39:00.775860019 (82h9m48.473428335s) [upload=72097]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:39:00.775864196 (82h9m48.473432502s) [upload=72097]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:39:00.924498628 (82h9m48.622066934s) [upload=72097]: Done uploading segments... Dec 9 01:39:00.924511733 (82h9m48.622080038s) [upload=72097]: Upload finished. err: <nil> Duration: 6.813927795s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 14 out of 60 is failed (threshold=3) [X.......X...X.....X.X.X...X...X..X.X..X......X..X.....X.....] duration: 5.627563652s trace: https://jaeger.dev.storj.io/trace/7c6bdd8bee4bfc0e FAIL (2025-12-09 01:42:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 733831955 (82h9m45.431400291s) [noise=true , address=81.171.14.70:4033 , piece_id=JRVTZECOZWQGJJHTASK2G3BODS4AZ2XVE45YYXT2GPCMWFHSICCA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.734987704 (82h9m45.43255604s) [noise=true , address=185.167.204.205:4036 , piece_id=GQOYZKTDS3K3XGEOOINJTN767EQXG23JOFYF226DJYEJNETDJ2BQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.736018750 (82h9m45.433587077s) [noise=true , address=81.171.14.70:4028 , piece_id=SM75T7PBZ54GWI35ANTK343OL5B6VOVAIL77NPTKPMJO342JFHVA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.738080051 (82h9m45.435648377s) [noise=true , address=185.167.204.206:4047 , piece_id=NW47TPJDWAKL676HMJYU324HO75EEOIHMOPMS5PQYLEKYOMBWZUA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.740009845 (82h9m45.437578181s) [noise=true , address=185.167.204.205:4033 , piece_id=IPKHWYQBK33AEFC3UVAYGTS2VD3YY27P3NRZNWD7E2KGCECB3ERQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.740258349 (82h9m45.437826685s) [noise=true , address=89.149.201.147:4005 , piece_id=N5SDW7MVGXA27OYRAT6PRV3QZ7EGRAQWM56BIH6ELSUHJMG4VMUQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.741865852 (82h9m45.439434188s) [noise=true , address=185.167.204.205:4010 , piece_id=V54JRAIPTAHE5MCGQUNSBJUJ5TK5EXOJC2GC4AIHPXUYUMLGE2ZQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.742709749 (82h9m45.440278084s) [noise=true , address=185.167.204.205:4023 , piece_id=UPFQ4BTO3RXW2S2EPN5DCDAKX2FKVXT3GU5PN4C3CW43WFWRHUPQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.744997753 (82h9m45.442566079s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.746659848 (82h9m45.444228164s) [noise=true , address=81.171.14.70:4035 , piece_id=OWBJGEQGTSCR3FYNAOG424BCWICLOH6SUWPXOE7HHA454ZGM5JBA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.748622674 (82h9m45.446191s) [noise=true , address=89.149.201.147:4021 , piece_id=XVSL373IQK3EJ5ROTEA4ATRFTFS7YRRVUEHHN4V76MGSI32AC2EQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:58.224081322 (82h9m45.921649628s) [upload=72097]: Next returned nil segment Dec 9 01:38:58.224089837 (82h9m45.921658144s) [upload=72097]: Waiting for error group managing segments... Dec 9 01:38:58.431307515 (82h9m46.128875821s) [noise=true , address=89.149.201.147:4005 , piece_id=N5SDW7MVGXA27OYRAT6PRV3QZ7EGRAQWM56BIH6ELSUHJMG4VMUQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.431749651 (82h9m46.129317997s) [noise=true , address=81.171.14.70:4037 , piece_id=K2IE5MXBWGN5LIDT5EBAB42REHN7H4IIGA34NZWNYZXKQGEEMGRQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.490273164 (82h9m46.1878415s) [noise=true , address=89.149.201.147:4014 , piece_id=RMGYDI27Y4M7Z7VV5PTCP5TGCFYQVRFXRKDSKHN7J6HDQP5W3GFA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.502770258 (82h9m46.200338564s) [noise=true , address=89.149.201.147:4020 , piece_id=5LEKKWXSJDXKUYRK7XXK2NIAYEYD36VNCFKTQGJQWGNUKHWBQ7WQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.778274576 (82h9m46.475842912s) [noise=true , address=81.171.14.70:4029 , piece_id=QCPC46W4FFKFED4YRW7D2FPO3XZ4PTE4JWGLOZDDM6TGSXIJLKLA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.834300524 (82h9m46.53186887s) [noise=true , address=185.167.204.206:4056 , piece_id=UY6RJOJYQIMOXSJA6IF52U73TR3EXMXWA6NMZQPJZHT4KOK5ECCQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.904869168 (82h9m46.602437484s) [noise=true , address=81.171.14.70:4045 , piece_id=5MCTULWWE4YX7MIRQK4J6FTJDGW5XLPNPUZDQ2CBRC7MD4MV7AJQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.913844133 (82h9m46.61141248s) [noise=true , address=89.149.201.147:4021 , piece_id=XVSL373IQK3EJ5ROTEA4ATRFTFS7YRRVUEHHN4V76MGSI32AC2EQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.919030171 (82h9m46.616598477s) [noise=true , address=185.167.204.205:4036 , piece_id=GQOYZKTDS3K3XGEOOINJTN767EQXG23JOFYF226DJYEJNETDJ2BQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.932451492 (82h9m46.630019828s) [noise=true , address=185.167.204.205:4010 , piece_id=V54JRAIPTAHE5MCGQUNSBJUJ5TK5EXOJC2GC4AIHPXUYUMLGE2ZQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.943222923 (82h9m46.640791229s) [noise=true , address=89.149.201.147:4009 , piece_id=6UNPJCAZ5WYFTLWCRZU2FAPN4DVBV57ZP7KYXW26NMG2TSSVRUDA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.960077819 (82h9m46.657646155s) [noise=true , address=81.171.14.70:4032 , piece_id=SEPKDP35H3TQKSSXXKJKYL4ORU4TESWYCGLHPSGFHBBWW76WP5MA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.032398786 (82h9m46.729967102s) [noise=true , address=81.171.14.70:4028 , piece_id=SM75T7PBZ54GWI35ANTK343OL5B6VOVAIL77NPTKPMJO342JFHVA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.057203271 (82h9m46.754771587s) [noise=true , address=185.167.204.205:4023 , piece_id=UPFQ4BTO3RXW2S2EPN5DCDAKX2FKVXT3GU5PN4C3CW43WFWRHUPQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.081058494 (82h9m46.77862682s) [noise=true , address=185.167.204.206:4055 , piece_id=TK6CZLA3NXDZX5RLSK4H3GGEPNXZ2GDZ2CGI2OZ7B4TPP6AR7DHA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.112142418 (82h9m46.809710755s) [noise=true , address=185.167.204.205:4018 , piece_id=SNDUUOXX7WBTLKDHPB65A4WTFJ7PC6XRHPRENQ6KMOIPM4E5MSKA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.531727623 (82h9m47.229295959s) [noise=true , address=185.167.204.205:4012 , piece_id=4V2U6G2XVPFRZOEGLMVY6JNZFZ3BZ3QBIQWL47TXB3YK4DJIJ34A, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.534328111 (82h9m47.231896438s) [noise=true , address=89.149.201.147:4017 , piece_id=KA54SKQCIIIQSGHLZBBR7EWVKD5QJHX756BKLRXMPDJ6WDJR5YBQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.719679832 (82h9m47.417248168s) [noise=true , address=81.171.14.70:4035 , piece_id=OWBJGEQGTSCR3FYNAOG424BCWICLOH6SUWPXOE7HHA454ZGM5JBA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.724123352 (82h9m47.421691688s) [noise=true , address=89.149.201.147:4018 , piece_id=NHYZ3WXHU4QMPG37K4I3BH5K22GCY7WDUGXL7O4PEB225KKEC6HQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.786813169 (82h9m47.484381505s) [noise=true , address=81.171.14.70:4038 , piece_id=CCN4X2R6HMAC5IFPL5POH66QHXRZWHASDYWE2KEVVO64BIGD4OBA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.828658967 (82h9m47.526227304s) [noise=true , address=81.171.14.70:4033 , piece_id=JRVTZECOZWQGJJHTASK2G3BODS4AZ2XVE45YYXT2GPCMWFHSICCA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.250467174 (82h9m47.94803549s) [noise=true , address=185.167.204.205:4033 , piece_id=IPKHWYQBK33AEFC3UVAYGTS2VD3YY27P3NRZNWD7E2KGCECB3ERQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.328214947 (82h9m48.025783253s) [noise=true , address=81.171.14.70:4047 , piece_id=K66YL34O4IFTJV3RBEXZDERYJTAGAPXCNODECGD23QQNOAXVBM5A, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.360647713 (82h9m48.058216029s) [noise=true , address=185.167.204.206:4069 , piece_id=H6SQBPSIZ25KBJMBNIMDPZCXHEH7JQVXXGZQIDM2NUZDYRYO5QUA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.775238387 (82h9m48.472806723s) [noise=true , address=185.167.204.206:4047 , piece_id=NW47TPJDWAKL676HMJYU324HO75EEOIHMOPMS5PQYLEKYOMBWZUA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.775263474 (82h9m48.47283182s) [seg_pos={0 0}, upload=72097]: Segment reached optimal threshold of 26 pieces. Dec 9 01:39:00.775563294 (82h9m48.47313163s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61): protocol: expected piece hash; context canceled; EOF Dec 9 01:39:00.775653142 (82h9m48.473221478s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Long tail cancellation due to optimal threshold Dec 9 01:39:00.775734835 (82h9m48.473303141s) [noise=true , address=81.171.14.70:4039 , piece_id=74L4VSJSG47MCVTLP3CAU4PRQS5OSPKKTCNADR4T7HYJIOLTUQYQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 9 01:39:00.775749791 (82h9m48.473318108s) [noise=true , address=81.171.14.70:4039 , piece_id=74L4VSJSG47MCVTLP3CAU4PRQS5OSPKKTCNADR4T7HYJIOLTUQYQ, seg_pos={0 0}, upload=72097]: Long tail cancellation due to optimal threshold Dec 9 01:39:00.775771663 (82h9m48.473339969s) [seg_pos={0 0}, upload=72097]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:39:00.775860019 (82h9m48.473428335s) [upload=72097]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:39:00.775864196 (82h9m48.473432502s) [upload=72097]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:39:00.924498628 (82h9m48.622066934s) [upload=72097]: Done uploading segments... Dec 9 01:39:00.924511733 (82h9m48.622080038s) [upload=72097]: Upload finished. err: <nil> Duration: 5.627585353s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 14 out of 60 is failed (threshold=3) [.X.......X...X.....X.X.X...X...X..X.X..X......X..X.....X....] duration: 9.579801173s trace: https://jaeger.dev.storj.io/trace/7c6bdd8bee4bfc0e FAIL (2025-12-09 01:41:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 733831955 (82h9m45.431400291s) [noise=true , address=81.171.14.70:4033 , piece_id=JRVTZECOZWQGJJHTASK2G3BODS4AZ2XVE45YYXT2GPCMWFHSICCA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.734987704 (82h9m45.43255604s) [noise=true , address=185.167.204.205:4036 , piece_id=GQOYZKTDS3K3XGEOOINJTN767EQXG23JOFYF226DJYEJNETDJ2BQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.736018750 (82h9m45.433587077s) [noise=true , address=81.171.14.70:4028 , piece_id=SM75T7PBZ54GWI35ANTK343OL5B6VOVAIL77NPTKPMJO342JFHVA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.738080051 (82h9m45.435648377s) [noise=true , address=185.167.204.206:4047 , piece_id=NW47TPJDWAKL676HMJYU324HO75EEOIHMOPMS5PQYLEKYOMBWZUA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.740009845 (82h9m45.437578181s) [noise=true , address=185.167.204.205:4033 , piece_id=IPKHWYQBK33AEFC3UVAYGTS2VD3YY27P3NRZNWD7E2KGCECB3ERQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.740258349 (82h9m45.437826685s) [noise=true , address=89.149.201.147:4005 , piece_id=N5SDW7MVGXA27OYRAT6PRV3QZ7EGRAQWM56BIH6ELSUHJMG4VMUQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.741865852 (82h9m45.439434188s) [noise=true , address=185.167.204.205:4010 , piece_id=V54JRAIPTAHE5MCGQUNSBJUJ5TK5EXOJC2GC4AIHPXUYUMLGE2ZQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.742709749 (82h9m45.440278084s) [noise=true , address=185.167.204.205:4023 , piece_id=UPFQ4BTO3RXW2S2EPN5DCDAKX2FKVXT3GU5PN4C3CW43WFWRHUPQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.744997753 (82h9m45.442566079s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.746659848 (82h9m45.444228164s) [noise=true , address=81.171.14.70:4035 , piece_id=OWBJGEQGTSCR3FYNAOG424BCWICLOH6SUWPXOE7HHA454ZGM5JBA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.748622674 (82h9m45.446191s) [noise=true , address=89.149.201.147:4021 , piece_id=XVSL373IQK3EJ5ROTEA4ATRFTFS7YRRVUEHHN4V76MGSI32AC2EQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:58.224081322 (82h9m45.921649628s) [upload=72097]: Next returned nil segment Dec 9 01:38:58.224089837 (82h9m45.921658144s) [upload=72097]: Waiting for error group managing segments... Dec 9 01:38:58.431307515 (82h9m46.128875821s) [noise=true , address=89.149.201.147:4005 , piece_id=N5SDW7MVGXA27OYRAT6PRV3QZ7EGRAQWM56BIH6ELSUHJMG4VMUQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.431749651 (82h9m46.129317997s) [noise=true , address=81.171.14.70:4037 , piece_id=K2IE5MXBWGN5LIDT5EBAB42REHN7H4IIGA34NZWNYZXKQGEEMGRQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.490273164 (82h9m46.1878415s) [noise=true , address=89.149.201.147:4014 , piece_id=RMGYDI27Y4M7Z7VV5PTCP5TGCFYQVRFXRKDSKHN7J6HDQP5W3GFA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.502770258 (82h9m46.200338564s) [noise=true , address=89.149.201.147:4020 , piece_id=5LEKKWXSJDXKUYRK7XXK2NIAYEYD36VNCFKTQGJQWGNUKHWBQ7WQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.778274576 (82h9m46.475842912s) [noise=true , address=81.171.14.70:4029 , piece_id=QCPC46W4FFKFED4YRW7D2FPO3XZ4PTE4JWGLOZDDM6TGSXIJLKLA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.834300524 (82h9m46.53186887s) [noise=true , address=185.167.204.206:4056 , piece_id=UY6RJOJYQIMOXSJA6IF52U73TR3EXMXWA6NMZQPJZHT4KOK5ECCQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.904869168 (82h9m46.602437484s) [noise=true , address=81.171.14.70:4045 , piece_id=5MCTULWWE4YX7MIRQK4J6FTJDGW5XLPNPUZDQ2CBRC7MD4MV7AJQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.913844133 (82h9m46.61141248s) [noise=true , address=89.149.201.147:4021 , piece_id=XVSL373IQK3EJ5ROTEA4ATRFTFS7YRRVUEHHN4V76MGSI32AC2EQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.919030171 (82h9m46.616598477s) [noise=true , address=185.167.204.205:4036 , piece_id=GQOYZKTDS3K3XGEOOINJTN767EQXG23JOFYF226DJYEJNETDJ2BQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.932451492 (82h9m46.630019828s) [noise=true , address=185.167.204.205:4010 , piece_id=V54JRAIPTAHE5MCGQUNSBJUJ5TK5EXOJC2GC4AIHPXUYUMLGE2ZQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.943222923 (82h9m46.640791229s) [noise=true , address=89.149.201.147:4009 , piece_id=6UNPJCAZ5WYFTLWCRZU2FAPN4DVBV57ZP7KYXW26NMG2TSSVRUDA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.960077819 (82h9m46.657646155s) [noise=true , address=81.171.14.70:4032 , piece_id=SEPKDP35H3TQKSSXXKJKYL4ORU4TESWYCGLHPSGFHBBWW76WP5MA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.032398786 (82h9m46.729967102s) [noise=true , address=81.171.14.70:4028 , piece_id=SM75T7PBZ54GWI35ANTK343OL5B6VOVAIL77NPTKPMJO342JFHVA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.057203271 (82h9m46.754771587s) [noise=true , address=185.167.204.205:4023 , piece_id=UPFQ4BTO3RXW2S2EPN5DCDAKX2FKVXT3GU5PN4C3CW43WFWRHUPQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.081058494 (82h9m46.77862682s) [noise=true , address=185.167.204.206:4055 , piece_id=TK6CZLA3NXDZX5RLSK4H3GGEPNXZ2GDZ2CGI2OZ7B4TPP6AR7DHA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.112142418 (82h9m46.809710755s) [noise=true , address=185.167.204.205:4018 , piece_id=SNDUUOXX7WBTLKDHPB65A4WTFJ7PC6XRHPRENQ6KMOIPM4E5MSKA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.531727623 (82h9m47.229295959s) [noise=true , address=185.167.204.205:4012 , piece_id=4V2U6G2XVPFRZOEGLMVY6JNZFZ3BZ3QBIQWL47TXB3YK4DJIJ34A, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.534328111 (82h9m47.231896438s) [noise=true , address=89.149.201.147:4017 , piece_id=KA54SKQCIIIQSGHLZBBR7EWVKD5QJHX756BKLRXMPDJ6WDJR5YBQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.719679832 (82h9m47.417248168s) [noise=true , address=81.171.14.70:4035 , piece_id=OWBJGEQGTSCR3FYNAOG424BCWICLOH6SUWPXOE7HHA454ZGM5JBA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.724123352 (82h9m47.421691688s) [noise=true , address=89.149.201.147:4018 , piece_id=NHYZ3WXHU4QMPG37K4I3BH5K22GCY7WDUGXL7O4PEB225KKEC6HQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.786813169 (82h9m47.484381505s) [noise=true , address=81.171.14.70:4038 , piece_id=CCN4X2R6HMAC5IFPL5POH66QHXRZWHASDYWE2KEVVO64BIGD4OBA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.828658967 (82h9m47.526227304s) [noise=true , address=81.171.14.70:4033 , piece_id=JRVTZECOZWQGJJHTASK2G3BODS4AZ2XVE45YYXT2GPCMWFHSICCA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.250467174 (82h9m47.94803549s) [noise=true , address=185.167.204.205:4033 , piece_id=IPKHWYQBK33AEFC3UVAYGTS2VD3YY27P3NRZNWD7E2KGCECB3ERQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.328214947 (82h9m48.025783253s) [noise=true , address=81.171.14.70:4047 , piece_id=K66YL34O4IFTJV3RBEXZDERYJTAGAPXCNODECGD23QQNOAXVBM5A, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.360647713 (82h9m48.058216029s) [noise=true , address=185.167.204.206:4069 , piece_id=H6SQBPSIZ25KBJMBNIMDPZCXHEH7JQVXXGZQIDM2NUZDYRYO5QUA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.775238387 (82h9m48.472806723s) [noise=true , address=185.167.204.206:4047 , piece_id=NW47TPJDWAKL676HMJYU324HO75EEOIHMOPMS5PQYLEKYOMBWZUA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.775263474 (82h9m48.47283182s) [seg_pos={0 0}, upload=72097]: Segment reached optimal threshold of 26 pieces. Dec 9 01:39:00.775563294 (82h9m48.47313163s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61): protocol: expected piece hash; context canceled; EOF Dec 9 01:39:00.775653142 (82h9m48.473221478s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Long tail cancellation due to optimal threshold Dec 9 01:39:00.775734835 (82h9m48.473303141s) [noise=true , address=81.171.14.70:4039 , piece_id=74L4VSJSG47MCVTLP3CAU4PRQS5OSPKKTCNADR4T7HYJIOLTUQYQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 9 01:39:00.775749791 (82h9m48.473318108s) [noise=true , address=81.171.14.70:4039 , piece_id=74L4VSJSG47MCVTLP3CAU4PRQS5OSPKKTCNADR4T7HYJIOLTUQYQ, seg_pos={0 0}, upload=72097]: Long tail cancellation due to optimal threshold Dec 9 01:39:00.775771663 (82h9m48.473339969s) [seg_pos={0 0}, upload=72097]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:39:00.775860019 (82h9m48.473428335s) [upload=72097]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:39:00.775864196 (82h9m48.473432502s) [upload=72097]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:39:00.924498628 (82h9m48.622066934s) [upload=72097]: Done uploading segments... Dec 9 01:39:00.924511733 (82h9m48.622080038s) [upload=72097]: Upload finished. err: <nil> Duration: 9.579817653s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 15 out of 60 is failed (threshold=3) [X.X.......X...X.....X.X.X...X...X..X.X..X......X..X.....X...] duration: 5.242169888s trace: https://jaeger.dev.storj.io/trace/7c6bdd8bee4bfc0e FAIL (2025-12-09 01:41:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 733831955 (82h9m45.431400291s) [noise=true , address=81.171.14.70:4033 , piece_id=JRVTZECOZWQGJJHTASK2G3BODS4AZ2XVE45YYXT2GPCMWFHSICCA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.734987704 (82h9m45.43255604s) [noise=true , address=185.167.204.205:4036 , piece_id=GQOYZKTDS3K3XGEOOINJTN767EQXG23JOFYF226DJYEJNETDJ2BQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.736018750 (82h9m45.433587077s) [noise=true , address=81.171.14.70:4028 , piece_id=SM75T7PBZ54GWI35ANTK343OL5B6VOVAIL77NPTKPMJO342JFHVA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.738080051 (82h9m45.435648377s) [noise=true , address=185.167.204.206:4047 , piece_id=NW47TPJDWAKL676HMJYU324HO75EEOIHMOPMS5PQYLEKYOMBWZUA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.740009845 (82h9m45.437578181s) [noise=true , address=185.167.204.205:4033 , piece_id=IPKHWYQBK33AEFC3UVAYGTS2VD3YY27P3NRZNWD7E2KGCECB3ERQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.740258349 (82h9m45.437826685s) [noise=true , address=89.149.201.147:4005 , piece_id=N5SDW7MVGXA27OYRAT6PRV3QZ7EGRAQWM56BIH6ELSUHJMG4VMUQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.741865852 (82h9m45.439434188s) [noise=true , address=185.167.204.205:4010 , piece_id=V54JRAIPTAHE5MCGQUNSBJUJ5TK5EXOJC2GC4AIHPXUYUMLGE2ZQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.742709749 (82h9m45.440278084s) [noise=true , address=185.167.204.205:4023 , piece_id=UPFQ4BTO3RXW2S2EPN5DCDAKX2FKVXT3GU5PN4C3CW43WFWRHUPQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.744997753 (82h9m45.442566079s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.746659848 (82h9m45.444228164s) [noise=true , address=81.171.14.70:4035 , piece_id=OWBJGEQGTSCR3FYNAOG424BCWICLOH6SUWPXOE7HHA454ZGM5JBA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.748622674 (82h9m45.446191s) [noise=true , address=89.149.201.147:4021 , piece_id=XVSL373IQK3EJ5ROTEA4ATRFTFS7YRRVUEHHN4V76MGSI32AC2EQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:58.224081322 (82h9m45.921649628s) [upload=72097]: Next returned nil segment Dec 9 01:38:58.224089837 (82h9m45.921658144s) [upload=72097]: Waiting for error group managing segments... Dec 9 01:38:58.431307515 (82h9m46.128875821s) [noise=true , address=89.149.201.147:4005 , piece_id=N5SDW7MVGXA27OYRAT6PRV3QZ7EGRAQWM56BIH6ELSUHJMG4VMUQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.431749651 (82h9m46.129317997s) [noise=true , address=81.171.14.70:4037 , piece_id=K2IE5MXBWGN5LIDT5EBAB42REHN7H4IIGA34NZWNYZXKQGEEMGRQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.490273164 (82h9m46.1878415s) [noise=true , address=89.149.201.147:4014 , piece_id=RMGYDI27Y4M7Z7VV5PTCP5TGCFYQVRFXRKDSKHN7J6HDQP5W3GFA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.502770258 (82h9m46.200338564s) [noise=true , address=89.149.201.147:4020 , piece_id=5LEKKWXSJDXKUYRK7XXK2NIAYEYD36VNCFKTQGJQWGNUKHWBQ7WQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.778274576 (82h9m46.475842912s) [noise=true , address=81.171.14.70:4029 , piece_id=QCPC46W4FFKFED4YRW7D2FPO3XZ4PTE4JWGLOZDDM6TGSXIJLKLA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.834300524 (82h9m46.53186887s) [noise=true , address=185.167.204.206:4056 , piece_id=UY6RJOJYQIMOXSJA6IF52U73TR3EXMXWA6NMZQPJZHT4KOK5ECCQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.904869168 (82h9m46.602437484s) [noise=true , address=81.171.14.70:4045 , piece_id=5MCTULWWE4YX7MIRQK4J6FTJDGW5XLPNPUZDQ2CBRC7MD4MV7AJQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.913844133 (82h9m46.61141248s) [noise=true , address=89.149.201.147:4021 , piece_id=XVSL373IQK3EJ5ROTEA4ATRFTFS7YRRVUEHHN4V76MGSI32AC2EQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.919030171 (82h9m46.616598477s) [noise=true , address=185.167.204.205:4036 , piece_id=GQOYZKTDS3K3XGEOOINJTN767EQXG23JOFYF226DJYEJNETDJ2BQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.932451492 (82h9m46.630019828s) [noise=true , address=185.167.204.205:4010 , piece_id=V54JRAIPTAHE5MCGQUNSBJUJ5TK5EXOJC2GC4AIHPXUYUMLGE2ZQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.943222923 (82h9m46.640791229s) [noise=true , address=89.149.201.147:4009 , piece_id=6UNPJCAZ5WYFTLWCRZU2FAPN4DVBV57ZP7KYXW26NMG2TSSVRUDA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.960077819 (82h9m46.657646155s) [noise=true , address=81.171.14.70:4032 , piece_id=SEPKDP35H3TQKSSXXKJKYL4ORU4TESWYCGLHPSGFHBBWW76WP5MA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.032398786 (82h9m46.729967102s) [noise=true , address=81.171.14.70:4028 , piece_id=SM75T7PBZ54GWI35ANTK343OL5B6VOVAIL77NPTKPMJO342JFHVA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.057203271 (82h9m46.754771587s) [noise=true , address=185.167.204.205:4023 , piece_id=UPFQ4BTO3RXW2S2EPN5DCDAKX2FKVXT3GU5PN4C3CW43WFWRHUPQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.081058494 (82h9m46.77862682s) [noise=true , address=185.167.204.206:4055 , piece_id=TK6CZLA3NXDZX5RLSK4H3GGEPNXZ2GDZ2CGI2OZ7B4TPP6AR7DHA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.112142418 (82h9m46.809710755s) [noise=true , address=185.167.204.205:4018 , piece_id=SNDUUOXX7WBTLKDHPB65A4WTFJ7PC6XRHPRENQ6KMOIPM4E5MSKA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.531727623 (82h9m47.229295959s) [noise=true , address=185.167.204.205:4012 , piece_id=4V2U6G2XVPFRZOEGLMVY6JNZFZ3BZ3QBIQWL47TXB3YK4DJIJ34A, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.534328111 (82h9m47.231896438s) [noise=true , address=89.149.201.147:4017 , piece_id=KA54SKQCIIIQSGHLZBBR7EWVKD5QJHX756BKLRXMPDJ6WDJR5YBQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.719679832 (82h9m47.417248168s) [noise=true , address=81.171.14.70:4035 , piece_id=OWBJGEQGTSCR3FYNAOG424BCWICLOH6SUWPXOE7HHA454ZGM5JBA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.724123352 (82h9m47.421691688s) [noise=true , address=89.149.201.147:4018 , piece_id=NHYZ3WXHU4QMPG37K4I3BH5K22GCY7WDUGXL7O4PEB225KKEC6HQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.786813169 (82h9m47.484381505s) [noise=true , address=81.171.14.70:4038 , piece_id=CCN4X2R6HMAC5IFPL5POH66QHXRZWHASDYWE2KEVVO64BIGD4OBA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.828658967 (82h9m47.526227304s) [noise=true , address=81.171.14.70:4033 , piece_id=JRVTZECOZWQGJJHTASK2G3BODS4AZ2XVE45YYXT2GPCMWFHSICCA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.250467174 (82h9m47.94803549s) [noise=true , address=185.167.204.205:4033 , piece_id=IPKHWYQBK33AEFC3UVAYGTS2VD3YY27P3NRZNWD7E2KGCECB3ERQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.328214947 (82h9m48.025783253s) [noise=true , address=81.171.14.70:4047 , piece_id=K66YL34O4IFTJV3RBEXZDERYJTAGAPXCNODECGD23QQNOAXVBM5A, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.360647713 (82h9m48.058216029s) [noise=true , address=185.167.204.206:4069 , piece_id=H6SQBPSIZ25KBJMBNIMDPZCXHEH7JQVXXGZQIDM2NUZDYRYO5QUA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.775238387 (82h9m48.472806723s) [noise=true , address=185.167.204.206:4047 , piece_id=NW47TPJDWAKL676HMJYU324HO75EEOIHMOPMS5PQYLEKYOMBWZUA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.775263474 (82h9m48.47283182s) [seg_pos={0 0}, upload=72097]: Segment reached optimal threshold of 26 pieces. Dec 9 01:39:00.775563294 (82h9m48.47313163s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61): protocol: expected piece hash; context canceled; EOF Dec 9 01:39:00.775653142 (82h9m48.473221478s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Long tail cancellation due to optimal threshold Dec 9 01:39:00.775734835 (82h9m48.473303141s) [noise=true , address=81.171.14.70:4039 , piece_id=74L4VSJSG47MCVTLP3CAU4PRQS5OSPKKTCNADR4T7HYJIOLTUQYQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 9 01:39:00.775749791 (82h9m48.473318108s) [noise=true , address=81.171.14.70:4039 , piece_id=74L4VSJSG47MCVTLP3CAU4PRQS5OSPKKTCNADR4T7HYJIOLTUQYQ, seg_pos={0 0}, upload=72097]: Long tail cancellation due to optimal threshold Dec 9 01:39:00.775771663 (82h9m48.473339969s) [seg_pos={0 0}, upload=72097]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:39:00.775860019 (82h9m48.473428335s) [upload=72097]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:39:00.775864196 (82h9m48.473432502s) [upload=72097]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:39:00.924498628 (82h9m48.622066934s) [upload=72097]: Done uploading segments... Dec 9 01:39:00.924511733 (82h9m48.622080038s) [upload=72097]: Upload finished. err: <nil> Duration: 5.242187301s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 15 out of 60 is failed (threshold=3) [.X.X.......X...X.....X.X.X...X...X..X.X..X......X..X.....X..] duration: 46.499345535s trace: https://jaeger.dev.storj.io/trace/7c6bdd8bee4bfc0e FAIL (2025-12-09 01:41:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 733831955 (82h9m45.431400291s) [noise=true , address=81.171.14.70:4033 , piece_id=JRVTZECOZWQGJJHTASK2G3BODS4AZ2XVE45YYXT2GPCMWFHSICCA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.734987704 (82h9m45.43255604s) [noise=true , address=185.167.204.205:4036 , piece_id=GQOYZKTDS3K3XGEOOINJTN767EQXG23JOFYF226DJYEJNETDJ2BQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.736018750 (82h9m45.433587077s) [noise=true , address=81.171.14.70:4028 , piece_id=SM75T7PBZ54GWI35ANTK343OL5B6VOVAIL77NPTKPMJO342JFHVA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.738080051 (82h9m45.435648377s) [noise=true , address=185.167.204.206:4047 , piece_id=NW47TPJDWAKL676HMJYU324HO75EEOIHMOPMS5PQYLEKYOMBWZUA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.740009845 (82h9m45.437578181s) [noise=true , address=185.167.204.205:4033 , piece_id=IPKHWYQBK33AEFC3UVAYGTS2VD3YY27P3NRZNWD7E2KGCECB3ERQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.740258349 (82h9m45.437826685s) [noise=true , address=89.149.201.147:4005 , piece_id=N5SDW7MVGXA27OYRAT6PRV3QZ7EGRAQWM56BIH6ELSUHJMG4VMUQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.741865852 (82h9m45.439434188s) [noise=true , address=185.167.204.205:4010 , piece_id=V54JRAIPTAHE5MCGQUNSBJUJ5TK5EXOJC2GC4AIHPXUYUMLGE2ZQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.742709749 (82h9m45.440278084s) [noise=true , address=185.167.204.205:4023 , piece_id=UPFQ4BTO3RXW2S2EPN5DCDAKX2FKVXT3GU5PN4C3CW43WFWRHUPQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.744997753 (82h9m45.442566079s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.746659848 (82h9m45.444228164s) [noise=true , address=81.171.14.70:4035 , piece_id=OWBJGEQGTSCR3FYNAOG424BCWICLOH6SUWPXOE7HHA454ZGM5JBA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.748622674 (82h9m45.446191s) [noise=true , address=89.149.201.147:4021 , piece_id=XVSL373IQK3EJ5ROTEA4ATRFTFS7YRRVUEHHN4V76MGSI32AC2EQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:58.224081322 (82h9m45.921649628s) [upload=72097]: Next returned nil segment Dec 9 01:38:58.224089837 (82h9m45.921658144s) [upload=72097]: Waiting for error group managing segments... Dec 9 01:38:58.431307515 (82h9m46.128875821s) [noise=true , address=89.149.201.147:4005 , piece_id=N5SDW7MVGXA27OYRAT6PRV3QZ7EGRAQWM56BIH6ELSUHJMG4VMUQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.431749651 (82h9m46.129317997s) [noise=true , address=81.171.14.70:4037 , piece_id=K2IE5MXBWGN5LIDT5EBAB42REHN7H4IIGA34NZWNYZXKQGEEMGRQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.490273164 (82h9m46.1878415s) [noise=true , address=89.149.201.147:4014 , piece_id=RMGYDI27Y4M7Z7VV5PTCP5TGCFYQVRFXRKDSKHN7J6HDQP5W3GFA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.502770258 (82h9m46.200338564s) [noise=true , address=89.149.201.147:4020 , piece_id=5LEKKWXSJDXKUYRK7XXK2NIAYEYD36VNCFKTQGJQWGNUKHWBQ7WQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.778274576 (82h9m46.475842912s) [noise=true , address=81.171.14.70:4029 , piece_id=QCPC46W4FFKFED4YRW7D2FPO3XZ4PTE4JWGLOZDDM6TGSXIJLKLA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.834300524 (82h9m46.53186887s) [noise=true , address=185.167.204.206:4056 , piece_id=UY6RJOJYQIMOXSJA6IF52U73TR3EXMXWA6NMZQPJZHT4KOK5ECCQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.904869168 (82h9m46.602437484s) [noise=true , address=81.171.14.70:4045 , piece_id=5MCTULWWE4YX7MIRQK4J6FTJDGW5XLPNPUZDQ2CBRC7MD4MV7AJQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.913844133 (82h9m46.61141248s) [noise=true , address=89.149.201.147:4021 , piece_id=XVSL373IQK3EJ5ROTEA4ATRFTFS7YRRVUEHHN4V76MGSI32AC2EQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.919030171 (82h9m46.616598477s) [noise=true , address=185.167.204.205:4036 , piece_id=GQOYZKTDS3K3XGEOOINJTN767EQXG23JOFYF226DJYEJNETDJ2BQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.932451492 (82h9m46.630019828s) [noise=true , address=185.167.204.205:4010 , piece_id=V54JRAIPTAHE5MCGQUNSBJUJ5TK5EXOJC2GC4AIHPXUYUMLGE2ZQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.943222923 (82h9m46.640791229s) [noise=true , address=89.149.201.147:4009 , piece_id=6UNPJCAZ5WYFTLWCRZU2FAPN4DVBV57ZP7KYXW26NMG2TSSVRUDA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.960077819 (82h9m46.657646155s) [noise=true , address=81.171.14.70:4032 , piece_id=SEPKDP35H3TQKSSXXKJKYL4ORU4TESWYCGLHPSGFHBBWW76WP5MA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.032398786 (82h9m46.729967102s) [noise=true , address=81.171.14.70:4028 , piece_id=SM75T7PBZ54GWI35ANTK343OL5B6VOVAIL77NPTKPMJO342JFHVA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.057203271 (82h9m46.754771587s) [noise=true , address=185.167.204.205:4023 , piece_id=UPFQ4BTO3RXW2S2EPN5DCDAKX2FKVXT3GU5PN4C3CW43WFWRHUPQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.081058494 (82h9m46.77862682s) [noise=true , address=185.167.204.206:4055 , piece_id=TK6CZLA3NXDZX5RLSK4H3GGEPNXZ2GDZ2CGI2OZ7B4TPP6AR7DHA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.112142418 (82h9m46.809710755s) [noise=true , address=185.167.204.205:4018 , piece_id=SNDUUOXX7WBTLKDHPB65A4WTFJ7PC6XRHPRENQ6KMOIPM4E5MSKA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.531727623 (82h9m47.229295959s) [noise=true , address=185.167.204.205:4012 , piece_id=4V2U6G2XVPFRZOEGLMVY6JNZFZ3BZ3QBIQWL47TXB3YK4DJIJ34A, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.534328111 (82h9m47.231896438s) [noise=true , address=89.149.201.147:4017 , piece_id=KA54SKQCIIIQSGHLZBBR7EWVKD5QJHX756BKLRXMPDJ6WDJR5YBQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.719679832 (82h9m47.417248168s) [noise=true , address=81.171.14.70:4035 , piece_id=OWBJGEQGTSCR3FYNAOG424BCWICLOH6SUWPXOE7HHA454ZGM5JBA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.724123352 (82h9m47.421691688s) [noise=true , address=89.149.201.147:4018 , piece_id=NHYZ3WXHU4QMPG37K4I3BH5K22GCY7WDUGXL7O4PEB225KKEC6HQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.786813169 (82h9m47.484381505s) [noise=true , address=81.171.14.70:4038 , piece_id=CCN4X2R6HMAC5IFPL5POH66QHXRZWHASDYWE2KEVVO64BIGD4OBA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.828658967 (82h9m47.526227304s) [noise=true , address=81.171.14.70:4033 , piece_id=JRVTZECOZWQGJJHTASK2G3BODS4AZ2XVE45YYXT2GPCMWFHSICCA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.250467174 (82h9m47.94803549s) [noise=true , address=185.167.204.205:4033 , piece_id=IPKHWYQBK33AEFC3UVAYGTS2VD3YY27P3NRZNWD7E2KGCECB3ERQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.328214947 (82h9m48.025783253s) [noise=true , address=81.171.14.70:4047 , piece_id=K66YL34O4IFTJV3RBEXZDERYJTAGAPXCNODECGD23QQNOAXVBM5A, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.360647713 (82h9m48.058216029s) [noise=true , address=185.167.204.206:4069 , piece_id=H6SQBPSIZ25KBJMBNIMDPZCXHEH7JQVXXGZQIDM2NUZDYRYO5QUA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.775238387 (82h9m48.472806723s) [noise=true , address=185.167.204.206:4047 , piece_id=NW47TPJDWAKL676HMJYU324HO75EEOIHMOPMS5PQYLEKYOMBWZUA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.775263474 (82h9m48.47283182s) [seg_pos={0 0}, upload=72097]: Segment reached optimal threshold of 26 pieces. Dec 9 01:39:00.775563294 (82h9m48.47313163s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61): protocol: expected piece hash; context canceled; EOF Dec 9 01:39:00.775653142 (82h9m48.473221478s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Long tail cancellation due to optimal threshold Dec 9 01:39:00.775734835 (82h9m48.473303141s) [noise=true , address=81.171.14.70:4039 , piece_id=74L4VSJSG47MCVTLP3CAU4PRQS5OSPKKTCNADR4T7HYJIOLTUQYQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 9 01:39:00.775749791 (82h9m48.473318108s) [noise=true , address=81.171.14.70:4039 , piece_id=74L4VSJSG47MCVTLP3CAU4PRQS5OSPKKTCNADR4T7HYJIOLTUQYQ, seg_pos={0 0}, upload=72097]: Long tail cancellation due to optimal threshold Dec 9 01:39:00.775771663 (82h9m48.473339969s) [seg_pos={0 0}, upload=72097]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:39:00.775860019 (82h9m48.473428335s) [upload=72097]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:39:00.775864196 (82h9m48.473432502s) [upload=72097]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:39:00.924498628 (82h9m48.622066934s) [upload=72097]: Done uploading segments... Dec 9 01:39:00.924511733 (82h9m48.622080038s) [upload=72097]: Upload finished. err: <nil> Duration: 46.499360982s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 15 out of 60 is failed (threshold=3) [..X.X.......X...X.....X.X.X...X...X..X.X..X......X..X.....X.] duration: 4.709433357s trace: https://jaeger.dev.storj.io/trace/7c6bdd8bee4bfc0e FAIL (2025-12-09 01:39:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 733831955 (82h9m45.431400291s) [noise=true , address=81.171.14.70:4033 , piece_id=JRVTZECOZWQGJJHTASK2G3BODS4AZ2XVE45YYXT2GPCMWFHSICCA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.734987704 (82h9m45.43255604s) [noise=true , address=185.167.204.205:4036 , piece_id=GQOYZKTDS3K3XGEOOINJTN767EQXG23JOFYF226DJYEJNETDJ2BQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.736018750 (82h9m45.433587077s) [noise=true , address=81.171.14.70:4028 , piece_id=SM75T7PBZ54GWI35ANTK343OL5B6VOVAIL77NPTKPMJO342JFHVA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.738080051 (82h9m45.435648377s) [noise=true , address=185.167.204.206:4047 , piece_id=NW47TPJDWAKL676HMJYU324HO75EEOIHMOPMS5PQYLEKYOMBWZUA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.740009845 (82h9m45.437578181s) [noise=true , address=185.167.204.205:4033 , piece_id=IPKHWYQBK33AEFC3UVAYGTS2VD3YY27P3NRZNWD7E2KGCECB3ERQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.740258349 (82h9m45.437826685s) [noise=true , address=89.149.201.147:4005 , piece_id=N5SDW7MVGXA27OYRAT6PRV3QZ7EGRAQWM56BIH6ELSUHJMG4VMUQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.741865852 (82h9m45.439434188s) [noise=true , address=185.167.204.205:4010 , piece_id=V54JRAIPTAHE5MCGQUNSBJUJ5TK5EXOJC2GC4AIHPXUYUMLGE2ZQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.742709749 (82h9m45.440278084s) [noise=true , address=185.167.204.205:4023 , piece_id=UPFQ4BTO3RXW2S2EPN5DCDAKX2FKVXT3GU5PN4C3CW43WFWRHUPQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.744997753 (82h9m45.442566079s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.746659848 (82h9m45.444228164s) [noise=true , address=81.171.14.70:4035 , piece_id=OWBJGEQGTSCR3FYNAOG424BCWICLOH6SUWPXOE7HHA454ZGM5JBA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.748622674 (82h9m45.446191s) [noise=true , address=89.149.201.147:4021 , piece_id=XVSL373IQK3EJ5ROTEA4ATRFTFS7YRRVUEHHN4V76MGSI32AC2EQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:58.224081322 (82h9m45.921649628s) [upload=72097]: Next returned nil segment Dec 9 01:38:58.224089837 (82h9m45.921658144s) [upload=72097]: Waiting for error group managing segments... Dec 9 01:38:58.431307515 (82h9m46.128875821s) [noise=true , address=89.149.201.147:4005 , piece_id=N5SDW7MVGXA27OYRAT6PRV3QZ7EGRAQWM56BIH6ELSUHJMG4VMUQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.431749651 (82h9m46.129317997s) [noise=true , address=81.171.14.70:4037 , piece_id=K2IE5MXBWGN5LIDT5EBAB42REHN7H4IIGA34NZWNYZXKQGEEMGRQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.490273164 (82h9m46.1878415s) [noise=true , address=89.149.201.147:4014 , piece_id=RMGYDI27Y4M7Z7VV5PTCP5TGCFYQVRFXRKDSKHN7J6HDQP5W3GFA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.502770258 (82h9m46.200338564s) [noise=true , address=89.149.201.147:4020 , piece_id=5LEKKWXSJDXKUYRK7XXK2NIAYEYD36VNCFKTQGJQWGNUKHWBQ7WQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.778274576 (82h9m46.475842912s) [noise=true , address=81.171.14.70:4029 , piece_id=QCPC46W4FFKFED4YRW7D2FPO3XZ4PTE4JWGLOZDDM6TGSXIJLKLA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.834300524 (82h9m46.53186887s) [noise=true , address=185.167.204.206:4056 , piece_id=UY6RJOJYQIMOXSJA6IF52U73TR3EXMXWA6NMZQPJZHT4KOK5ECCQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.904869168 (82h9m46.602437484s) [noise=true , address=81.171.14.70:4045 , piece_id=5MCTULWWE4YX7MIRQK4J6FTJDGW5XLPNPUZDQ2CBRC7MD4MV7AJQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.913844133 (82h9m46.61141248s) [noise=true , address=89.149.201.147:4021 , piece_id=XVSL373IQK3EJ5ROTEA4ATRFTFS7YRRVUEHHN4V76MGSI32AC2EQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.919030171 (82h9m46.616598477s) [noise=true , address=185.167.204.205:4036 , piece_id=GQOYZKTDS3K3XGEOOINJTN767EQXG23JOFYF226DJYEJNETDJ2BQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.932451492 (82h9m46.630019828s) [noise=true , address=185.167.204.205:4010 , piece_id=V54JRAIPTAHE5MCGQUNSBJUJ5TK5EXOJC2GC4AIHPXUYUMLGE2ZQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.943222923 (82h9m46.640791229s) [noise=true , address=89.149.201.147:4009 , piece_id=6UNPJCAZ5WYFTLWCRZU2FAPN4DVBV57ZP7KYXW26NMG2TSSVRUDA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.960077819 (82h9m46.657646155s) [noise=true , address=81.171.14.70:4032 , piece_id=SEPKDP35H3TQKSSXXKJKYL4ORU4TESWYCGLHPSGFHBBWW76WP5MA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.032398786 (82h9m46.729967102s) [noise=true , address=81.171.14.70:4028 , piece_id=SM75T7PBZ54GWI35ANTK343OL5B6VOVAIL77NPTKPMJO342JFHVA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.057203271 (82h9m46.754771587s) [noise=true , address=185.167.204.205:4023 , piece_id=UPFQ4BTO3RXW2S2EPN5DCDAKX2FKVXT3GU5PN4C3CW43WFWRHUPQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.081058494 (82h9m46.77862682s) [noise=true , address=185.167.204.206:4055 , piece_id=TK6CZLA3NXDZX5RLSK4H3GGEPNXZ2GDZ2CGI2OZ7B4TPP6AR7DHA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.112142418 (82h9m46.809710755s) [noise=true , address=185.167.204.205:4018 , piece_id=SNDUUOXX7WBTLKDHPB65A4WTFJ7PC6XRHPRENQ6KMOIPM4E5MSKA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.531727623 (82h9m47.229295959s) [noise=true , address=185.167.204.205:4012 , piece_id=4V2U6G2XVPFRZOEGLMVY6JNZFZ3BZ3QBIQWL47TXB3YK4DJIJ34A, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.534328111 (82h9m47.231896438s) [noise=true , address=89.149.201.147:4017 , piece_id=KA54SKQCIIIQSGHLZBBR7EWVKD5QJHX756BKLRXMPDJ6WDJR5YBQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.719679832 (82h9m47.417248168s) [noise=true , address=81.171.14.70:4035 , piece_id=OWBJGEQGTSCR3FYNAOG424BCWICLOH6SUWPXOE7HHA454ZGM5JBA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.724123352 (82h9m47.421691688s) [noise=true , address=89.149.201.147:4018 , piece_id=NHYZ3WXHU4QMPG37K4I3BH5K22GCY7WDUGXL7O4PEB225KKEC6HQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.786813169 (82h9m47.484381505s) [noise=true , address=81.171.14.70:4038 , piece_id=CCN4X2R6HMAC5IFPL5POH66QHXRZWHASDYWE2KEVVO64BIGD4OBA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.828658967 (82h9m47.526227304s) [noise=true , address=81.171.14.70:4033 , piece_id=JRVTZECOZWQGJJHTASK2G3BODS4AZ2XVE45YYXT2GPCMWFHSICCA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.250467174 (82h9m47.94803549s) [noise=true , address=185.167.204.205:4033 , piece_id=IPKHWYQBK33AEFC3UVAYGTS2VD3YY27P3NRZNWD7E2KGCECB3ERQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.328214947 (82h9m48.025783253s) [noise=true , address=81.171.14.70:4047 , piece_id=K66YL34O4IFTJV3RBEXZDERYJTAGAPXCNODECGD23QQNOAXVBM5A, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.360647713 (82h9m48.058216029s) [noise=true , address=185.167.204.206:4069 , piece_id=H6SQBPSIZ25KBJMBNIMDPZCXHEH7JQVXXGZQIDM2NUZDYRYO5QUA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.775238387 (82h9m48.472806723s) [noise=true , address=185.167.204.206:4047 , piece_id=NW47TPJDWAKL676HMJYU324HO75EEOIHMOPMS5PQYLEKYOMBWZUA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.775263474 (82h9m48.47283182s) [seg_pos={0 0}, upload=72097]: Segment reached optimal threshold of 26 pieces. Dec 9 01:39:00.775563294 (82h9m48.47313163s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61): protocol: expected piece hash; context canceled; EOF Dec 9 01:39:00.775653142 (82h9m48.473221478s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Long tail cancellation due to optimal threshold Dec 9 01:39:00.775734835 (82h9m48.473303141s) [noise=true , address=81.171.14.70:4039 , piece_id=74L4VSJSG47MCVTLP3CAU4PRQS5OSPKKTCNADR4T7HYJIOLTUQYQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 9 01:39:00.775749791 (82h9m48.473318108s) [noise=true , address=81.171.14.70:4039 , piece_id=74L4VSJSG47MCVTLP3CAU4PRQS5OSPKKTCNADR4T7HYJIOLTUQYQ, seg_pos={0 0}, upload=72097]: Long tail cancellation due to optimal threshold Dec 9 01:39:00.775771663 (82h9m48.473339969s) [seg_pos={0 0}, upload=72097]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:39:00.775860019 (82h9m48.473428335s) [upload=72097]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:39:00.775864196 (82h9m48.473432502s) [upload=72097]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:39:00.924498628 (82h9m48.622066934s) [upload=72097]: Done uploading segments... Dec 9 01:39:00.924511733 (82h9m48.622080038s) [upload=72097]: Upload finished. err: <nil> Duration: 4.70945069s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 15 out of 60 is failed (threshold=3) [...X.X.......X...X.....X.X.X...X...X..X.X..X......X..X.....X] duration: 32.021559823s trace: https://jaeger.dev.storj.io/trace/7c6bdd8bee4bfc0e FAIL (2025-12-09 01:39:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 733831955 (82h9m45.431400291s) [noise=true , address=81.171.14.70:4033 , piece_id=JRVTZECOZWQGJJHTASK2G3BODS4AZ2XVE45YYXT2GPCMWFHSICCA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.734987704 (82h9m45.43255604s) [noise=true , address=185.167.204.205:4036 , piece_id=GQOYZKTDS3K3XGEOOINJTN767EQXG23JOFYF226DJYEJNETDJ2BQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.736018750 (82h9m45.433587077s) [noise=true , address=81.171.14.70:4028 , piece_id=SM75T7PBZ54GWI35ANTK343OL5B6VOVAIL77NPTKPMJO342JFHVA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.738080051 (82h9m45.435648377s) [noise=true , address=185.167.204.206:4047 , piece_id=NW47TPJDWAKL676HMJYU324HO75EEOIHMOPMS5PQYLEKYOMBWZUA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.740009845 (82h9m45.437578181s) [noise=true , address=185.167.204.205:4033 , piece_id=IPKHWYQBK33AEFC3UVAYGTS2VD3YY27P3NRZNWD7E2KGCECB3ERQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.740258349 (82h9m45.437826685s) [noise=true , address=89.149.201.147:4005 , piece_id=N5SDW7MVGXA27OYRAT6PRV3QZ7EGRAQWM56BIH6ELSUHJMG4VMUQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.741865852 (82h9m45.439434188s) [noise=true , address=185.167.204.205:4010 , piece_id=V54JRAIPTAHE5MCGQUNSBJUJ5TK5EXOJC2GC4AIHPXUYUMLGE2ZQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.742709749 (82h9m45.440278084s) [noise=true , address=185.167.204.205:4023 , piece_id=UPFQ4BTO3RXW2S2EPN5DCDAKX2FKVXT3GU5PN4C3CW43WFWRHUPQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.744997753 (82h9m45.442566079s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.746659848 (82h9m45.444228164s) [noise=true , address=81.171.14.70:4035 , piece_id=OWBJGEQGTSCR3FYNAOG424BCWICLOH6SUWPXOE7HHA454ZGM5JBA, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:57.748622674 (82h9m45.446191s) [noise=true , address=89.149.201.147:4021 , piece_id=XVSL373IQK3EJ5ROTEA4ATRFTFS7YRRVUEHHN4V76MGSI32AC2EQ, seg_pos={0 0}, upload=72097]: Uploading piece... Dec 9 01:38:58.224081322 (82h9m45.921649628s) [upload=72097]: Next returned nil segment Dec 9 01:38:58.224089837 (82h9m45.921658144s) [upload=72097]: Waiting for error group managing segments... Dec 9 01:38:58.431307515 (82h9m46.128875821s) [noise=true , address=89.149.201.147:4005 , piece_id=N5SDW7MVGXA27OYRAT6PRV3QZ7EGRAQWM56BIH6ELSUHJMG4VMUQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.431749651 (82h9m46.129317997s) [noise=true , address=81.171.14.70:4037 , piece_id=K2IE5MXBWGN5LIDT5EBAB42REHN7H4IIGA34NZWNYZXKQGEEMGRQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.490273164 (82h9m46.1878415s) [noise=true , address=89.149.201.147:4014 , piece_id=RMGYDI27Y4M7Z7VV5PTCP5TGCFYQVRFXRKDSKHN7J6HDQP5W3GFA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.502770258 (82h9m46.200338564s) [noise=true , address=89.149.201.147:4020 , piece_id=5LEKKWXSJDXKUYRK7XXK2NIAYEYD36VNCFKTQGJQWGNUKHWBQ7WQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.778274576 (82h9m46.475842912s) [noise=true , address=81.171.14.70:4029 , piece_id=QCPC46W4FFKFED4YRW7D2FPO3XZ4PTE4JWGLOZDDM6TGSXIJLKLA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.834300524 (82h9m46.53186887s) [noise=true , address=185.167.204.206:4056 , piece_id=UY6RJOJYQIMOXSJA6IF52U73TR3EXMXWA6NMZQPJZHT4KOK5ECCQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.904869168 (82h9m46.602437484s) [noise=true , address=81.171.14.70:4045 , piece_id=5MCTULWWE4YX7MIRQK4J6FTJDGW5XLPNPUZDQ2CBRC7MD4MV7AJQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.913844133 (82h9m46.61141248s) [noise=true , address=89.149.201.147:4021 , piece_id=XVSL373IQK3EJ5ROTEA4ATRFTFS7YRRVUEHHN4V76MGSI32AC2EQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.919030171 (82h9m46.616598477s) [noise=true , address=185.167.204.205:4036 , piece_id=GQOYZKTDS3K3XGEOOINJTN767EQXG23JOFYF226DJYEJNETDJ2BQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.932451492 (82h9m46.630019828s) [noise=true , address=185.167.204.205:4010 , piece_id=V54JRAIPTAHE5MCGQUNSBJUJ5TK5EXOJC2GC4AIHPXUYUMLGE2ZQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.943222923 (82h9m46.640791229s) [noise=true , address=89.149.201.147:4009 , piece_id=6UNPJCAZ5WYFTLWCRZU2FAPN4DVBV57ZP7KYXW26NMG2TSSVRUDA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:58.960077819 (82h9m46.657646155s) [noise=true , address=81.171.14.70:4032 , piece_id=SEPKDP35H3TQKSSXXKJKYL4ORU4TESWYCGLHPSGFHBBWW76WP5MA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.032398786 (82h9m46.729967102s) [noise=true , address=81.171.14.70:4028 , piece_id=SM75T7PBZ54GWI35ANTK343OL5B6VOVAIL77NPTKPMJO342JFHVA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.057203271 (82h9m46.754771587s) [noise=true , address=185.167.204.205:4023 , piece_id=UPFQ4BTO3RXW2S2EPN5DCDAKX2FKVXT3GU5PN4C3CW43WFWRHUPQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.081058494 (82h9m46.77862682s) [noise=true , address=185.167.204.206:4055 , piece_id=TK6CZLA3NXDZX5RLSK4H3GGEPNXZ2GDZ2CGI2OZ7B4TPP6AR7DHA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.112142418 (82h9m46.809710755s) [noise=true , address=185.167.204.205:4018 , piece_id=SNDUUOXX7WBTLKDHPB65A4WTFJ7PC6XRHPRENQ6KMOIPM4E5MSKA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.531727623 (82h9m47.229295959s) [noise=true , address=185.167.204.205:4012 , piece_id=4V2U6G2XVPFRZOEGLMVY6JNZFZ3BZ3QBIQWL47TXB3YK4DJIJ34A, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.534328111 (82h9m47.231896438s) [noise=true , address=89.149.201.147:4017 , piece_id=KA54SKQCIIIQSGHLZBBR7EWVKD5QJHX756BKLRXMPDJ6WDJR5YBQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.719679832 (82h9m47.417248168s) [noise=true , address=81.171.14.70:4035 , piece_id=OWBJGEQGTSCR3FYNAOG424BCWICLOH6SUWPXOE7HHA454ZGM5JBA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.724123352 (82h9m47.421691688s) [noise=true , address=89.149.201.147:4018 , piece_id=NHYZ3WXHU4QMPG37K4I3BH5K22GCY7WDUGXL7O4PEB225KKEC6HQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.786813169 (82h9m47.484381505s) [noise=true , address=81.171.14.70:4038 , piece_id=CCN4X2R6HMAC5IFPL5POH66QHXRZWHASDYWE2KEVVO64BIGD4OBA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:38:59.828658967 (82h9m47.526227304s) [noise=true , address=81.171.14.70:4033 , piece_id=JRVTZECOZWQGJJHTASK2G3BODS4AZ2XVE45YYXT2GPCMWFHSICCA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.250467174 (82h9m47.94803549s) [noise=true , address=185.167.204.205:4033 , piece_id=IPKHWYQBK33AEFC3UVAYGTS2VD3YY27P3NRZNWD7E2KGCECB3ERQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.328214947 (82h9m48.025783253s) [noise=true , address=81.171.14.70:4047 , piece_id=K66YL34O4IFTJV3RBEXZDERYJTAGAPXCNODECGD23QQNOAXVBM5A, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.360647713 (82h9m48.058216029s) [noise=true , address=185.167.204.206:4069 , piece_id=H6SQBPSIZ25KBJMBNIMDPZCXHEH7JQVXXGZQIDM2NUZDYRYO5QUA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.775238387 (82h9m48.472806723s) [noise=true , address=185.167.204.206:4047 , piece_id=NW47TPJDWAKL676HMJYU324HO75EEOIHMOPMS5PQYLEKYOMBWZUA, seg_pos={0 0}, upload=72097]: Done uploading piece. err: <nil> Dec 9 01:39:00.775263474 (82h9m48.47283182s) [seg_pos={0 0}, upload=72097]: Segment reached optimal threshold of 26 pieces. Dec 9 01:39:00.775563294 (82h9m48.47313163s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61): protocol: expected piece hash; context canceled; EOF Dec 9 01:39:00.775653142 (82h9m48.473221478s) [noise=true , address=185.167.204.205:4028 , piece_id=J3RZ5C4D6WEQQSUATTY5TJ2OBPIIIFMNQUYEFAWPVHNNLIFHPGZQ, seg_pos={0 0}, upload=72097]: Long tail cancellation due to optimal threshold Dec 9 01:39:00.775734835 (82h9m48.473303141s) [noise=true , address=81.171.14.70:4039 , piece_id=74L4VSJSG47MCVTLP3CAU4PRQS5OSPKKTCNADR4T7HYJIOLTUQYQ, seg_pos={0 0}, upload=72097]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC): protocol: expected piece hash; context canceled; EOF Dec 9 01:39:00.775749791 (82h9m48.473318108s) [noise=true , address=81.171.14.70:4039 , piece_id=74L4VSJSG47MCVTLP3CAU4PRQS5OSPKKTCNADR4T7HYJIOLTUQYQ, seg_pos={0 0}, upload=72097]: Long tail cancellation due to optimal threshold Dec 9 01:39:00.775771663 (82h9m48.473339969s) [seg_pos={0 0}, upload=72097]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:39:00.775860019 (82h9m48.473428335s) [upload=72097]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:39:00.775864196 (82h9m48.473432502s) [upload=72097]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:39:00.924498628 (82h9m48.622066934s) [upload=72097]: Done uploading segments... Dec 9 01:39:00.924511733 (82h9m48.622080038s) [upload=72097]: Upload finished. err: <nil> Duration: 32.021597633s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 14 out of 60 is failed (threshold=3) [....X.X.......X...X.....X.X.X...X...X..X.X..X......X..X.....] duration: 29.015064048s trace: https://jaeger.dev.storj.io/trace/519cb5a5cf852994 FAIL (2025-12-09 01:38:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 72034]: Uploading piece... Dec 9 01:34:17.294173911 (82h5m4.991742247s) [noise=true , address=81.171.14.70:4031 , piece_id=VMWGXG2SSYMHY5SORAGRBXLPUSUXNFLHXEZQOVL2KDISW3Q46T5A, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.294832581 (82h5m4.992400917s) [noise=true , address=89.149.201.147:4003 , piece_id=OJYZ3EV5OBQLGJEBXTV3KVDKFFG5NYF34SVHNJXNDKTFM3KYOT3A, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.295369924 (82h5m4.99293827s) [noise=true , address=185.167.204.206:4064 , piece_id=5JAZMICRVXSMHBYZAGLNGY6ZGYIZVBPLEDDTT74UP7XP4FBL3ZWQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.296070062 (82h5m4.993638398s) [noise=true , address=185.167.204.205:4028 , piece_id=ENT5PT3YUDVSZWHJVUTRSKXJLAGAXOIUVTVVTUZ2JQITJF3OA4PA, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.296991865 (82h5m4.9945602s) [noise=true , address=81.171.14.70:4028 , piece_id=RE3HAXNXHPZWF5V7MOI3B3USPJ5YEPWBSVNNWJPEZRESSJWIC45Q, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.298398622 (82h5m4.995966959s) [noise=true , address=89.149.201.147:4010 , piece_id=OSW7NQGAJNQKAGYKL6UGLO75PIZE75OSDTUTOPM6XEXVXRLOMOSQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.300072309 (82h5m4.997640645s) [noise=true , address=89.149.201.147:4020 , piece_id=IOBSCAS3T5VWF4AACXWE2L2QYJXNYZYK42CF7ZT3DAI43CHT5YXQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.301403756 (82h5m4.998972093s) [noise=true , address=185.167.204.206:4063 , piece_id=D2MEA7BEKS7QR63UD5BFYBLC6G426ZQ7QI5GWUKMF7PHW4OZOARQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.302419573 (82h5m4.99998791s) [noise=true , address=185.167.204.205:4022 , piece_id=KJERBQFKQTGBEOYQAKNEKVJL6PIX5KNOZBOWRXIQRO5KRTF7OJ6A, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.303831050 (82h5m5.001399396s) [noise=true , address=81.171.14.70:4040 , piece_id=L3I53NLQEU45XVCJXMVC6JUUG4KHA3XZMJPXV24YWAAMWWEEZMJA, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.304618061 (82h5m5.002186397s) [noise=true , address=81.171.14.70:4035 , piece_id=PMF2IYGSM3BAPJLYTLLKXEQBCBIZZTQR77CO7XJ75CUPTREWKKNQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.803237461 (82h5m5.500805768s) [upload=72034]: Next returned nil segment Dec 9 01:34:17.803246358 (82h5m5.500814664s) [upload=72034]: Waiting for error group managing segments... Dec 9 01:34:18.024412471 (82h5m5.721980787s) [noise=true , address=81.171.14.70:4039 , piece_id=377SOY73YS55CGF4ZQDTG6KB7QDZPDYBWLZ4BSF5DV3BFELJEQRA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.047649438 (82h5m5.745217754s) [noise=true , address=89.149.201.147:4010 , piece_id=OSW7NQGAJNQKAGYKL6UGLO75PIZE75OSDTUTOPM6XEXVXRLOMOSQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.062384955 (82h5m5.759953261s) [noise=true , address=185.167.204.205:4001 , piece_id=KBK3DRDGPNUIFVNARCAAUD6Y4VNQJPFUB4K52CISZLCUCE27MF2Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.079260248 (82h5m5.776828554s) [noise=true , address=81.171.14.70:4031 , piece_id=VMWGXG2SSYMHY5SORAGRBXLPUSUXNFLHXEZQOVL2KDISW3Q46T5A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.082634280 (82h5m5.780202596s) [noise=true , address=185.167.204.206:4063 , piece_id=D2MEA7BEKS7QR63UD5BFYBLC6G426ZQ7QI5GWUKMF7PHW4OZOARQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.399071283 (82h5m6.096639599s) [noise=true , address=185.167.204.205:4032 , piece_id=PYDU6O3J6TJDVVPF2ZTIPN4DUCSLRYAMHSOWEWJ7MCSMI5RMZP7Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.403770821 (82h5m6.101339137s) [noise=true , address=81.171.14.70:4040 , piece_id=L3I53NLQEU45XVCJXMVC6JUUG4KHA3XZMJPXV24YWAAMWWEEZMJA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.404858062 (82h5m6.102426378s) [noise=true , address=185.167.204.205:4013 , piece_id=WG3PXCHNEJWFKV4NRFMN7VCYUJVBMCJ65IVS5AYF36UAQGCUN3MA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.418075823 (82h5m6.115644139s) [noise=true , address=89.149.201.147:4020 , piece_id=IOBSCAS3T5VWF4AACXWE2L2QYJXNYZYK42CF7ZT3DAI43CHT5YXQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.431455867 (82h5m6.129024174s) [noise=true , address=185.167.204.206:4059 , piece_id=EZHEB6K2G24VVL2APK3HFC6JG4XHP373QRFFU6NQKUJQJQUSHSYQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.486763764 (82h5m6.18433207s) [noise=true , address=185.167.204.205:4029 , piece_id=KRQPYIQXASDBX3WGA5LOSDLUJFO626CNVTFA3LVYN22YMMTOM7DQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.499699628 (82h5m6.197267934s) [noise=true , address=89.149.201.147:4014 , piece_id=LGXYX62J565RRFUNMKYBZX33UO5TP4VGCI77FYQBFNUIEVZVUNQQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.521949441 (82h5m6.219517757s) [noise=true , address=185.167.204.206:4050 , piece_id=YCM3D5SXLWSM7L6FDBHTJYBI22OSKJAVQ3QPNQAXUDDVLTVWC6OQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.537474051 (82h5m6.235042367s) [noise=true , address=81.171.14.70:4047 , piece_id=SBD2YXIEFWNZMORDUHXG62VSC4ZCRR2HDP37X5BB4CNZGLGGJRGA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.588547407 (82h5m6.286115723s) [noise=true , address=89.149.201.147:4003 , piece_id=OJYZ3EV5OBQLGJEBXTV3KVDKFFG5NYF34SVHNJXNDKTFM3KYOT3A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.636045044 (82h5m6.33361336s) [noise=true , address=89.149.201.147:4011 , piece_id=7DCCHD44M3IZ7NRBKLQWRJWQVFQZEBRWHC5XON6U5GSZE7O56VZQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.816644769 (82h5m6.514213085s) [noise=true , address=185.167.204.205:4022 , piece_id=KJERBQFKQTGBEOYQAKNEKVJL6PIX5KNOZBOWRXIQRO5KRTF7OJ6A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.826196301 (82h5m6.523764617s) [noise=true , address=185.167.204.206:4064 , piece_id=5JAZMICRVXSMHBYZAGLNGY6ZGYIZVBPLEDDTT74UP7XP4FBL3ZWQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.040531373 (82h5m6.738099689s) [noise=true , address=185.167.204.205:4028 , piece_id=ENT5PT3YUDVSZWHJVUTRSKXJLAGAXOIUVTVVTUZ2JQITJF3OA4PA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.109718766 (82h5m6.807287072s) [noise=true , address=89.149.201.147:4019 , piece_id=6X3HD5X4CJZK4XLLLYBU7YGDRVNMRKSAVAMENDCNMFNQOCSI77YQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.136232996 (82h5m6.833801312s) [noise=true , address=81.171.14.70:4032 , piece_id=QOPQAJPCLPA277YBEXGZMRKKUAQDLP4DJVURFKSLB3LDKKQALPNA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.219893776 (82h5m6.917462092s) [noise=true , address=81.171.14.70:4029 , piece_id=CTGZOQIAECAYZAEVZGFHVPQOOGTXLRK47BPFUJF6LNJXZ7WCPYLQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.584338075 (82h5m7.281906411s) [noise=true , address=81.171.14.70:4028 , piece_id=RE3HAXNXHPZWF5V7MOI3B3USPJ5YEPWBSVNNWJPEZRESSJWIC45Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.797344046 (82h5m7.494912392s) [noise=true , address=81.171.14.70:4048 , piece_id=ZLRG4RFWN5Y43Y4I6R5WFZWBK6VQHDAIK3FJLJWDNVJP7E6UEPJQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.858541855 (82h5m7.55611019s) [noise=true , address=81.171.14.70:4041 , piece_id=RFQ3WZLWVA6SZTMTLYK54CZA3PHGKCPX4KPRA7HCIK7JLRTOFOTQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:20.987056725 (82h5m8.684625031s) [noise=true , address=81.171.14.70:4045 , piece_id=A6WM37OUZBQL5NERDYQLNSFTHARTRZ5LY225RSKWE4WG4FUIKC3Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:20.987071533 (82h5m8.684639849s) [seg_pos={0 0}, upload=72034]: Segment reached optimal threshold of 26 pieces. Dec 9 01:34:20.987234247 (82h5m8.684802563s) [noise=true , address=185.167.204.206:4049 , piece_id=6BRINFJE7YAIJCRH2BDHWGWWZZXLU4RD7GRO3W55JOKP3Y4AUN4A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM): protocol: expected piece hash; context canceled; EOF Dec 9 01:34:20.987240819 (82h5m8.684809125s) [noise=true , address=185.167.204.206:4049 , piece_id=6BRINFJE7YAIJCRH2BDHWGWWZZXLU4RD7GRO3W55JOKP3Y4AUN4A, seg_pos={0 0}, upload=72034]: Long tail cancellation due to optimal threshold Dec 9 01:34:20.987324134 (82h5m8.684892441s) [noise=true , address=81.171.14.70:4035 , piece_id=PMF2IYGSM3BAPJLYTLLKXEQBCBIZZTQR77CO7XJ75CUPTREWKKNQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA): protocol: expected piece hash; context canceled; EOF Dec 9 01:34:20.987328543 (82h5m8.684896849s) [noise=true , address=81.171.14.70:4035 , piece_id=PMF2IYGSM3BAPJLYTLLKXEQBCBIZZTQR77CO7XJ75CUPTREWKKNQ, seg_pos={0 0}, upload=72034]: Long tail cancellation due to optimal threshold Dec 9 01:34:20.987341026 (82h5m8.684909332s) [seg_pos={0 0}, upload=72034]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:34:20.987400196 (82h5m8.684968502s) [upload=72034]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:34:20.987403793 (82h5m8.684972109s) [upload=72034]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:34:21.138199254 (82h5m8.83576757s) [upload=72034]: Done uploading segments... Dec 9 01:34:21.138213260 (82h5m8.835781566s) [upload=72034]: Upload finished. err: <nil> Duration: 29.01508095s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 14 out of 60 is failed (threshold=3) [.....X.X.......X...X.....X.X.X...X...X..X.X..X......X..X....] duration: 5.802768539s trace: https://jaeger.dev.storj.io/trace/519cb5a5cf852994 FAIL (2025-12-09 01:37:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 72034]: Uploading piece... Dec 9 01:34:17.294173911 (82h5m4.991742247s) [noise=true , address=81.171.14.70:4031 , piece_id=VMWGXG2SSYMHY5SORAGRBXLPUSUXNFLHXEZQOVL2KDISW3Q46T5A, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.294832581 (82h5m4.992400917s) [noise=true , address=89.149.201.147:4003 , piece_id=OJYZ3EV5OBQLGJEBXTV3KVDKFFG5NYF34SVHNJXNDKTFM3KYOT3A, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.295369924 (82h5m4.99293827s) [noise=true , address=185.167.204.206:4064 , piece_id=5JAZMICRVXSMHBYZAGLNGY6ZGYIZVBPLEDDTT74UP7XP4FBL3ZWQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.296070062 (82h5m4.993638398s) [noise=true , address=185.167.204.205:4028 , piece_id=ENT5PT3YUDVSZWHJVUTRSKXJLAGAXOIUVTVVTUZ2JQITJF3OA4PA, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.296991865 (82h5m4.9945602s) [noise=true , address=81.171.14.70:4028 , piece_id=RE3HAXNXHPZWF5V7MOI3B3USPJ5YEPWBSVNNWJPEZRESSJWIC45Q, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.298398622 (82h5m4.995966959s) [noise=true , address=89.149.201.147:4010 , piece_id=OSW7NQGAJNQKAGYKL6UGLO75PIZE75OSDTUTOPM6XEXVXRLOMOSQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.300072309 (82h5m4.997640645s) [noise=true , address=89.149.201.147:4020 , piece_id=IOBSCAS3T5VWF4AACXWE2L2QYJXNYZYK42CF7ZT3DAI43CHT5YXQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.301403756 (82h5m4.998972093s) [noise=true , address=185.167.204.206:4063 , piece_id=D2MEA7BEKS7QR63UD5BFYBLC6G426ZQ7QI5GWUKMF7PHW4OZOARQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.302419573 (82h5m4.99998791s) [noise=true , address=185.167.204.205:4022 , piece_id=KJERBQFKQTGBEOYQAKNEKVJL6PIX5KNOZBOWRXIQRO5KRTF7OJ6A, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.303831050 (82h5m5.001399396s) [noise=true , address=81.171.14.70:4040 , piece_id=L3I53NLQEU45XVCJXMVC6JUUG4KHA3XZMJPXV24YWAAMWWEEZMJA, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.304618061 (82h5m5.002186397s) [noise=true , address=81.171.14.70:4035 , piece_id=PMF2IYGSM3BAPJLYTLLKXEQBCBIZZTQR77CO7XJ75CUPTREWKKNQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.803237461 (82h5m5.500805768s) [upload=72034]: Next returned nil segment Dec 9 01:34:17.803246358 (82h5m5.500814664s) [upload=72034]: Waiting for error group managing segments... Dec 9 01:34:18.024412471 (82h5m5.721980787s) [noise=true , address=81.171.14.70:4039 , piece_id=377SOY73YS55CGF4ZQDTG6KB7QDZPDYBWLZ4BSF5DV3BFELJEQRA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.047649438 (82h5m5.745217754s) [noise=true , address=89.149.201.147:4010 , piece_id=OSW7NQGAJNQKAGYKL6UGLO75PIZE75OSDTUTOPM6XEXVXRLOMOSQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.062384955 (82h5m5.759953261s) [noise=true , address=185.167.204.205:4001 , piece_id=KBK3DRDGPNUIFVNARCAAUD6Y4VNQJPFUB4K52CISZLCUCE27MF2Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.079260248 (82h5m5.776828554s) [noise=true , address=81.171.14.70:4031 , piece_id=VMWGXG2SSYMHY5SORAGRBXLPUSUXNFLHXEZQOVL2KDISW3Q46T5A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.082634280 (82h5m5.780202596s) [noise=true , address=185.167.204.206:4063 , piece_id=D2MEA7BEKS7QR63UD5BFYBLC6G426ZQ7QI5GWUKMF7PHW4OZOARQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.399071283 (82h5m6.096639599s) [noise=true , address=185.167.204.205:4032 , piece_id=PYDU6O3J6TJDVVPF2ZTIPN4DUCSLRYAMHSOWEWJ7MCSMI5RMZP7Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.403770821 (82h5m6.101339137s) [noise=true , address=81.171.14.70:4040 , piece_id=L3I53NLQEU45XVCJXMVC6JUUG4KHA3XZMJPXV24YWAAMWWEEZMJA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.404858062 (82h5m6.102426378s) [noise=true , address=185.167.204.205:4013 , piece_id=WG3PXCHNEJWFKV4NRFMN7VCYUJVBMCJ65IVS5AYF36UAQGCUN3MA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.418075823 (82h5m6.115644139s) [noise=true , address=89.149.201.147:4020 , piece_id=IOBSCAS3T5VWF4AACXWE2L2QYJXNYZYK42CF7ZT3DAI43CHT5YXQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.431455867 (82h5m6.129024174s) [noise=true , address=185.167.204.206:4059 , piece_id=EZHEB6K2G24VVL2APK3HFC6JG4XHP373QRFFU6NQKUJQJQUSHSYQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.486763764 (82h5m6.18433207s) [noise=true , address=185.167.204.205:4029 , piece_id=KRQPYIQXASDBX3WGA5LOSDLUJFO626CNVTFA3LVYN22YMMTOM7DQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.499699628 (82h5m6.197267934s) [noise=true , address=89.149.201.147:4014 , piece_id=LGXYX62J565RRFUNMKYBZX33UO5TP4VGCI77FYQBFNUIEVZVUNQQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.521949441 (82h5m6.219517757s) [noise=true , address=185.167.204.206:4050 , piece_id=YCM3D5SXLWSM7L6FDBHTJYBI22OSKJAVQ3QPNQAXUDDVLTVWC6OQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.537474051 (82h5m6.235042367s) [noise=true , address=81.171.14.70:4047 , piece_id=SBD2YXIEFWNZMORDUHXG62VSC4ZCRR2HDP37X5BB4CNZGLGGJRGA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.588547407 (82h5m6.286115723s) [noise=true , address=89.149.201.147:4003 , piece_id=OJYZ3EV5OBQLGJEBXTV3KVDKFFG5NYF34SVHNJXNDKTFM3KYOT3A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.636045044 (82h5m6.33361336s) [noise=true , address=89.149.201.147:4011 , piece_id=7DCCHD44M3IZ7NRBKLQWRJWQVFQZEBRWHC5XON6U5GSZE7O56VZQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.816644769 (82h5m6.514213085s) [noise=true , address=185.167.204.205:4022 , piece_id=KJERBQFKQTGBEOYQAKNEKVJL6PIX5KNOZBOWRXIQRO5KRTF7OJ6A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.826196301 (82h5m6.523764617s) [noise=true , address=185.167.204.206:4064 , piece_id=5JAZMICRVXSMHBYZAGLNGY6ZGYIZVBPLEDDTT74UP7XP4FBL3ZWQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.040531373 (82h5m6.738099689s) [noise=true , address=185.167.204.205:4028 , piece_id=ENT5PT3YUDVSZWHJVUTRSKXJLAGAXOIUVTVVTUZ2JQITJF3OA4PA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.109718766 (82h5m6.807287072s) [noise=true , address=89.149.201.147:4019 , piece_id=6X3HD5X4CJZK4XLLLYBU7YGDRVNMRKSAVAMENDCNMFNQOCSI77YQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.136232996 (82h5m6.833801312s) [noise=true , address=81.171.14.70:4032 , piece_id=QOPQAJPCLPA277YBEXGZMRKKUAQDLP4DJVURFKSLB3LDKKQALPNA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.219893776 (82h5m6.917462092s) [noise=true , address=81.171.14.70:4029 , piece_id=CTGZOQIAECAYZAEVZGFHVPQOOGTXLRK47BPFUJF6LNJXZ7WCPYLQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.584338075 (82h5m7.281906411s) [noise=true , address=81.171.14.70:4028 , piece_id=RE3HAXNXHPZWF5V7MOI3B3USPJ5YEPWBSVNNWJPEZRESSJWIC45Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.797344046 (82h5m7.494912392s) [noise=true , address=81.171.14.70:4048 , piece_id=ZLRG4RFWN5Y43Y4I6R5WFZWBK6VQHDAIK3FJLJWDNVJP7E6UEPJQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.858541855 (82h5m7.55611019s) [noise=true , address=81.171.14.70:4041 , piece_id=RFQ3WZLWVA6SZTMTLYK54CZA3PHGKCPX4KPRA7HCIK7JLRTOFOTQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:20.987056725 (82h5m8.684625031s) [noise=true , address=81.171.14.70:4045 , piece_id=A6WM37OUZBQL5NERDYQLNSFTHARTRZ5LY225RSKWE4WG4FUIKC3Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:20.987071533 (82h5m8.684639849s) [seg_pos={0 0}, upload=72034]: Segment reached optimal threshold of 26 pieces. Dec 9 01:34:20.987234247 (82h5m8.684802563s) [noise=true , address=185.167.204.206:4049 , piece_id=6BRINFJE7YAIJCRH2BDHWGWWZZXLU4RD7GRO3W55JOKP3Y4AUN4A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM): protocol: expected piece hash; context canceled; EOF Dec 9 01:34:20.987240819 (82h5m8.684809125s) [noise=true , address=185.167.204.206:4049 , piece_id=6BRINFJE7YAIJCRH2BDHWGWWZZXLU4RD7GRO3W55JOKP3Y4AUN4A, seg_pos={0 0}, upload=72034]: Long tail cancellation due to optimal threshold Dec 9 01:34:20.987324134 (82h5m8.684892441s) [noise=true , address=81.171.14.70:4035 , piece_id=PMF2IYGSM3BAPJLYTLLKXEQBCBIZZTQR77CO7XJ75CUPTREWKKNQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA): protocol: expected piece hash; context canceled; EOF Dec 9 01:34:20.987328543 (82h5m8.684896849s) [noise=true , address=81.171.14.70:4035 , piece_id=PMF2IYGSM3BAPJLYTLLKXEQBCBIZZTQR77CO7XJ75CUPTREWKKNQ, seg_pos={0 0}, upload=72034]: Long tail cancellation due to optimal threshold Dec 9 01:34:20.987341026 (82h5m8.684909332s) [seg_pos={0 0}, upload=72034]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:34:20.987400196 (82h5m8.684968502s) [upload=72034]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:34:20.987403793 (82h5m8.684972109s) [upload=72034]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:34:21.138199254 (82h5m8.83576757s) [upload=72034]: Done uploading segments... Dec 9 01:34:21.138213260 (82h5m8.835781566s) [upload=72034]: Upload finished. err: <nil> Duration: 5.802785871s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 15 out of 60 is failed (threshold=3) [X.....X.X.......X...X.....X.X.X...X...X..X.X..X......X..X...] duration: 9.688366299s trace: https://jaeger.dev.storj.io/trace/519cb5a5cf852994 FAIL (2025-12-09 01:36:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 72034]: Uploading piece... Dec 9 01:34:17.294173911 (82h5m4.991742247s) [noise=true , address=81.171.14.70:4031 , piece_id=VMWGXG2SSYMHY5SORAGRBXLPUSUXNFLHXEZQOVL2KDISW3Q46T5A, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.294832581 (82h5m4.992400917s) [noise=true , address=89.149.201.147:4003 , piece_id=OJYZ3EV5OBQLGJEBXTV3KVDKFFG5NYF34SVHNJXNDKTFM3KYOT3A, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.295369924 (82h5m4.99293827s) [noise=true , address=185.167.204.206:4064 , piece_id=5JAZMICRVXSMHBYZAGLNGY6ZGYIZVBPLEDDTT74UP7XP4FBL3ZWQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.296070062 (82h5m4.993638398s) [noise=true , address=185.167.204.205:4028 , piece_id=ENT5PT3YUDVSZWHJVUTRSKXJLAGAXOIUVTVVTUZ2JQITJF3OA4PA, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.296991865 (82h5m4.9945602s) [noise=true , address=81.171.14.70:4028 , piece_id=RE3HAXNXHPZWF5V7MOI3B3USPJ5YEPWBSVNNWJPEZRESSJWIC45Q, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.298398622 (82h5m4.995966959s) [noise=true , address=89.149.201.147:4010 , piece_id=OSW7NQGAJNQKAGYKL6UGLO75PIZE75OSDTUTOPM6XEXVXRLOMOSQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.300072309 (82h5m4.997640645s) [noise=true , address=89.149.201.147:4020 , piece_id=IOBSCAS3T5VWF4AACXWE2L2QYJXNYZYK42CF7ZT3DAI43CHT5YXQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.301403756 (82h5m4.998972093s) [noise=true , address=185.167.204.206:4063 , piece_id=D2MEA7BEKS7QR63UD5BFYBLC6G426ZQ7QI5GWUKMF7PHW4OZOARQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.302419573 (82h5m4.99998791s) [noise=true , address=185.167.204.205:4022 , piece_id=KJERBQFKQTGBEOYQAKNEKVJL6PIX5KNOZBOWRXIQRO5KRTF7OJ6A, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.303831050 (82h5m5.001399396s) [noise=true , address=81.171.14.70:4040 , piece_id=L3I53NLQEU45XVCJXMVC6JUUG4KHA3XZMJPXV24YWAAMWWEEZMJA, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.304618061 (82h5m5.002186397s) [noise=true , address=81.171.14.70:4035 , piece_id=PMF2IYGSM3BAPJLYTLLKXEQBCBIZZTQR77CO7XJ75CUPTREWKKNQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.803237461 (82h5m5.500805768s) [upload=72034]: Next returned nil segment Dec 9 01:34:17.803246358 (82h5m5.500814664s) [upload=72034]: Waiting for error group managing segments... Dec 9 01:34:18.024412471 (82h5m5.721980787s) [noise=true , address=81.171.14.70:4039 , piece_id=377SOY73YS55CGF4ZQDTG6KB7QDZPDYBWLZ4BSF5DV3BFELJEQRA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.047649438 (82h5m5.745217754s) [noise=true , address=89.149.201.147:4010 , piece_id=OSW7NQGAJNQKAGYKL6UGLO75PIZE75OSDTUTOPM6XEXVXRLOMOSQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.062384955 (82h5m5.759953261s) [noise=true , address=185.167.204.205:4001 , piece_id=KBK3DRDGPNUIFVNARCAAUD6Y4VNQJPFUB4K52CISZLCUCE27MF2Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.079260248 (82h5m5.776828554s) [noise=true , address=81.171.14.70:4031 , piece_id=VMWGXG2SSYMHY5SORAGRBXLPUSUXNFLHXEZQOVL2KDISW3Q46T5A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.082634280 (82h5m5.780202596s) [noise=true , address=185.167.204.206:4063 , piece_id=D2MEA7BEKS7QR63UD5BFYBLC6G426ZQ7QI5GWUKMF7PHW4OZOARQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.399071283 (82h5m6.096639599s) [noise=true , address=185.167.204.205:4032 , piece_id=PYDU6O3J6TJDVVPF2ZTIPN4DUCSLRYAMHSOWEWJ7MCSMI5RMZP7Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.403770821 (82h5m6.101339137s) [noise=true , address=81.171.14.70:4040 , piece_id=L3I53NLQEU45XVCJXMVC6JUUG4KHA3XZMJPXV24YWAAMWWEEZMJA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.404858062 (82h5m6.102426378s) [noise=true , address=185.167.204.205:4013 , piece_id=WG3PXCHNEJWFKV4NRFMN7VCYUJVBMCJ65IVS5AYF36UAQGCUN3MA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.418075823 (82h5m6.115644139s) [noise=true , address=89.149.201.147:4020 , piece_id=IOBSCAS3T5VWF4AACXWE2L2QYJXNYZYK42CF7ZT3DAI43CHT5YXQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.431455867 (82h5m6.129024174s) [noise=true , address=185.167.204.206:4059 , piece_id=EZHEB6K2G24VVL2APK3HFC6JG4XHP373QRFFU6NQKUJQJQUSHSYQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.486763764 (82h5m6.18433207s) [noise=true , address=185.167.204.205:4029 , piece_id=KRQPYIQXASDBX3WGA5LOSDLUJFO626CNVTFA3LVYN22YMMTOM7DQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.499699628 (82h5m6.197267934s) [noise=true , address=89.149.201.147:4014 , piece_id=LGXYX62J565RRFUNMKYBZX33UO5TP4VGCI77FYQBFNUIEVZVUNQQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.521949441 (82h5m6.219517757s) [noise=true , address=185.167.204.206:4050 , piece_id=YCM3D5SXLWSM7L6FDBHTJYBI22OSKJAVQ3QPNQAXUDDVLTVWC6OQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.537474051 (82h5m6.235042367s) [noise=true , address=81.171.14.70:4047 , piece_id=SBD2YXIEFWNZMORDUHXG62VSC4ZCRR2HDP37X5BB4CNZGLGGJRGA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.588547407 (82h5m6.286115723s) [noise=true , address=89.149.201.147:4003 , piece_id=OJYZ3EV5OBQLGJEBXTV3KVDKFFG5NYF34SVHNJXNDKTFM3KYOT3A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.636045044 (82h5m6.33361336s) [noise=true , address=89.149.201.147:4011 , piece_id=7DCCHD44M3IZ7NRBKLQWRJWQVFQZEBRWHC5XON6U5GSZE7O56VZQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.816644769 (82h5m6.514213085s) [noise=true , address=185.167.204.205:4022 , piece_id=KJERBQFKQTGBEOYQAKNEKVJL6PIX5KNOZBOWRXIQRO5KRTF7OJ6A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.826196301 (82h5m6.523764617s) [noise=true , address=185.167.204.206:4064 , piece_id=5JAZMICRVXSMHBYZAGLNGY6ZGYIZVBPLEDDTT74UP7XP4FBL3ZWQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.040531373 (82h5m6.738099689s) [noise=true , address=185.167.204.205:4028 , piece_id=ENT5PT3YUDVSZWHJVUTRSKXJLAGAXOIUVTVVTUZ2JQITJF3OA4PA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.109718766 (82h5m6.807287072s) [noise=true , address=89.149.201.147:4019 , piece_id=6X3HD5X4CJZK4XLLLYBU7YGDRVNMRKSAVAMENDCNMFNQOCSI77YQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.136232996 (82h5m6.833801312s) [noise=true , address=81.171.14.70:4032 , piece_id=QOPQAJPCLPA277YBEXGZMRKKUAQDLP4DJVURFKSLB3LDKKQALPNA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.219893776 (82h5m6.917462092s) [noise=true , address=81.171.14.70:4029 , piece_id=CTGZOQIAECAYZAEVZGFHVPQOOGTXLRK47BPFUJF6LNJXZ7WCPYLQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.584338075 (82h5m7.281906411s) [noise=true , address=81.171.14.70:4028 , piece_id=RE3HAXNXHPZWF5V7MOI3B3USPJ5YEPWBSVNNWJPEZRESSJWIC45Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.797344046 (82h5m7.494912392s) [noise=true , address=81.171.14.70:4048 , piece_id=ZLRG4RFWN5Y43Y4I6R5WFZWBK6VQHDAIK3FJLJWDNVJP7E6UEPJQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.858541855 (82h5m7.55611019s) [noise=true , address=81.171.14.70:4041 , piece_id=RFQ3WZLWVA6SZTMTLYK54CZA3PHGKCPX4KPRA7HCIK7JLRTOFOTQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:20.987056725 (82h5m8.684625031s) [noise=true , address=81.171.14.70:4045 , piece_id=A6WM37OUZBQL5NERDYQLNSFTHARTRZ5LY225RSKWE4WG4FUIKC3Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:20.987071533 (82h5m8.684639849s) [seg_pos={0 0}, upload=72034]: Segment reached optimal threshold of 26 pieces. Dec 9 01:34:20.987234247 (82h5m8.684802563s) [noise=true , address=185.167.204.206:4049 , piece_id=6BRINFJE7YAIJCRH2BDHWGWWZZXLU4RD7GRO3W55JOKP3Y4AUN4A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM): protocol: expected piece hash; context canceled; EOF Dec 9 01:34:20.987240819 (82h5m8.684809125s) [noise=true , address=185.167.204.206:4049 , piece_id=6BRINFJE7YAIJCRH2BDHWGWWZZXLU4RD7GRO3W55JOKP3Y4AUN4A, seg_pos={0 0}, upload=72034]: Long tail cancellation due to optimal threshold Dec 9 01:34:20.987324134 (82h5m8.684892441s) [noise=true , address=81.171.14.70:4035 , piece_id=PMF2IYGSM3BAPJLYTLLKXEQBCBIZZTQR77CO7XJ75CUPTREWKKNQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA): protocol: expected piece hash; context canceled; EOF Dec 9 01:34:20.987328543 (82h5m8.684896849s) [noise=true , address=81.171.14.70:4035 , piece_id=PMF2IYGSM3BAPJLYTLLKXEQBCBIZZTQR77CO7XJ75CUPTREWKKNQ, seg_pos={0 0}, upload=72034]: Long tail cancellation due to optimal threshold Dec 9 01:34:20.987341026 (82h5m8.684909332s) [seg_pos={0 0}, upload=72034]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:34:20.987400196 (82h5m8.684968502s) [upload=72034]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:34:20.987403793 (82h5m8.684972109s) [upload=72034]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:34:21.138199254 (82h5m8.83576757s) [upload=72034]: Done uploading segments... Dec 9 01:34:21.138213260 (82h5m8.835781566s) [upload=72034]: Upload finished. err: <nil> Duration: 9.68839409s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 15 out of 60 is failed (threshold=3) [.X.....X.X.......X...X.....X.X.X...X...X..X.X..X......X..X..] duration: 29.091306746s trace: https://jaeger.dev.storj.io/trace/519cb5a5cf852994 FAIL (2025-12-09 01:36:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 72034]: Uploading piece... Dec 9 01:34:17.294173911 (82h5m4.991742247s) [noise=true , address=81.171.14.70:4031 , piece_id=VMWGXG2SSYMHY5SORAGRBXLPUSUXNFLHXEZQOVL2KDISW3Q46T5A, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.294832581 (82h5m4.992400917s) [noise=true , address=89.149.201.147:4003 , piece_id=OJYZ3EV5OBQLGJEBXTV3KVDKFFG5NYF34SVHNJXNDKTFM3KYOT3A, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.295369924 (82h5m4.99293827s) [noise=true , address=185.167.204.206:4064 , piece_id=5JAZMICRVXSMHBYZAGLNGY6ZGYIZVBPLEDDTT74UP7XP4FBL3ZWQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.296070062 (82h5m4.993638398s) [noise=true , address=185.167.204.205:4028 , piece_id=ENT5PT3YUDVSZWHJVUTRSKXJLAGAXOIUVTVVTUZ2JQITJF3OA4PA, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.296991865 (82h5m4.9945602s) [noise=true , address=81.171.14.70:4028 , piece_id=RE3HAXNXHPZWF5V7MOI3B3USPJ5YEPWBSVNNWJPEZRESSJWIC45Q, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.298398622 (82h5m4.995966959s) [noise=true , address=89.149.201.147:4010 , piece_id=OSW7NQGAJNQKAGYKL6UGLO75PIZE75OSDTUTOPM6XEXVXRLOMOSQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.300072309 (82h5m4.997640645s) [noise=true , address=89.149.201.147:4020 , piece_id=IOBSCAS3T5VWF4AACXWE2L2QYJXNYZYK42CF7ZT3DAI43CHT5YXQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.301403756 (82h5m4.998972093s) [noise=true , address=185.167.204.206:4063 , piece_id=D2MEA7BEKS7QR63UD5BFYBLC6G426ZQ7QI5GWUKMF7PHW4OZOARQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.302419573 (82h5m4.99998791s) [noise=true , address=185.167.204.205:4022 , piece_id=KJERBQFKQTGBEOYQAKNEKVJL6PIX5KNOZBOWRXIQRO5KRTF7OJ6A, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.303831050 (82h5m5.001399396s) [noise=true , address=81.171.14.70:4040 , piece_id=L3I53NLQEU45XVCJXMVC6JUUG4KHA3XZMJPXV24YWAAMWWEEZMJA, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.304618061 (82h5m5.002186397s) [noise=true , address=81.171.14.70:4035 , piece_id=PMF2IYGSM3BAPJLYTLLKXEQBCBIZZTQR77CO7XJ75CUPTREWKKNQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.803237461 (82h5m5.500805768s) [upload=72034]: Next returned nil segment Dec 9 01:34:17.803246358 (82h5m5.500814664s) [upload=72034]: Waiting for error group managing segments... Dec 9 01:34:18.024412471 (82h5m5.721980787s) [noise=true , address=81.171.14.70:4039 , piece_id=377SOY73YS55CGF4ZQDTG6KB7QDZPDYBWLZ4BSF5DV3BFELJEQRA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.047649438 (82h5m5.745217754s) [noise=true , address=89.149.201.147:4010 , piece_id=OSW7NQGAJNQKAGYKL6UGLO75PIZE75OSDTUTOPM6XEXVXRLOMOSQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.062384955 (82h5m5.759953261s) [noise=true , address=185.167.204.205:4001 , piece_id=KBK3DRDGPNUIFVNARCAAUD6Y4VNQJPFUB4K52CISZLCUCE27MF2Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.079260248 (82h5m5.776828554s) [noise=true , address=81.171.14.70:4031 , piece_id=VMWGXG2SSYMHY5SORAGRBXLPUSUXNFLHXEZQOVL2KDISW3Q46T5A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.082634280 (82h5m5.780202596s) [noise=true , address=185.167.204.206:4063 , piece_id=D2MEA7BEKS7QR63UD5BFYBLC6G426ZQ7QI5GWUKMF7PHW4OZOARQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.399071283 (82h5m6.096639599s) [noise=true , address=185.167.204.205:4032 , piece_id=PYDU6O3J6TJDVVPF2ZTIPN4DUCSLRYAMHSOWEWJ7MCSMI5RMZP7Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.403770821 (82h5m6.101339137s) [noise=true , address=81.171.14.70:4040 , piece_id=L3I53NLQEU45XVCJXMVC6JUUG4KHA3XZMJPXV24YWAAMWWEEZMJA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.404858062 (82h5m6.102426378s) [noise=true , address=185.167.204.205:4013 , piece_id=WG3PXCHNEJWFKV4NRFMN7VCYUJVBMCJ65IVS5AYF36UAQGCUN3MA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.418075823 (82h5m6.115644139s) [noise=true , address=89.149.201.147:4020 , piece_id=IOBSCAS3T5VWF4AACXWE2L2QYJXNYZYK42CF7ZT3DAI43CHT5YXQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.431455867 (82h5m6.129024174s) [noise=true , address=185.167.204.206:4059 , piece_id=EZHEB6K2G24VVL2APK3HFC6JG4XHP373QRFFU6NQKUJQJQUSHSYQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.486763764 (82h5m6.18433207s) [noise=true , address=185.167.204.205:4029 , piece_id=KRQPYIQXASDBX3WGA5LOSDLUJFO626CNVTFA3LVYN22YMMTOM7DQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.499699628 (82h5m6.197267934s) [noise=true , address=89.149.201.147:4014 , piece_id=LGXYX62J565RRFUNMKYBZX33UO5TP4VGCI77FYQBFNUIEVZVUNQQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.521949441 (82h5m6.219517757s) [noise=true , address=185.167.204.206:4050 , piece_id=YCM3D5SXLWSM7L6FDBHTJYBI22OSKJAVQ3QPNQAXUDDVLTVWC6OQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.537474051 (82h5m6.235042367s) [noise=true , address=81.171.14.70:4047 , piece_id=SBD2YXIEFWNZMORDUHXG62VSC4ZCRR2HDP37X5BB4CNZGLGGJRGA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.588547407 (82h5m6.286115723s) [noise=true , address=89.149.201.147:4003 , piece_id=OJYZ3EV5OBQLGJEBXTV3KVDKFFG5NYF34SVHNJXNDKTFM3KYOT3A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.636045044 (82h5m6.33361336s) [noise=true , address=89.149.201.147:4011 , piece_id=7DCCHD44M3IZ7NRBKLQWRJWQVFQZEBRWHC5XON6U5GSZE7O56VZQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.816644769 (82h5m6.514213085s) [noise=true , address=185.167.204.205:4022 , piece_id=KJERBQFKQTGBEOYQAKNEKVJL6PIX5KNOZBOWRXIQRO5KRTF7OJ6A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.826196301 (82h5m6.523764617s) [noise=true , address=185.167.204.206:4064 , piece_id=5JAZMICRVXSMHBYZAGLNGY6ZGYIZVBPLEDDTT74UP7XP4FBL3ZWQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.040531373 (82h5m6.738099689s) [noise=true , address=185.167.204.205:4028 , piece_id=ENT5PT3YUDVSZWHJVUTRSKXJLAGAXOIUVTVVTUZ2JQITJF3OA4PA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.109718766 (82h5m6.807287072s) [noise=true , address=89.149.201.147:4019 , piece_id=6X3HD5X4CJZK4XLLLYBU7YGDRVNMRKSAVAMENDCNMFNQOCSI77YQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.136232996 (82h5m6.833801312s) [noise=true , address=81.171.14.70:4032 , piece_id=QOPQAJPCLPA277YBEXGZMRKKUAQDLP4DJVURFKSLB3LDKKQALPNA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.219893776 (82h5m6.917462092s) [noise=true , address=81.171.14.70:4029 , piece_id=CTGZOQIAECAYZAEVZGFHVPQOOGTXLRK47BPFUJF6LNJXZ7WCPYLQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.584338075 (82h5m7.281906411s) [noise=true , address=81.171.14.70:4028 , piece_id=RE3HAXNXHPZWF5V7MOI3B3USPJ5YEPWBSVNNWJPEZRESSJWIC45Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.797344046 (82h5m7.494912392s) [noise=true , address=81.171.14.70:4048 , piece_id=ZLRG4RFWN5Y43Y4I6R5WFZWBK6VQHDAIK3FJLJWDNVJP7E6UEPJQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.858541855 (82h5m7.55611019s) [noise=true , address=81.171.14.70:4041 , piece_id=RFQ3WZLWVA6SZTMTLYK54CZA3PHGKCPX4KPRA7HCIK7JLRTOFOTQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:20.987056725 (82h5m8.684625031s) [noise=true , address=81.171.14.70:4045 , piece_id=A6WM37OUZBQL5NERDYQLNSFTHARTRZ5LY225RSKWE4WG4FUIKC3Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:20.987071533 (82h5m8.684639849s) [seg_pos={0 0}, upload=72034]: Segment reached optimal threshold of 26 pieces. Dec 9 01:34:20.987234247 (82h5m8.684802563s) [noise=true , address=185.167.204.206:4049 , piece_id=6BRINFJE7YAIJCRH2BDHWGWWZZXLU4RD7GRO3W55JOKP3Y4AUN4A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM): protocol: expected piece hash; context canceled; EOF Dec 9 01:34:20.987240819 (82h5m8.684809125s) [noise=true , address=185.167.204.206:4049 , piece_id=6BRINFJE7YAIJCRH2BDHWGWWZZXLU4RD7GRO3W55JOKP3Y4AUN4A, seg_pos={0 0}, upload=72034]: Long tail cancellation due to optimal threshold Dec 9 01:34:20.987324134 (82h5m8.684892441s) [noise=true , address=81.171.14.70:4035 , piece_id=PMF2IYGSM3BAPJLYTLLKXEQBCBIZZTQR77CO7XJ75CUPTREWKKNQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA): protocol: expected piece hash; context canceled; EOF Dec 9 01:34:20.987328543 (82h5m8.684896849s) [noise=true , address=81.171.14.70:4035 , piece_id=PMF2IYGSM3BAPJLYTLLKXEQBCBIZZTQR77CO7XJ75CUPTREWKKNQ, seg_pos={0 0}, upload=72034]: Long tail cancellation due to optimal threshold Dec 9 01:34:20.987341026 (82h5m8.684909332s) [seg_pos={0 0}, upload=72034]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:34:20.987400196 (82h5m8.684968502s) [upload=72034]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:34:20.987403793 (82h5m8.684972109s) [upload=72034]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:34:21.138199254 (82h5m8.83576757s) [upload=72034]: Done uploading segments... Dec 9 01:34:21.138213260 (82h5m8.835781566s) [upload=72034]: Upload finished. err: <nil> Duration: 29.091326463s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 15 out of 60 is failed (threshold=3) [..X.....X.X.......X...X.....X.X.X...X...X..X.X..X......X..X.] duration: 4.591364526s trace: https://jaeger.dev.storj.io/trace/519cb5a5cf852994 FAIL (2025-12-09 01:35:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 72034]: Uploading piece... Dec 9 01:34:17.294173911 (82h5m4.991742247s) [noise=true , address=81.171.14.70:4031 , piece_id=VMWGXG2SSYMHY5SORAGRBXLPUSUXNFLHXEZQOVL2KDISW3Q46T5A, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.294832581 (82h5m4.992400917s) [noise=true , address=89.149.201.147:4003 , piece_id=OJYZ3EV5OBQLGJEBXTV3KVDKFFG5NYF34SVHNJXNDKTFM3KYOT3A, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.295369924 (82h5m4.99293827s) [noise=true , address=185.167.204.206:4064 , piece_id=5JAZMICRVXSMHBYZAGLNGY6ZGYIZVBPLEDDTT74UP7XP4FBL3ZWQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.296070062 (82h5m4.993638398s) [noise=true , address=185.167.204.205:4028 , piece_id=ENT5PT3YUDVSZWHJVUTRSKXJLAGAXOIUVTVVTUZ2JQITJF3OA4PA, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.296991865 (82h5m4.9945602s) [noise=true , address=81.171.14.70:4028 , piece_id=RE3HAXNXHPZWF5V7MOI3B3USPJ5YEPWBSVNNWJPEZRESSJWIC45Q, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.298398622 (82h5m4.995966959s) [noise=true , address=89.149.201.147:4010 , piece_id=OSW7NQGAJNQKAGYKL6UGLO75PIZE75OSDTUTOPM6XEXVXRLOMOSQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.300072309 (82h5m4.997640645s) [noise=true , address=89.149.201.147:4020 , piece_id=IOBSCAS3T5VWF4AACXWE2L2QYJXNYZYK42CF7ZT3DAI43CHT5YXQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.301403756 (82h5m4.998972093s) [noise=true , address=185.167.204.206:4063 , piece_id=D2MEA7BEKS7QR63UD5BFYBLC6G426ZQ7QI5GWUKMF7PHW4OZOARQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.302419573 (82h5m4.99998791s) [noise=true , address=185.167.204.205:4022 , piece_id=KJERBQFKQTGBEOYQAKNEKVJL6PIX5KNOZBOWRXIQRO5KRTF7OJ6A, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.303831050 (82h5m5.001399396s) [noise=true , address=81.171.14.70:4040 , piece_id=L3I53NLQEU45XVCJXMVC6JUUG4KHA3XZMJPXV24YWAAMWWEEZMJA, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.304618061 (82h5m5.002186397s) [noise=true , address=81.171.14.70:4035 , piece_id=PMF2IYGSM3BAPJLYTLLKXEQBCBIZZTQR77CO7XJ75CUPTREWKKNQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.803237461 (82h5m5.500805768s) [upload=72034]: Next returned nil segment Dec 9 01:34:17.803246358 (82h5m5.500814664s) [upload=72034]: Waiting for error group managing segments... Dec 9 01:34:18.024412471 (82h5m5.721980787s) [noise=true , address=81.171.14.70:4039 , piece_id=377SOY73YS55CGF4ZQDTG6KB7QDZPDYBWLZ4BSF5DV3BFELJEQRA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.047649438 (82h5m5.745217754s) [noise=true , address=89.149.201.147:4010 , piece_id=OSW7NQGAJNQKAGYKL6UGLO75PIZE75OSDTUTOPM6XEXVXRLOMOSQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.062384955 (82h5m5.759953261s) [noise=true , address=185.167.204.205:4001 , piece_id=KBK3DRDGPNUIFVNARCAAUD6Y4VNQJPFUB4K52CISZLCUCE27MF2Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.079260248 (82h5m5.776828554s) [noise=true , address=81.171.14.70:4031 , piece_id=VMWGXG2SSYMHY5SORAGRBXLPUSUXNFLHXEZQOVL2KDISW3Q46T5A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.082634280 (82h5m5.780202596s) [noise=true , address=185.167.204.206:4063 , piece_id=D2MEA7BEKS7QR63UD5BFYBLC6G426ZQ7QI5GWUKMF7PHW4OZOARQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.399071283 (82h5m6.096639599s) [noise=true , address=185.167.204.205:4032 , piece_id=PYDU6O3J6TJDVVPF2ZTIPN4DUCSLRYAMHSOWEWJ7MCSMI5RMZP7Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.403770821 (82h5m6.101339137s) [noise=true , address=81.171.14.70:4040 , piece_id=L3I53NLQEU45XVCJXMVC6JUUG4KHA3XZMJPXV24YWAAMWWEEZMJA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.404858062 (82h5m6.102426378s) [noise=true , address=185.167.204.205:4013 , piece_id=WG3PXCHNEJWFKV4NRFMN7VCYUJVBMCJ65IVS5AYF36UAQGCUN3MA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.418075823 (82h5m6.115644139s) [noise=true , address=89.149.201.147:4020 , piece_id=IOBSCAS3T5VWF4AACXWE2L2QYJXNYZYK42CF7ZT3DAI43CHT5YXQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.431455867 (82h5m6.129024174s) [noise=true , address=185.167.204.206:4059 , piece_id=EZHEB6K2G24VVL2APK3HFC6JG4XHP373QRFFU6NQKUJQJQUSHSYQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.486763764 (82h5m6.18433207s) [noise=true , address=185.167.204.205:4029 , piece_id=KRQPYIQXASDBX3WGA5LOSDLUJFO626CNVTFA3LVYN22YMMTOM7DQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.499699628 (82h5m6.197267934s) [noise=true , address=89.149.201.147:4014 , piece_id=LGXYX62J565RRFUNMKYBZX33UO5TP4VGCI77FYQBFNUIEVZVUNQQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.521949441 (82h5m6.219517757s) [noise=true , address=185.167.204.206:4050 , piece_id=YCM3D5SXLWSM7L6FDBHTJYBI22OSKJAVQ3QPNQAXUDDVLTVWC6OQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.537474051 (82h5m6.235042367s) [noise=true , address=81.171.14.70:4047 , piece_id=SBD2YXIEFWNZMORDUHXG62VSC4ZCRR2HDP37X5BB4CNZGLGGJRGA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.588547407 (82h5m6.286115723s) [noise=true , address=89.149.201.147:4003 , piece_id=OJYZ3EV5OBQLGJEBXTV3KVDKFFG5NYF34SVHNJXNDKTFM3KYOT3A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.636045044 (82h5m6.33361336s) [noise=true , address=89.149.201.147:4011 , piece_id=7DCCHD44M3IZ7NRBKLQWRJWQVFQZEBRWHC5XON6U5GSZE7O56VZQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.816644769 (82h5m6.514213085s) [noise=true , address=185.167.204.205:4022 , piece_id=KJERBQFKQTGBEOYQAKNEKVJL6PIX5KNOZBOWRXIQRO5KRTF7OJ6A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.826196301 (82h5m6.523764617s) [noise=true , address=185.167.204.206:4064 , piece_id=5JAZMICRVXSMHBYZAGLNGY6ZGYIZVBPLEDDTT74UP7XP4FBL3ZWQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.040531373 (82h5m6.738099689s) [noise=true , address=185.167.204.205:4028 , piece_id=ENT5PT3YUDVSZWHJVUTRSKXJLAGAXOIUVTVVTUZ2JQITJF3OA4PA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.109718766 (82h5m6.807287072s) [noise=true , address=89.149.201.147:4019 , piece_id=6X3HD5X4CJZK4XLLLYBU7YGDRVNMRKSAVAMENDCNMFNQOCSI77YQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.136232996 (82h5m6.833801312s) [noise=true , address=81.171.14.70:4032 , piece_id=QOPQAJPCLPA277YBEXGZMRKKUAQDLP4DJVURFKSLB3LDKKQALPNA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.219893776 (82h5m6.917462092s) [noise=true , address=81.171.14.70:4029 , piece_id=CTGZOQIAECAYZAEVZGFHVPQOOGTXLRK47BPFUJF6LNJXZ7WCPYLQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.584338075 (82h5m7.281906411s) [noise=true , address=81.171.14.70:4028 , piece_id=RE3HAXNXHPZWF5V7MOI3B3USPJ5YEPWBSVNNWJPEZRESSJWIC45Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.797344046 (82h5m7.494912392s) [noise=true , address=81.171.14.70:4048 , piece_id=ZLRG4RFWN5Y43Y4I6R5WFZWBK6VQHDAIK3FJLJWDNVJP7E6UEPJQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.858541855 (82h5m7.55611019s) [noise=true , address=81.171.14.70:4041 , piece_id=RFQ3WZLWVA6SZTMTLYK54CZA3PHGKCPX4KPRA7HCIK7JLRTOFOTQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:20.987056725 (82h5m8.684625031s) [noise=true , address=81.171.14.70:4045 , piece_id=A6WM37OUZBQL5NERDYQLNSFTHARTRZ5LY225RSKWE4WG4FUIKC3Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:20.987071533 (82h5m8.684639849s) [seg_pos={0 0}, upload=72034]: Segment reached optimal threshold of 26 pieces. Dec 9 01:34:20.987234247 (82h5m8.684802563s) [noise=true , address=185.167.204.206:4049 , piece_id=6BRINFJE7YAIJCRH2BDHWGWWZZXLU4RD7GRO3W55JOKP3Y4AUN4A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM): protocol: expected piece hash; context canceled; EOF Dec 9 01:34:20.987240819 (82h5m8.684809125s) [noise=true , address=185.167.204.206:4049 , piece_id=6BRINFJE7YAIJCRH2BDHWGWWZZXLU4RD7GRO3W55JOKP3Y4AUN4A, seg_pos={0 0}, upload=72034]: Long tail cancellation due to optimal threshold Dec 9 01:34:20.987324134 (82h5m8.684892441s) [noise=true , address=81.171.14.70:4035 , piece_id=PMF2IYGSM3BAPJLYTLLKXEQBCBIZZTQR77CO7XJ75CUPTREWKKNQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA): protocol: expected piece hash; context canceled; EOF Dec 9 01:34:20.987328543 (82h5m8.684896849s) [noise=true , address=81.171.14.70:4035 , piece_id=PMF2IYGSM3BAPJLYTLLKXEQBCBIZZTQR77CO7XJ75CUPTREWKKNQ, seg_pos={0 0}, upload=72034]: Long tail cancellation due to optimal threshold Dec 9 01:34:20.987341026 (82h5m8.684909332s) [seg_pos={0 0}, upload=72034]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:34:20.987400196 (82h5m8.684968502s) [upload=72034]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:34:20.987403793 (82h5m8.684972109s) [upload=72034]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:34:21.138199254 (82h5m8.83576757s) [upload=72034]: Done uploading segments... Dec 9 01:34:21.138213260 (82h5m8.835781566s) [upload=72034]: Upload finished. err: <nil> Duration: 4.591386306s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 15 out of 60 is failed (threshold=3) [...X.....X.X.......X...X.....X.X.X...X...X..X.X..X......X..X] duration: 52.695017543s trace: https://jaeger.dev.storj.io/trace/519cb5a5cf852994 FAIL (2025-12-09 01:35:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 72034]: Uploading piece... Dec 9 01:34:17.294173911 (82h5m4.991742247s) [noise=true , address=81.171.14.70:4031 , piece_id=VMWGXG2SSYMHY5SORAGRBXLPUSUXNFLHXEZQOVL2KDISW3Q46T5A, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.294832581 (82h5m4.992400917s) [noise=true , address=89.149.201.147:4003 , piece_id=OJYZ3EV5OBQLGJEBXTV3KVDKFFG5NYF34SVHNJXNDKTFM3KYOT3A, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.295369924 (82h5m4.99293827s) [noise=true , address=185.167.204.206:4064 , piece_id=5JAZMICRVXSMHBYZAGLNGY6ZGYIZVBPLEDDTT74UP7XP4FBL3ZWQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.296070062 (82h5m4.993638398s) [noise=true , address=185.167.204.205:4028 , piece_id=ENT5PT3YUDVSZWHJVUTRSKXJLAGAXOIUVTVVTUZ2JQITJF3OA4PA, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.296991865 (82h5m4.9945602s) [noise=true , address=81.171.14.70:4028 , piece_id=RE3HAXNXHPZWF5V7MOI3B3USPJ5YEPWBSVNNWJPEZRESSJWIC45Q, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.298398622 (82h5m4.995966959s) [noise=true , address=89.149.201.147:4010 , piece_id=OSW7NQGAJNQKAGYKL6UGLO75PIZE75OSDTUTOPM6XEXVXRLOMOSQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.300072309 (82h5m4.997640645s) [noise=true , address=89.149.201.147:4020 , piece_id=IOBSCAS3T5VWF4AACXWE2L2QYJXNYZYK42CF7ZT3DAI43CHT5YXQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.301403756 (82h5m4.998972093s) [noise=true , address=185.167.204.206:4063 , piece_id=D2MEA7BEKS7QR63UD5BFYBLC6G426ZQ7QI5GWUKMF7PHW4OZOARQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.302419573 (82h5m4.99998791s) [noise=true , address=185.167.204.205:4022 , piece_id=KJERBQFKQTGBEOYQAKNEKVJL6PIX5KNOZBOWRXIQRO5KRTF7OJ6A, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.303831050 (82h5m5.001399396s) [noise=true , address=81.171.14.70:4040 , piece_id=L3I53NLQEU45XVCJXMVC6JUUG4KHA3XZMJPXV24YWAAMWWEEZMJA, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.304618061 (82h5m5.002186397s) [noise=true , address=81.171.14.70:4035 , piece_id=PMF2IYGSM3BAPJLYTLLKXEQBCBIZZTQR77CO7XJ75CUPTREWKKNQ, seg_pos={0 0}, upload=72034]: Uploading piece... Dec 9 01:34:17.803237461 (82h5m5.500805768s) [upload=72034]: Next returned nil segment Dec 9 01:34:17.803246358 (82h5m5.500814664s) [upload=72034]: Waiting for error group managing segments... Dec 9 01:34:18.024412471 (82h5m5.721980787s) [noise=true , address=81.171.14.70:4039 , piece_id=377SOY73YS55CGF4ZQDTG6KB7QDZPDYBWLZ4BSF5DV3BFELJEQRA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.047649438 (82h5m5.745217754s) [noise=true , address=89.149.201.147:4010 , piece_id=OSW7NQGAJNQKAGYKL6UGLO75PIZE75OSDTUTOPM6XEXVXRLOMOSQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.062384955 (82h5m5.759953261s) [noise=true , address=185.167.204.205:4001 , piece_id=KBK3DRDGPNUIFVNARCAAUD6Y4VNQJPFUB4K52CISZLCUCE27MF2Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.079260248 (82h5m5.776828554s) [noise=true , address=81.171.14.70:4031 , piece_id=VMWGXG2SSYMHY5SORAGRBXLPUSUXNFLHXEZQOVL2KDISW3Q46T5A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.082634280 (82h5m5.780202596s) [noise=true , address=185.167.204.206:4063 , piece_id=D2MEA7BEKS7QR63UD5BFYBLC6G426ZQ7QI5GWUKMF7PHW4OZOARQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.399071283 (82h5m6.096639599s) [noise=true , address=185.167.204.205:4032 , piece_id=PYDU6O3J6TJDVVPF2ZTIPN4DUCSLRYAMHSOWEWJ7MCSMI5RMZP7Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.403770821 (82h5m6.101339137s) [noise=true , address=81.171.14.70:4040 , piece_id=L3I53NLQEU45XVCJXMVC6JUUG4KHA3XZMJPXV24YWAAMWWEEZMJA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.404858062 (82h5m6.102426378s) [noise=true , address=185.167.204.205:4013 , piece_id=WG3PXCHNEJWFKV4NRFMN7VCYUJVBMCJ65IVS5AYF36UAQGCUN3MA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.418075823 (82h5m6.115644139s) [noise=true , address=89.149.201.147:4020 , piece_id=IOBSCAS3T5VWF4AACXWE2L2QYJXNYZYK42CF7ZT3DAI43CHT5YXQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.431455867 (82h5m6.129024174s) [noise=true , address=185.167.204.206:4059 , piece_id=EZHEB6K2G24VVL2APK3HFC6JG4XHP373QRFFU6NQKUJQJQUSHSYQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.486763764 (82h5m6.18433207s) [noise=true , address=185.167.204.205:4029 , piece_id=KRQPYIQXASDBX3WGA5LOSDLUJFO626CNVTFA3LVYN22YMMTOM7DQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.499699628 (82h5m6.197267934s) [noise=true , address=89.149.201.147:4014 , piece_id=LGXYX62J565RRFUNMKYBZX33UO5TP4VGCI77FYQBFNUIEVZVUNQQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.521949441 (82h5m6.219517757s) [noise=true , address=185.167.204.206:4050 , piece_id=YCM3D5SXLWSM7L6FDBHTJYBI22OSKJAVQ3QPNQAXUDDVLTVWC6OQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.537474051 (82h5m6.235042367s) [noise=true , address=81.171.14.70:4047 , piece_id=SBD2YXIEFWNZMORDUHXG62VSC4ZCRR2HDP37X5BB4CNZGLGGJRGA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.588547407 (82h5m6.286115723s) [noise=true , address=89.149.201.147:4003 , piece_id=OJYZ3EV5OBQLGJEBXTV3KVDKFFG5NYF34SVHNJXNDKTFM3KYOT3A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.636045044 (82h5m6.33361336s) [noise=true , address=89.149.201.147:4011 , piece_id=7DCCHD44M3IZ7NRBKLQWRJWQVFQZEBRWHC5XON6U5GSZE7O56VZQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.816644769 (82h5m6.514213085s) [noise=true , address=185.167.204.205:4022 , piece_id=KJERBQFKQTGBEOYQAKNEKVJL6PIX5KNOZBOWRXIQRO5KRTF7OJ6A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:18.826196301 (82h5m6.523764617s) [noise=true , address=185.167.204.206:4064 , piece_id=5JAZMICRVXSMHBYZAGLNGY6ZGYIZVBPLEDDTT74UP7XP4FBL3ZWQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.040531373 (82h5m6.738099689s) [noise=true , address=185.167.204.205:4028 , piece_id=ENT5PT3YUDVSZWHJVUTRSKXJLAGAXOIUVTVVTUZ2JQITJF3OA4PA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.109718766 (82h5m6.807287072s) [noise=true , address=89.149.201.147:4019 , piece_id=6X3HD5X4CJZK4XLLLYBU7YGDRVNMRKSAVAMENDCNMFNQOCSI77YQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.136232996 (82h5m6.833801312s) [noise=true , address=81.171.14.70:4032 , piece_id=QOPQAJPCLPA277YBEXGZMRKKUAQDLP4DJVURFKSLB3LDKKQALPNA, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.219893776 (82h5m6.917462092s) [noise=true , address=81.171.14.70:4029 , piece_id=CTGZOQIAECAYZAEVZGFHVPQOOGTXLRK47BPFUJF6LNJXZ7WCPYLQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.584338075 (82h5m7.281906411s) [noise=true , address=81.171.14.70:4028 , piece_id=RE3HAXNXHPZWF5V7MOI3B3USPJ5YEPWBSVNNWJPEZRESSJWIC45Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.797344046 (82h5m7.494912392s) [noise=true , address=81.171.14.70:4048 , piece_id=ZLRG4RFWN5Y43Y4I6R5WFZWBK6VQHDAIK3FJLJWDNVJP7E6UEPJQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:19.858541855 (82h5m7.55611019s) [noise=true , address=81.171.14.70:4041 , piece_id=RFQ3WZLWVA6SZTMTLYK54CZA3PHGKCPX4KPRA7HCIK7JLRTOFOTQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:20.987056725 (82h5m8.684625031s) [noise=true , address=81.171.14.70:4045 , piece_id=A6WM37OUZBQL5NERDYQLNSFTHARTRZ5LY225RSKWE4WG4FUIKC3Q, seg_pos={0 0}, upload=72034]: Done uploading piece. err: <nil> Dec 9 01:34:20.987071533 (82h5m8.684639849s) [seg_pos={0 0}, upload=72034]: Segment reached optimal threshold of 26 pieces. Dec 9 01:34:20.987234247 (82h5m8.684802563s) [noise=true , address=185.167.204.206:4049 , piece_id=6BRINFJE7YAIJCRH2BDHWGWWZZXLU4RD7GRO3W55JOKP3Y4AUN4A, seg_pos={0 0}, upload=72034]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM): protocol: expected piece hash; context canceled; EOF Dec 9 01:34:20.987240819 (82h5m8.684809125s) [noise=true , address=185.167.204.206:4049 , piece_id=6BRINFJE7YAIJCRH2BDHWGWWZZXLU4RD7GRO3W55JOKP3Y4AUN4A, seg_pos={0 0}, upload=72034]: Long tail cancellation due to optimal threshold Dec 9 01:34:20.987324134 (82h5m8.684892441s) [noise=true , address=81.171.14.70:4035 , piece_id=PMF2IYGSM3BAPJLYTLLKXEQBCBIZZTQR77CO7XJ75CUPTREWKKNQ, seg_pos={0 0}, upload=72034]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA): protocol: expected piece hash; context canceled; EOF Dec 9 01:34:20.987328543 (82h5m8.684896849s) [noise=true , address=81.171.14.70:4035 , piece_id=PMF2IYGSM3BAPJLYTLLKXEQBCBIZZTQR77CO7XJ75CUPTREWKKNQ, seg_pos={0 0}, upload=72034]: Long tail cancellation due to optimal threshold Dec 9 01:34:20.987341026 (82h5m8.684909332s) [seg_pos={0 0}, upload=72034]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:34:20.987400196 (82h5m8.684968502s) [upload=72034]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:34:20.987403793 (82h5m8.684972109s) [upload=72034]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:34:21.138199254 (82h5m8.83576757s) [upload=72034]: Done uploading segments... Dec 9 01:34:21.138213260 (82h5m8.835781566s) [upload=72034]: Upload finished. err: <nil> Duration: 52.695084858s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 15 out of 60 is failed (threshold=3) [X...X.....X.X.......X...X.....X.X.X...X...X..X.X..X......X..] duration: 4.957471283s trace: https://jaeger.dev.storj.io/trace/106a267a3a4b2858 FAIL (2025-12-09 01:33:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== ise=true , address=89.149.201.147:4003 , piece_id=TUSHGZZYDJBN6JKU4QT7MP54TQVAFBIHFNTLNAATFNE7DAIEJM4Q, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.624123530 (82h2m47.321691846s) [noise=true , address=185.167.204.205:4009 , piece_id=QMLZQWDRUYGRKTTVJW4HQIXAEEDBFJ3UJPOECHQYNJQ6PRNT4NVQ, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.625163712 (82h2m47.322732018s) [noise=true , address=185.167.204.205:4008 , piece_id=PIOG3NB2EXTAPCSJ4INGKS3ZCUNFDIVPJDLADM2TTXKNU3TARZVA, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.625539523 (82h2m47.323107839s) [noise=true , address=81.171.14.70:4040 , piece_id=4TAY4GVJAM52W72UQPENJQSGPBF37772EAEF3AZAGIJC7CYT6PFQ, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.625847790 (82h2m47.323416095s) [noise=true , address=89.149.201.147:4004 , piece_id=WTU4EKHHUB47TPBMPZES6BCR24URME7TUF75RV76KFA3IEX4ZEQA, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.626103918 (82h2m47.323672234s) [noise=true , address=185.167.204.206:4052 , piece_id=PKW23KQRLZ3F66AR7A373EOCHJ6VKCDDUTCBMDJRPU2N4AVGNOCQ, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.626361871 (82h2m47.323930187s) [noise=true , address=185.167.204.205:4033 , piece_id=YACV3UAOCHIYM6GBYHUUS7NIMTEK4OMBESBJSDTKD33EVUFMPQWA, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.626629621 (82h2m47.324197937s) [noise=true , address=185.167.204.206:4048 , piece_id=BYH43OTQNKZNIX5QAHJAMMXJVSGSQSHQS4FOVJBG6SQVO6AXNEIQ, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.626944729 (82h2m47.324513045s) [noise=true , address=185.167.204.205:4035 , piece_id=JOSTAHVHVMQF34FL73QAQ7NGFKRXO2FQC27SRDXLCRVHM2ERAB4Q, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.628484184 (82h2m47.3260525s) [noise=true , address=185.167.204.206:4069 , piece_id=K3TLSVR42BDRLBEBEL7RCSJEFQJP2IXFTMNGIOOTIRMPAULDLZYA, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:32:00.123690511 (82h2m47.821258817s) [upload=71999]: Next returned nil segment Dec 9 01:32:00.123699839 (82h2m47.821268145s) [upload=71999]: Waiting for error group managing segments... Dec 9 01:32:00.322927539 (82h2m48.020495845s) [noise=true , address=81.171.14.70:4048 , piece_id=X45JYZTZS6WOAAE52KLY6GSDLUZPRYIVNEMTT6HWTWM24KO3S4ZA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.325012214 (82h2m48.02258053s) [noise=true , address=185.167.204.206:4052 , piece_id=PKW23KQRLZ3F66AR7A373EOCHJ6VKCDDUTCBMDJRPU2N4AVGNOCQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.350134142 (82h2m48.047702448s) [noise=true , address=185.167.204.205:4025 , piece_id=RQD2EZZLSCAIPEKCNOHVJ4OVUJFWVIBUH2SYVQC3JINRER32XEIQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.367082622 (82h2m48.064650928s) [noise=true , address=89.149.201.147:4009 , piece_id=STHOB6BEHQHWMM5D5GUKCHG4JCY5XBYSPBSCIMY22BROCWIZMHHQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.676324131 (82h2m48.373892468s) [noise=true , address=89.149.201.147:4003 , piece_id=TUSHGZZYDJBN6JKU4QT7MP54TQVAFBIHFNTLNAATFNE7DAIEJM4Q, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.678208262 (82h2m48.375776578s) [noise=true , address=185.167.204.205:4027 , piece_id=5ZMDJUN6H5SDZCAF3QGO7BZME4GUQVEJYPSROX6F3MYG3KXXKAOA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.697955169 (82h2m48.395523506s) [noise=true , address=185.167.204.205:4028 , piece_id=2GLODSX67GSUJQ54CM4RHVGZJY4UVWHEDOT2OBT5AQ7OSERL7NHQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.711604767 (82h2m48.409173103s) [noise=true , address=185.167.204.205:4035 , piece_id=JOSTAHVHVMQF34FL73QAQ7NGFKRXO2FQC27SRDXLCRVHM2ERAB4Q, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.720412631 (82h2m48.417980967s) [noise=true , address=89.149.201.147:4004 , piece_id=WTU4EKHHUB47TPBMPZES6BCR24URME7TUF75RV76KFA3IEX4ZEQA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.741933652 (82h2m48.439501968s) [noise=true , address=81.171.14.70:4047 , piece_id=PKJJTRQHI2ZFDRSBWK34EY4CPQN766QPAHB5DXTGOVDUAOL6V5XQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.771899840 (82h2m48.469468146s) [noise=true , address=81.171.14.70:4027 , piece_id=ZLL3YC63KXRQIOAFIKQYAKTLX4EZP7QGX6AWWIE6K6XLAQS65XEA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.814805939 (82h2m48.512374275s) [noise=true , address=89.149.201.147:4018 , piece_id=KYL3KJDB2TDTFWNKVRQUFP6F7Z3L3RLI5G5QDCQ35XFGP4MGVQ5A, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.819453711 (82h2m48.517022047s) [noise=true , address=185.167.204.206:4069 , piece_id=K3TLSVR42BDRLBEBEL7RCSJEFQJP2IXFTMNGIOOTIRMPAULDLZYA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.864084393 (82h2m48.561652729s) [noise=true , address=185.167.204.205:4033 , piece_id=YACV3UAOCHIYM6GBYHUUS7NIMTEK4OMBESBJSDTKD33EVUFMPQWA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.868123207 (82h2m48.565691543s) [noise=true , address=89.149.201.147:4001 , piece_id=JG45XZFMFBNWB7DATCH5OB4SYHF5HFXEFWKNSFEUDJBKK3RXQR7Q, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.878311820 (82h2m48.575880166s) [noise=true , address=81.171.14.70:4031 , piece_id=7GNEHRRR4SUM6CHSFM7AYVLQ625WJDJMXTVMQWXFBY5YLVOKDIKQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.889271453 (82h2m48.586839788s) [noise=true , address=185.167.204.205:4004 , piece_id=E6J2ZG36BSHLCC4757I3EKCWORW64GW7AMA7SFEWR6HQHJHQCMOQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.890795059 (82h2m48.588363394s) [noise=true , address=185.167.204.205:4011 , piece_id=UHWXGGT3QYLZP5XUXS6YNAPBAT3BWSIKCE4PAAPBR6MJMWNQH6RQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.998620680 (82h2m48.696188986s) [noise=true , address=185.167.204.206:4048 , piece_id=BYH43OTQNKZNIX5QAHJAMMXJVSGSQSHQS4FOVJBG6SQVO6AXNEIQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.027275558 (82h2m48.724843874s) [noise=true , address=185.167.204.205:4008 , piece_id=PIOG3NB2EXTAPCSJ4INGKS3ZCUNFDIVPJDLADM2TTXKNU3TARZVA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.053797460 (82h2m48.751365776s) [noise=true , address=81.171.14.70:4035 , piece_id=W5K2O4JU2QOGUMAM7YIE5F5YBXSUQORIJQ5MKWSXD4YLGBC4TNBQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.131350904 (82h2m48.82891922s) [noise=true , address=185.167.204.205:4009 , piece_id=QMLZQWDRUYGRKTTVJW4HQIXAEEDBFJ3UJPOECHQYNJQ6PRNT4NVQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.158873686 (82h2m48.856442002s) [noise=true , address=185.167.204.206:4058 , piece_id=OHKY3LUDKBQSTLBIMBJ37MFAT5DRTZTYITIRI46S774GLMELFARA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.180035436 (82h2m48.877603752s) [noise=true , address=81.171.14.70:4043 , piece_id=7BSMEEWW2LPNF6RRCJJPFA26PKQYXG75BHH2Y3F5UN4MBDVEDIBA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.188195249 (82h2m48.885763555s) [noise=true , address=89.149.201.147:4022 , piece_id=XJHAYYKDETNAMKBTKL6HH62GLIKNTTQODVDBQBBI6BUHGB3DW6ZQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.233922599 (82h2m48.931490935s) [noise=true , address=81.171.14.70:4037 , piece_id=AREOBU5WCCEDZ7IZRL337AYDE54IJFGC2GTGN2YHEYIWW7AZTAPA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.233943509 (82h2m48.931511844s) [seg_pos={0 0}, upload=71999]: Segment reached optimal threshold of 26 pieces. Dec 9 01:32:01.234203904 (82h2m48.931772241s) [noise=true , address=81.171.14.70:4040 , piece_id=4TAY4GVJAM52W72UQPENJQSGPBF37772EAEF3AZAGIJC7CYT6PFQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV): protocol: write tcp 5.161.89.252:8752->81.171.14.70:4040: use of closed network connection; write tcp 5.161.89.252:8752->81.171.14.70:4040: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8752->81.171.14.70:4040: use of closed network connection Dec 9 01:32:01.234214134 (82h2m48.93178247s) [noise=true , address=81.171.14.70:4040 , piece_id=4TAY4GVJAM52W72UQPENJQSGPBF37772EAEF3AZAGIJC7CYT6PFQ, seg_pos={0 0}, upload=71999]: Long tail cancellation due to optimal threshold Dec 9 01:32:01.234317186 (82h2m48.931885492s) [noise=true , address=89.149.201.147:4008 , piece_id=KUDZ3FSIEXOZZO43WT3VWNZAEPDNKHDFNZUBQWPEHSWPYGH74SPQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn): protocol: expected piece hash; context canceled; EOF Dec 9 01:32:01.234329118 (82h2m48.931897425s) [noise=true , address=89.149.201.147:4008 , piece_id=KUDZ3FSIEXOZZO43WT3VWNZAEPDNKHDFNZUBQWPEHSWPYGH74SPQ, seg_pos={0 0}, upload=71999]: Long tail cancellation due to optimal threshold Dec 9 01:32:01.234353294 (82h2m48.93192161s) [seg_pos={0 0}, upload=71999]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:32:01.234421882 (82h2m48.931990198s) [upload=71999]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:32:01.234425508 (82h2m48.931993824s) [upload=71999]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:32:01.394952857 (82h2m49.092521173s) [upload=71999]: Done uploading segments... Dec 9 01:32:01.394966343 (82h2m49.092534659s) [upload=71999]: Upload finished. err: <nil> Duration: 4.957485308s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 15 out of 60 is failed (threshold=3) [.X...X.....X.X.......X...X.....X.X.X...X...X..X.X..X......X.] duration: 5.91268837s trace: https://jaeger.dev.storj.io/trace/106a267a3a4b2858 FAIL (2025-12-09 01:33:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== ise=true , address=89.149.201.147:4003 , piece_id=TUSHGZZYDJBN6JKU4QT7MP54TQVAFBIHFNTLNAATFNE7DAIEJM4Q, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.624123530 (82h2m47.321691846s) [noise=true , address=185.167.204.205:4009 , piece_id=QMLZQWDRUYGRKTTVJW4HQIXAEEDBFJ3UJPOECHQYNJQ6PRNT4NVQ, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.625163712 (82h2m47.322732018s) [noise=true , address=185.167.204.205:4008 , piece_id=PIOG3NB2EXTAPCSJ4INGKS3ZCUNFDIVPJDLADM2TTXKNU3TARZVA, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.625539523 (82h2m47.323107839s) [noise=true , address=81.171.14.70:4040 , piece_id=4TAY4GVJAM52W72UQPENJQSGPBF37772EAEF3AZAGIJC7CYT6PFQ, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.625847790 (82h2m47.323416095s) [noise=true , address=89.149.201.147:4004 , piece_id=WTU4EKHHUB47TPBMPZES6BCR24URME7TUF75RV76KFA3IEX4ZEQA, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.626103918 (82h2m47.323672234s) [noise=true , address=185.167.204.206:4052 , piece_id=PKW23KQRLZ3F66AR7A373EOCHJ6VKCDDUTCBMDJRPU2N4AVGNOCQ, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.626361871 (82h2m47.323930187s) [noise=true , address=185.167.204.205:4033 , piece_id=YACV3UAOCHIYM6GBYHUUS7NIMTEK4OMBESBJSDTKD33EVUFMPQWA, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.626629621 (82h2m47.324197937s) [noise=true , address=185.167.204.206:4048 , piece_id=BYH43OTQNKZNIX5QAHJAMMXJVSGSQSHQS4FOVJBG6SQVO6AXNEIQ, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.626944729 (82h2m47.324513045s) [noise=true , address=185.167.204.205:4035 , piece_id=JOSTAHVHVMQF34FL73QAQ7NGFKRXO2FQC27SRDXLCRVHM2ERAB4Q, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.628484184 (82h2m47.3260525s) [noise=true , address=185.167.204.206:4069 , piece_id=K3TLSVR42BDRLBEBEL7RCSJEFQJP2IXFTMNGIOOTIRMPAULDLZYA, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:32:00.123690511 (82h2m47.821258817s) [upload=71999]: Next returned nil segment Dec 9 01:32:00.123699839 (82h2m47.821268145s) [upload=71999]: Waiting for error group managing segments... Dec 9 01:32:00.322927539 (82h2m48.020495845s) [noise=true , address=81.171.14.70:4048 , piece_id=X45JYZTZS6WOAAE52KLY6GSDLUZPRYIVNEMTT6HWTWM24KO3S4ZA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.325012214 (82h2m48.02258053s) [noise=true , address=185.167.204.206:4052 , piece_id=PKW23KQRLZ3F66AR7A373EOCHJ6VKCDDUTCBMDJRPU2N4AVGNOCQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.350134142 (82h2m48.047702448s) [noise=true , address=185.167.204.205:4025 , piece_id=RQD2EZZLSCAIPEKCNOHVJ4OVUJFWVIBUH2SYVQC3JINRER32XEIQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.367082622 (82h2m48.064650928s) [noise=true , address=89.149.201.147:4009 , piece_id=STHOB6BEHQHWMM5D5GUKCHG4JCY5XBYSPBSCIMY22BROCWIZMHHQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.676324131 (82h2m48.373892468s) [noise=true , address=89.149.201.147:4003 , piece_id=TUSHGZZYDJBN6JKU4QT7MP54TQVAFBIHFNTLNAATFNE7DAIEJM4Q, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.678208262 (82h2m48.375776578s) [noise=true , address=185.167.204.205:4027 , piece_id=5ZMDJUN6H5SDZCAF3QGO7BZME4GUQVEJYPSROX6F3MYG3KXXKAOA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.697955169 (82h2m48.395523506s) [noise=true , address=185.167.204.205:4028 , piece_id=2GLODSX67GSUJQ54CM4RHVGZJY4UVWHEDOT2OBT5AQ7OSERL7NHQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.711604767 (82h2m48.409173103s) [noise=true , address=185.167.204.205:4035 , piece_id=JOSTAHVHVMQF34FL73QAQ7NGFKRXO2FQC27SRDXLCRVHM2ERAB4Q, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.720412631 (82h2m48.417980967s) [noise=true , address=89.149.201.147:4004 , piece_id=WTU4EKHHUB47TPBMPZES6BCR24URME7TUF75RV76KFA3IEX4ZEQA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.741933652 (82h2m48.439501968s) [noise=true , address=81.171.14.70:4047 , piece_id=PKJJTRQHI2ZFDRSBWK34EY4CPQN766QPAHB5DXTGOVDUAOL6V5XQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.771899840 (82h2m48.469468146s) [noise=true , address=81.171.14.70:4027 , piece_id=ZLL3YC63KXRQIOAFIKQYAKTLX4EZP7QGX6AWWIE6K6XLAQS65XEA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.814805939 (82h2m48.512374275s) [noise=true , address=89.149.201.147:4018 , piece_id=KYL3KJDB2TDTFWNKVRQUFP6F7Z3L3RLI5G5QDCQ35XFGP4MGVQ5A, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.819453711 (82h2m48.517022047s) [noise=true , address=185.167.204.206:4069 , piece_id=K3TLSVR42BDRLBEBEL7RCSJEFQJP2IXFTMNGIOOTIRMPAULDLZYA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.864084393 (82h2m48.561652729s) [noise=true , address=185.167.204.205:4033 , piece_id=YACV3UAOCHIYM6GBYHUUS7NIMTEK4OMBESBJSDTKD33EVUFMPQWA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.868123207 (82h2m48.565691543s) [noise=true , address=89.149.201.147:4001 , piece_id=JG45XZFMFBNWB7DATCH5OB4SYHF5HFXEFWKNSFEUDJBKK3RXQR7Q, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.878311820 (82h2m48.575880166s) [noise=true , address=81.171.14.70:4031 , piece_id=7GNEHRRR4SUM6CHSFM7AYVLQ625WJDJMXTVMQWXFBY5YLVOKDIKQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.889271453 (82h2m48.586839788s) [noise=true , address=185.167.204.205:4004 , piece_id=E6J2ZG36BSHLCC4757I3EKCWORW64GW7AMA7SFEWR6HQHJHQCMOQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.890795059 (82h2m48.588363394s) [noise=true , address=185.167.204.205:4011 , piece_id=UHWXGGT3QYLZP5XUXS6YNAPBAT3BWSIKCE4PAAPBR6MJMWNQH6RQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.998620680 (82h2m48.696188986s) [noise=true , address=185.167.204.206:4048 , piece_id=BYH43OTQNKZNIX5QAHJAMMXJVSGSQSHQS4FOVJBG6SQVO6AXNEIQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.027275558 (82h2m48.724843874s) [noise=true , address=185.167.204.205:4008 , piece_id=PIOG3NB2EXTAPCSJ4INGKS3ZCUNFDIVPJDLADM2TTXKNU3TARZVA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.053797460 (82h2m48.751365776s) [noise=true , address=81.171.14.70:4035 , piece_id=W5K2O4JU2QOGUMAM7YIE5F5YBXSUQORIJQ5MKWSXD4YLGBC4TNBQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.131350904 (82h2m48.82891922s) [noise=true , address=185.167.204.205:4009 , piece_id=QMLZQWDRUYGRKTTVJW4HQIXAEEDBFJ3UJPOECHQYNJQ6PRNT4NVQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.158873686 (82h2m48.856442002s) [noise=true , address=185.167.204.206:4058 , piece_id=OHKY3LUDKBQSTLBIMBJ37MFAT5DRTZTYITIRI46S774GLMELFARA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.180035436 (82h2m48.877603752s) [noise=true , address=81.171.14.70:4043 , piece_id=7BSMEEWW2LPNF6RRCJJPFA26PKQYXG75BHH2Y3F5UN4MBDVEDIBA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.188195249 (82h2m48.885763555s) [noise=true , address=89.149.201.147:4022 , piece_id=XJHAYYKDETNAMKBTKL6HH62GLIKNTTQODVDBQBBI6BUHGB3DW6ZQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.233922599 (82h2m48.931490935s) [noise=true , address=81.171.14.70:4037 , piece_id=AREOBU5WCCEDZ7IZRL337AYDE54IJFGC2GTGN2YHEYIWW7AZTAPA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.233943509 (82h2m48.931511844s) [seg_pos={0 0}, upload=71999]: Segment reached optimal threshold of 26 pieces. Dec 9 01:32:01.234203904 (82h2m48.931772241s) [noise=true , address=81.171.14.70:4040 , piece_id=4TAY4GVJAM52W72UQPENJQSGPBF37772EAEF3AZAGIJC7CYT6PFQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV): protocol: write tcp 5.161.89.252:8752->81.171.14.70:4040: use of closed network connection; write tcp 5.161.89.252:8752->81.171.14.70:4040: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8752->81.171.14.70:4040: use of closed network connection Dec 9 01:32:01.234214134 (82h2m48.93178247s) [noise=true , address=81.171.14.70:4040 , piece_id=4TAY4GVJAM52W72UQPENJQSGPBF37772EAEF3AZAGIJC7CYT6PFQ, seg_pos={0 0}, upload=71999]: Long tail cancellation due to optimal threshold Dec 9 01:32:01.234317186 (82h2m48.931885492s) [noise=true , address=89.149.201.147:4008 , piece_id=KUDZ3FSIEXOZZO43WT3VWNZAEPDNKHDFNZUBQWPEHSWPYGH74SPQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn): protocol: expected piece hash; context canceled; EOF Dec 9 01:32:01.234329118 (82h2m48.931897425s) [noise=true , address=89.149.201.147:4008 , piece_id=KUDZ3FSIEXOZZO43WT3VWNZAEPDNKHDFNZUBQWPEHSWPYGH74SPQ, seg_pos={0 0}, upload=71999]: Long tail cancellation due to optimal threshold Dec 9 01:32:01.234353294 (82h2m48.93192161s) [seg_pos={0 0}, upload=71999]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:32:01.234421882 (82h2m48.931990198s) [upload=71999]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:32:01.234425508 (82h2m48.931993824s) [upload=71999]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:32:01.394952857 (82h2m49.092521173s) [upload=71999]: Done uploading segments... Dec 9 01:32:01.394966343 (82h2m49.092534659s) [upload=71999]: Upload finished. err: <nil> Duration: 5.912707246s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 15 out of 60 is failed (threshold=3) [..X...X.....X.X.......X...X.....X.X.X...X...X..X.X..X......X] duration: 23.624133975s trace: https://jaeger.dev.storj.io/trace/106a267a3a4b2858 FAIL (2025-12-09 01:32:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== ise=true , address=89.149.201.147:4003 , piece_id=TUSHGZZYDJBN6JKU4QT7MP54TQVAFBIHFNTLNAATFNE7DAIEJM4Q, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.624123530 (82h2m47.321691846s) [noise=true , address=185.167.204.205:4009 , piece_id=QMLZQWDRUYGRKTTVJW4HQIXAEEDBFJ3UJPOECHQYNJQ6PRNT4NVQ, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.625163712 (82h2m47.322732018s) [noise=true , address=185.167.204.205:4008 , piece_id=PIOG3NB2EXTAPCSJ4INGKS3ZCUNFDIVPJDLADM2TTXKNU3TARZVA, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.625539523 (82h2m47.323107839s) [noise=true , address=81.171.14.70:4040 , piece_id=4TAY4GVJAM52W72UQPENJQSGPBF37772EAEF3AZAGIJC7CYT6PFQ, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.625847790 (82h2m47.323416095s) [noise=true , address=89.149.201.147:4004 , piece_id=WTU4EKHHUB47TPBMPZES6BCR24URME7TUF75RV76KFA3IEX4ZEQA, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.626103918 (82h2m47.323672234s) [noise=true , address=185.167.204.206:4052 , piece_id=PKW23KQRLZ3F66AR7A373EOCHJ6VKCDDUTCBMDJRPU2N4AVGNOCQ, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.626361871 (82h2m47.323930187s) [noise=true , address=185.167.204.205:4033 , piece_id=YACV3UAOCHIYM6GBYHUUS7NIMTEK4OMBESBJSDTKD33EVUFMPQWA, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.626629621 (82h2m47.324197937s) [noise=true , address=185.167.204.206:4048 , piece_id=BYH43OTQNKZNIX5QAHJAMMXJVSGSQSHQS4FOVJBG6SQVO6AXNEIQ, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.626944729 (82h2m47.324513045s) [noise=true , address=185.167.204.205:4035 , piece_id=JOSTAHVHVMQF34FL73QAQ7NGFKRXO2FQC27SRDXLCRVHM2ERAB4Q, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:31:59.628484184 (82h2m47.3260525s) [noise=true , address=185.167.204.206:4069 , piece_id=K3TLSVR42BDRLBEBEL7RCSJEFQJP2IXFTMNGIOOTIRMPAULDLZYA, seg_pos={0 0}, upload=71999]: Uploading piece... Dec 9 01:32:00.123690511 (82h2m47.821258817s) [upload=71999]: Next returned nil segment Dec 9 01:32:00.123699839 (82h2m47.821268145s) [upload=71999]: Waiting for error group managing segments... Dec 9 01:32:00.322927539 (82h2m48.020495845s) [noise=true , address=81.171.14.70:4048 , piece_id=X45JYZTZS6WOAAE52KLY6GSDLUZPRYIVNEMTT6HWTWM24KO3S4ZA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.325012214 (82h2m48.02258053s) [noise=true , address=185.167.204.206:4052 , piece_id=PKW23KQRLZ3F66AR7A373EOCHJ6VKCDDUTCBMDJRPU2N4AVGNOCQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.350134142 (82h2m48.047702448s) [noise=true , address=185.167.204.205:4025 , piece_id=RQD2EZZLSCAIPEKCNOHVJ4OVUJFWVIBUH2SYVQC3JINRER32XEIQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.367082622 (82h2m48.064650928s) [noise=true , address=89.149.201.147:4009 , piece_id=STHOB6BEHQHWMM5D5GUKCHG4JCY5XBYSPBSCIMY22BROCWIZMHHQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.676324131 (82h2m48.373892468s) [noise=true , address=89.149.201.147:4003 , piece_id=TUSHGZZYDJBN6JKU4QT7MP54TQVAFBIHFNTLNAATFNE7DAIEJM4Q, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.678208262 (82h2m48.375776578s) [noise=true , address=185.167.204.205:4027 , piece_id=5ZMDJUN6H5SDZCAF3QGO7BZME4GUQVEJYPSROX6F3MYG3KXXKAOA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.697955169 (82h2m48.395523506s) [noise=true , address=185.167.204.205:4028 , piece_id=2GLODSX67GSUJQ54CM4RHVGZJY4UVWHEDOT2OBT5AQ7OSERL7NHQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.711604767 (82h2m48.409173103s) [noise=true , address=185.167.204.205:4035 , piece_id=JOSTAHVHVMQF34FL73QAQ7NGFKRXO2FQC27SRDXLCRVHM2ERAB4Q, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.720412631 (82h2m48.417980967s) [noise=true , address=89.149.201.147:4004 , piece_id=WTU4EKHHUB47TPBMPZES6BCR24URME7TUF75RV76KFA3IEX4ZEQA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.741933652 (82h2m48.439501968s) [noise=true , address=81.171.14.70:4047 , piece_id=PKJJTRQHI2ZFDRSBWK34EY4CPQN766QPAHB5DXTGOVDUAOL6V5XQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.771899840 (82h2m48.469468146s) [noise=true , address=81.171.14.70:4027 , piece_id=ZLL3YC63KXRQIOAFIKQYAKTLX4EZP7QGX6AWWIE6K6XLAQS65XEA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.814805939 (82h2m48.512374275s) [noise=true , address=89.149.201.147:4018 , piece_id=KYL3KJDB2TDTFWNKVRQUFP6F7Z3L3RLI5G5QDCQ35XFGP4MGVQ5A, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.819453711 (82h2m48.517022047s) [noise=true , address=185.167.204.206:4069 , piece_id=K3TLSVR42BDRLBEBEL7RCSJEFQJP2IXFTMNGIOOTIRMPAULDLZYA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.864084393 (82h2m48.561652729s) [noise=true , address=185.167.204.205:4033 , piece_id=YACV3UAOCHIYM6GBYHUUS7NIMTEK4OMBESBJSDTKD33EVUFMPQWA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.868123207 (82h2m48.565691543s) [noise=true , address=89.149.201.147:4001 , piece_id=JG45XZFMFBNWB7DATCH5OB4SYHF5HFXEFWKNSFEUDJBKK3RXQR7Q, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.878311820 (82h2m48.575880166s) [noise=true , address=81.171.14.70:4031 , piece_id=7GNEHRRR4SUM6CHSFM7AYVLQ625WJDJMXTVMQWXFBY5YLVOKDIKQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.889271453 (82h2m48.586839788s) [noise=true , address=185.167.204.205:4004 , piece_id=E6J2ZG36BSHLCC4757I3EKCWORW64GW7AMA7SFEWR6HQHJHQCMOQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.890795059 (82h2m48.588363394s) [noise=true , address=185.167.204.205:4011 , piece_id=UHWXGGT3QYLZP5XUXS6YNAPBAT3BWSIKCE4PAAPBR6MJMWNQH6RQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:00.998620680 (82h2m48.696188986s) [noise=true , address=185.167.204.206:4048 , piece_id=BYH43OTQNKZNIX5QAHJAMMXJVSGSQSHQS4FOVJBG6SQVO6AXNEIQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.027275558 (82h2m48.724843874s) [noise=true , address=185.167.204.205:4008 , piece_id=PIOG3NB2EXTAPCSJ4INGKS3ZCUNFDIVPJDLADM2TTXKNU3TARZVA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.053797460 (82h2m48.751365776s) [noise=true , address=81.171.14.70:4035 , piece_id=W5K2O4JU2QOGUMAM7YIE5F5YBXSUQORIJQ5MKWSXD4YLGBC4TNBQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.131350904 (82h2m48.82891922s) [noise=true , address=185.167.204.205:4009 , piece_id=QMLZQWDRUYGRKTTVJW4HQIXAEEDBFJ3UJPOECHQYNJQ6PRNT4NVQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.158873686 (82h2m48.856442002s) [noise=true , address=185.167.204.206:4058 , piece_id=OHKY3LUDKBQSTLBIMBJ37MFAT5DRTZTYITIRI46S774GLMELFARA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.180035436 (82h2m48.877603752s) [noise=true , address=81.171.14.70:4043 , piece_id=7BSMEEWW2LPNF6RRCJJPFA26PKQYXG75BHH2Y3F5UN4MBDVEDIBA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.188195249 (82h2m48.885763555s) [noise=true , address=89.149.201.147:4022 , piece_id=XJHAYYKDETNAMKBTKL6HH62GLIKNTTQODVDBQBBI6BUHGB3DW6ZQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.233922599 (82h2m48.931490935s) [noise=true , address=81.171.14.70:4037 , piece_id=AREOBU5WCCEDZ7IZRL337AYDE54IJFGC2GTGN2YHEYIWW7AZTAPA, seg_pos={0 0}, upload=71999]: Done uploading piece. err: <nil> Dec 9 01:32:01.233943509 (82h2m48.931511844s) [seg_pos={0 0}, upload=71999]: Segment reached optimal threshold of 26 pieces. Dec 9 01:32:01.234203904 (82h2m48.931772241s) [noise=true , address=81.171.14.70:4040 , piece_id=4TAY4GVJAM52W72UQPENJQSGPBF37772EAEF3AZAGIJC7CYT6PFQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV): protocol: write tcp 5.161.89.252:8752->81.171.14.70:4040: use of closed network connection; write tcp 5.161.89.252:8752->81.171.14.70:4040: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8752->81.171.14.70:4040: use of closed network connection Dec 9 01:32:01.234214134 (82h2m48.93178247s) [noise=true , address=81.171.14.70:4040 , piece_id=4TAY4GVJAM52W72UQPENJQSGPBF37772EAEF3AZAGIJC7CYT6PFQ, seg_pos={0 0}, upload=71999]: Long tail cancellation due to optimal threshold Dec 9 01:32:01.234317186 (82h2m48.931885492s) [noise=true , address=89.149.201.147:4008 , piece_id=KUDZ3FSIEXOZZO43WT3VWNZAEPDNKHDFNZUBQWPEHSWPYGH74SPQ, seg_pos={0 0}, upload=71999]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn): protocol: expected piece hash; context canceled; EOF Dec 9 01:32:01.234329118 (82h2m48.931897425s) [noise=true , address=89.149.201.147:4008 , piece_id=KUDZ3FSIEXOZZO43WT3VWNZAEPDNKHDFNZUBQWPEHSWPYGH74SPQ, seg_pos={0 0}, upload=71999]: Long tail cancellation due to optimal threshold Dec 9 01:32:01.234353294 (82h2m48.93192161s) [seg_pos={0 0}, upload=71999]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:32:01.234421882 (82h2m48.931990198s) [upload=71999]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:32:01.234425508 (82h2m48.931993824s) [upload=71999]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:32:01.394952857 (82h2m49.092521173s) [upload=71999]: Done uploading segments... Dec 9 01:32:01.394966343 (82h2m49.092534659s) [upload=71999]: Upload finished. err: <nil> Duration: 23.624182006s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 15 out of 60 is failed (threshold=3) [X..X...X.....X.X.......X...X.....X.X.X...X...X..X.X..X......] duration: 5.999151712s trace: https://jaeger.dev.storj.io/trace/26bc3f210589b51c FAIL (2025-12-09 01:30:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== .205:4030 , piece_id=QEBI4GZOJ6C3MDXC2SSQTRUO3DMTOWLRKFDZPMXOU4KGR6YO3PEA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.134813251 (81h57m8.832381558s) [noise=true , address=89.149.201.147:4019 , piece_id=LH46OTYNYXDYDN77O4WB2O7LWIARKEQVLY3GRSHCUPPNXMMUQSSA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.135086352 (81h57m8.832654668s) [noise=true , address=81.171.14.70:4042 , piece_id=JC23GEREB4ADZZNWJ7MO7NUQE2ENW52R2HGYSGZ5Q6KUF2RXY7QA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.135363689 (81h57m8.832931996s) [noise=true , address=185.167.204.206:4052 , piece_id=FC3NDDRSTHZUER2ADWE3CYOMZXDQLKJ3PQ4ZT6GZWPHSEPXY2PEA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.135664291 (81h57m8.833232597s) [noise=true , address=89.149.201.147:4008 , piece_id=IGIPJKGGGSREGXSBQG644IVTVXNYW7TS6ALRGXSRNZ2SAEDJYAKA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.136041315 (81h57m8.833609631s) [noise=true , address=185.167.204.205:4001 , piece_id=WSZXNVFJ4MGMV3HUJELXRXDDBKSIDARXIFSQZRDJD5KOUXAMDR3A, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.137414409 (81h57m8.834982725s) [noise=true , address=81.171.14.70:4036 , piece_id=OVQWGWHUMFMSKOG5MYSEUXSY3OG7YCAKJZAKY2375RYLAGLSKIXQ, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.139702634 (81h57m8.837270941s) [noise=true , address=185.167.204.205:4015 , piece_id=3FOTB6XISVZZ423A5W46YZAI3CINP7I6TS6OBULTYLOR3QPBF52Q, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.140644615 (81h57m8.83821292s) [noise=true , address=185.167.204.205:4005 , piece_id=OAV24V43WPWUUR7BRJFVQYOCR4VFCUZGQEB4UEAMYIRSM2PUVTZA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.142941475 (81h57m8.840509781s) [noise=true , address=89.149.201.147:4015 , piece_id=YKV7MYYRYOIMUCMW35SX5CI7MY66OZLYC7IQKCM4H5NV2O3FQPWQ, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.645240170 (81h57m9.342808475s) [upload=71918]: Next returned nil segment Dec 9 01:26:21.645250509 (81h57m9.342818815s) [upload=71918]: Waiting for error group managing segments... Dec 9 01:26:21.847332132 (81h57m9.544900439s) [noise=true , address=185.167.204.206:4063 , piece_id=WJ6IEWKLAM5TZJYUY6N5NB54W24HABRKUR6P6PCFOMCORXKUF3OQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.851964756 (81h57m9.549533072s) [noise=true , address=81.171.14.70:4038 , piece_id=LRE67BYLMBTLEL4APTG6JWT2ULNZBC5CVZ4L7CPIKXIC54RZIK3A, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.855636315 (81h57m9.55320462s) [noise=true , address=81.171.14.70:4040 , piece_id=RJLUY5LUF5NLPO6SGRYM3MQEJNLLL4XHB6EOKJOANW5B3JFVNVKQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.856391406 (81h57m9.553959711s) [noise=true , address=81.171.14.70:4030 , piece_id=K3NHUHYBLAARBQMINJ2LKBSPBZ56MV3HGX3XID6LTN65RLRL5NNA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.857187321 (81h57m9.554755628s) [noise=true , address=185.167.204.205:4018 , piece_id=NS2AOBXSUKHBICPNS3ATQ3FLR7V4YB5ZEU7V2NY5WRXU2P7VKFDQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.861261362 (81h57m9.558829668s) [noise=true , address=185.167.204.206:4071 , piece_id=QVNE4LNSC4QWZF2WVS7PHUZNN4RJATDRLHCUJBL3MGJN7SF6ZSIQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.869441042 (81h57m9.567009348s) [noise=true , address=89.149.201.147:4005 , piece_id=YEJ4IILQKACR5PNAWPU5XC5V6R5T73Q5SMVV7ANWOENMEQ6LKISQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.874351294 (81h57m9.5719196s) [noise=true , address=89.149.201.147:4016 , piece_id=I6MEYHKCWYCTULCLEC7QHZAOIB5LPUINGZV2OEAQM4R3JZOSFOKA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.141691121 (81h57m9.839259447s) [noise=true , address=185.167.204.205:4015 , piece_id=3FOTB6XISVZZ423A5W46YZAI3CINP7I6TS6OBULTYLOR3QPBF52Q, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.179125058 (81h57m9.876693374s) [noise=true , address=81.171.14.70:4048 , piece_id=RL7D6BMSBR3G3STLIHPLR3LT56WOUD37LCTMT4RNVYSIFRASQBXA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.221424416 (81h57m9.918992732s) [noise=true , address=185.167.204.205:4014 , piece_id=4PIIA3ZQG65JZE2VHXDQNNV57KVOYMYWO4GEI4J3VQ4C7NEZHGXQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.221735806 (81h57m9.919304113s) [noise=true , address=81.171.14.70:4042 , piece_id=JC23GEREB4ADZZNWJ7MO7NUQE2ENW52R2HGYSGZ5Q6KUF2RXY7QA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.235756768 (81h57m9.933325074s) [noise=true , address=185.167.204.206:4051 , piece_id=NZS6DGCBOEXEVMVNUNX5FLKTPKULEAH4V22NTTXLZY3WFP3WRXHA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.252727751 (81h57m9.950296057s) [noise=true , address=185.167.204.205:4029 , piece_id=GHMY2UIASFMGBAWJDMQ5QB2J5NOQ3WNDAPAN5FYEPL7K4SUXQ5AA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.292437338 (81h57m9.990005654s) [noise=true , address=185.167.204.205:4030 , piece_id=QEBI4GZOJ6C3MDXC2SSQTRUO3DMTOWLRKFDZPMXOU4KGR6YO3PEA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.306794769 (81h57m10.004363074s) [noise=true , address=89.149.201.147:4008 , piece_id=IGIPJKGGGSREGXSBQG644IVTVXNYW7TS6ALRGXSRNZ2SAEDJYAKA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.324969600 (81h57m10.022537916s) [noise=true , address=89.149.201.147:4015 , piece_id=YKV7MYYRYOIMUCMW35SX5CI7MY66OZLYC7IQKCM4H5NV2O3FQPWQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.392595977 (81h57m10.090164283s) [noise=true , address=89.149.201.147:4017 , piece_id=ZJB2REXQ5RHXT2JGD2DRCXHWVZANN4F26VOIFIWWRK5QQWIE435Q, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.423117412 (81h57m10.120685718s) [noise=true , address=185.167.204.206:4054 , piece_id=ZSZ5NKFORG6IBNWPZYIAI5SYQFJ2WSVE5GKY626FSLKRVM2MFYTA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.513668302 (81h57m10.211236618s) [noise=true , address=89.149.201.147:4011 , piece_id=4354NZDLLWPQNEVVO6BCHAIKKCROKAJPMGYO3XN6SDSLRVDKV2QQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.575888201 (81h57m10.273456506s) [noise=true , address=89.149.201.147:4021 , piece_id=2K4XC4DAZ6JHL3OZ3MS4JXAAATMOBSVICLBJ2PZX6FD44XNTZD2Q, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.583090976 (81h57m10.280659292s) [noise=true , address=81.171.14.70:4041 , piece_id=OYVR4OKBP6GF2GTEVRHHWVE2URIHQRBO2HTUBWWKY52UEXTVNS7A, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.604254129 (81h57m10.301822445s) [noise=true , address=185.167.204.205:4005 , piece_id=OAV24V43WPWUUR7BRJFVQYOCR4VFCUZGQEB4UEAMYIRSM2PUVTZA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.694613544 (81h57m10.39218186s) [noise=true , address=185.167.204.206:4052 , piece_id=FC3NDDRSTHZUER2ADWE3CYOMZXDQLKJ3PQ4ZT6GZWPHSEPXY2PEA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.704271264 (81h57m10.40183958s) [noise=true , address=81.171.14.70:4036 , piece_id=OVQWGWHUMFMSKOG5MYSEUXSY3OG7YCAKJZAKY2375RYLAGLSKIXQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.746456667 (81h57m10.444024973s) [noise=true , address=185.167.204.205:4001 , piece_id=WSZXNVFJ4MGMV3HUJELXRXDDBKSIDARXIFSQZRDJD5KOUXAMDR3A, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.746471184 (81h57m10.444039491s) [seg_pos={0 0}, upload=71918]: Segment reached optimal threshold of 26 pieces. Dec 9 01:26:22.746650078 (81h57m10.444218394s) [noise=true , address=89.149.201.147:4019 , piece_id=LH46OTYNYXDYDN77O4WB2O7LWIARKEQVLY3GRSHCUPPNXMMUQSSA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: write tcp 5.161.89.252:15236->89.149.201.147:4019: use of closed network connection; write tcp 5.161.89.252:15236->89.149.201.147:4019: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:15236->89.149.201.147:4019: use of closed network connection Dec 9 01:26:22.746656770 (81h57m10.444225077s) [noise=true , address=89.149.201.147:4019 , piece_id=LH46OTYNYXDYDN77O4WB2O7LWIARKEQVLY3GRSHCUPPNXMMUQSSA, seg_pos={0 0}, upload=71918]: Long tail cancellation due to optimal threshold Dec 9 01:26:22.746700172 (81h57m10.444268478s) [noise=true , address=185.167.204.205:4033 , piece_id=F577SLHIMLXVHIOAMQTT7BWCEOKNGDAQLZGYFFRRKPB6HQJ7PTKA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: expected piece hash; context canceled; EOF Dec 9 01:26:22.746707656 (81h57m10.444275962s) [noise=true , address=185.167.204.205:4033 , piece_id=F577SLHIMLXVHIOAMQTT7BWCEOKNGDAQLZGYFFRRKPB6HQJ7PTKA, seg_pos={0 0}, upload=71918]: Long tail cancellation due to optimal threshold Dec 9 01:26:22.746721752 (81h57m10.444290068s) [seg_pos={0 0}, upload=71918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:26:22.746778107 (81h57m10.444346413s) [upload=71918]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:26:22.746781894 (81h57m10.4443502s) [upload=71918]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:26:22.899446395 (81h57m10.597014702s) [upload=71918]: Done uploading segments... Dec 9 01:26:22.899459901 (81h57m10.597028207s) [upload=71918]: Upload finished. err: <nil> Duration: 5.999207076s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 16 out of 60 is failed (threshold=3) [XX..X...X.....X.X.......X...X.....X.X.X...X...X..X.X..X.....] duration: 16.756884909s trace: https://jaeger.dev.storj.io/trace/26bc3f210589b51c FAIL (2025-12-09 01:30:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== .205:4030 , piece_id=QEBI4GZOJ6C3MDXC2SSQTRUO3DMTOWLRKFDZPMXOU4KGR6YO3PEA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.134813251 (81h57m8.832381558s) [noise=true , address=89.149.201.147:4019 , piece_id=LH46OTYNYXDYDN77O4WB2O7LWIARKEQVLY3GRSHCUPPNXMMUQSSA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.135086352 (81h57m8.832654668s) [noise=true , address=81.171.14.70:4042 , piece_id=JC23GEREB4ADZZNWJ7MO7NUQE2ENW52R2HGYSGZ5Q6KUF2RXY7QA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.135363689 (81h57m8.832931996s) [noise=true , address=185.167.204.206:4052 , piece_id=FC3NDDRSTHZUER2ADWE3CYOMZXDQLKJ3PQ4ZT6GZWPHSEPXY2PEA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.135664291 (81h57m8.833232597s) [noise=true , address=89.149.201.147:4008 , piece_id=IGIPJKGGGSREGXSBQG644IVTVXNYW7TS6ALRGXSRNZ2SAEDJYAKA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.136041315 (81h57m8.833609631s) [noise=true , address=185.167.204.205:4001 , piece_id=WSZXNVFJ4MGMV3HUJELXRXDDBKSIDARXIFSQZRDJD5KOUXAMDR3A, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.137414409 (81h57m8.834982725s) [noise=true , address=81.171.14.70:4036 , piece_id=OVQWGWHUMFMSKOG5MYSEUXSY3OG7YCAKJZAKY2375RYLAGLSKIXQ, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.139702634 (81h57m8.837270941s) [noise=true , address=185.167.204.205:4015 , piece_id=3FOTB6XISVZZ423A5W46YZAI3CINP7I6TS6OBULTYLOR3QPBF52Q, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.140644615 (81h57m8.83821292s) [noise=true , address=185.167.204.205:4005 , piece_id=OAV24V43WPWUUR7BRJFVQYOCR4VFCUZGQEB4UEAMYIRSM2PUVTZA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.142941475 (81h57m8.840509781s) [noise=true , address=89.149.201.147:4015 , piece_id=YKV7MYYRYOIMUCMW35SX5CI7MY66OZLYC7IQKCM4H5NV2O3FQPWQ, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.645240170 (81h57m9.342808475s) [upload=71918]: Next returned nil segment Dec 9 01:26:21.645250509 (81h57m9.342818815s) [upload=71918]: Waiting for error group managing segments... Dec 9 01:26:21.847332132 (81h57m9.544900439s) [noise=true , address=185.167.204.206:4063 , piece_id=WJ6IEWKLAM5TZJYUY6N5NB54W24HABRKUR6P6PCFOMCORXKUF3OQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.851964756 (81h57m9.549533072s) [noise=true , address=81.171.14.70:4038 , piece_id=LRE67BYLMBTLEL4APTG6JWT2ULNZBC5CVZ4L7CPIKXIC54RZIK3A, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.855636315 (81h57m9.55320462s) [noise=true , address=81.171.14.70:4040 , piece_id=RJLUY5LUF5NLPO6SGRYM3MQEJNLLL4XHB6EOKJOANW5B3JFVNVKQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.856391406 (81h57m9.553959711s) [noise=true , address=81.171.14.70:4030 , piece_id=K3NHUHYBLAARBQMINJ2LKBSPBZ56MV3HGX3XID6LTN65RLRL5NNA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.857187321 (81h57m9.554755628s) [noise=true , address=185.167.204.205:4018 , piece_id=NS2AOBXSUKHBICPNS3ATQ3FLR7V4YB5ZEU7V2NY5WRXU2P7VKFDQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.861261362 (81h57m9.558829668s) [noise=true , address=185.167.204.206:4071 , piece_id=QVNE4LNSC4QWZF2WVS7PHUZNN4RJATDRLHCUJBL3MGJN7SF6ZSIQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.869441042 (81h57m9.567009348s) [noise=true , address=89.149.201.147:4005 , piece_id=YEJ4IILQKACR5PNAWPU5XC5V6R5T73Q5SMVV7ANWOENMEQ6LKISQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.874351294 (81h57m9.5719196s) [noise=true , address=89.149.201.147:4016 , piece_id=I6MEYHKCWYCTULCLEC7QHZAOIB5LPUINGZV2OEAQM4R3JZOSFOKA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.141691121 (81h57m9.839259447s) [noise=true , address=185.167.204.205:4015 , piece_id=3FOTB6XISVZZ423A5W46YZAI3CINP7I6TS6OBULTYLOR3QPBF52Q, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.179125058 (81h57m9.876693374s) [noise=true , address=81.171.14.70:4048 , piece_id=RL7D6BMSBR3G3STLIHPLR3LT56WOUD37LCTMT4RNVYSIFRASQBXA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.221424416 (81h57m9.918992732s) [noise=true , address=185.167.204.205:4014 , piece_id=4PIIA3ZQG65JZE2VHXDQNNV57KVOYMYWO4GEI4J3VQ4C7NEZHGXQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.221735806 (81h57m9.919304113s) [noise=true , address=81.171.14.70:4042 , piece_id=JC23GEREB4ADZZNWJ7MO7NUQE2ENW52R2HGYSGZ5Q6KUF2RXY7QA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.235756768 (81h57m9.933325074s) [noise=true , address=185.167.204.206:4051 , piece_id=NZS6DGCBOEXEVMVNUNX5FLKTPKULEAH4V22NTTXLZY3WFP3WRXHA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.252727751 (81h57m9.950296057s) [noise=true , address=185.167.204.205:4029 , piece_id=GHMY2UIASFMGBAWJDMQ5QB2J5NOQ3WNDAPAN5FYEPL7K4SUXQ5AA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.292437338 (81h57m9.990005654s) [noise=true , address=185.167.204.205:4030 , piece_id=QEBI4GZOJ6C3MDXC2SSQTRUO3DMTOWLRKFDZPMXOU4KGR6YO3PEA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.306794769 (81h57m10.004363074s) [noise=true , address=89.149.201.147:4008 , piece_id=IGIPJKGGGSREGXSBQG644IVTVXNYW7TS6ALRGXSRNZ2SAEDJYAKA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.324969600 (81h57m10.022537916s) [noise=true , address=89.149.201.147:4015 , piece_id=YKV7MYYRYOIMUCMW35SX5CI7MY66OZLYC7IQKCM4H5NV2O3FQPWQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.392595977 (81h57m10.090164283s) [noise=true , address=89.149.201.147:4017 , piece_id=ZJB2REXQ5RHXT2JGD2DRCXHWVZANN4F26VOIFIWWRK5QQWIE435Q, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.423117412 (81h57m10.120685718s) [noise=true , address=185.167.204.206:4054 , piece_id=ZSZ5NKFORG6IBNWPZYIAI5SYQFJ2WSVE5GKY626FSLKRVM2MFYTA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.513668302 (81h57m10.211236618s) [noise=true , address=89.149.201.147:4011 , piece_id=4354NZDLLWPQNEVVO6BCHAIKKCROKAJPMGYO3XN6SDSLRVDKV2QQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.575888201 (81h57m10.273456506s) [noise=true , address=89.149.201.147:4021 , piece_id=2K4XC4DAZ6JHL3OZ3MS4JXAAATMOBSVICLBJ2PZX6FD44XNTZD2Q, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.583090976 (81h57m10.280659292s) [noise=true , address=81.171.14.70:4041 , piece_id=OYVR4OKBP6GF2GTEVRHHWVE2URIHQRBO2HTUBWWKY52UEXTVNS7A, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.604254129 (81h57m10.301822445s) [noise=true , address=185.167.204.205:4005 , piece_id=OAV24V43WPWUUR7BRJFVQYOCR4VFCUZGQEB4UEAMYIRSM2PUVTZA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.694613544 (81h57m10.39218186s) [noise=true , address=185.167.204.206:4052 , piece_id=FC3NDDRSTHZUER2ADWE3CYOMZXDQLKJ3PQ4ZT6GZWPHSEPXY2PEA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.704271264 (81h57m10.40183958s) [noise=true , address=81.171.14.70:4036 , piece_id=OVQWGWHUMFMSKOG5MYSEUXSY3OG7YCAKJZAKY2375RYLAGLSKIXQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.746456667 (81h57m10.444024973s) [noise=true , address=185.167.204.205:4001 , piece_id=WSZXNVFJ4MGMV3HUJELXRXDDBKSIDARXIFSQZRDJD5KOUXAMDR3A, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.746471184 (81h57m10.444039491s) [seg_pos={0 0}, upload=71918]: Segment reached optimal threshold of 26 pieces. Dec 9 01:26:22.746650078 (81h57m10.444218394s) [noise=true , address=89.149.201.147:4019 , piece_id=LH46OTYNYXDYDN77O4WB2O7LWIARKEQVLY3GRSHCUPPNXMMUQSSA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: write tcp 5.161.89.252:15236->89.149.201.147:4019: use of closed network connection; write tcp 5.161.89.252:15236->89.149.201.147:4019: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:15236->89.149.201.147:4019: use of closed network connection Dec 9 01:26:22.746656770 (81h57m10.444225077s) [noise=true , address=89.149.201.147:4019 , piece_id=LH46OTYNYXDYDN77O4WB2O7LWIARKEQVLY3GRSHCUPPNXMMUQSSA, seg_pos={0 0}, upload=71918]: Long tail cancellation due to optimal threshold Dec 9 01:26:22.746700172 (81h57m10.444268478s) [noise=true , address=185.167.204.205:4033 , piece_id=F577SLHIMLXVHIOAMQTT7BWCEOKNGDAQLZGYFFRRKPB6HQJ7PTKA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: expected piece hash; context canceled; EOF Dec 9 01:26:22.746707656 (81h57m10.444275962s) [noise=true , address=185.167.204.205:4033 , piece_id=F577SLHIMLXVHIOAMQTT7BWCEOKNGDAQLZGYFFRRKPB6HQJ7PTKA, seg_pos={0 0}, upload=71918]: Long tail cancellation due to optimal threshold Dec 9 01:26:22.746721752 (81h57m10.444290068s) [seg_pos={0 0}, upload=71918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:26:22.746778107 (81h57m10.444346413s) [upload=71918]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:26:22.746781894 (81h57m10.4443502s) [upload=71918]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:26:22.899446395 (81h57m10.597014702s) [upload=71918]: Done uploading segments... Dec 9 01:26:22.899459901 (81h57m10.597028207s) [upload=71918]: Upload finished. err: <nil> Duration: 16.756911138s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 16 out of 60 is failed (threshold=3) [.XX..X...X.....X.X.......X...X.....X.X.X...X...X..X.X..X....] duration: 6.817145192s trace: https://jaeger.dev.storj.io/trace/26bc3f210589b51c FAIL (2025-12-09 01:29:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== .205:4030 , piece_id=QEBI4GZOJ6C3MDXC2SSQTRUO3DMTOWLRKFDZPMXOU4KGR6YO3PEA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.134813251 (81h57m8.832381558s) [noise=true , address=89.149.201.147:4019 , piece_id=LH46OTYNYXDYDN77O4WB2O7LWIARKEQVLY3GRSHCUPPNXMMUQSSA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.135086352 (81h57m8.832654668s) [noise=true , address=81.171.14.70:4042 , piece_id=JC23GEREB4ADZZNWJ7MO7NUQE2ENW52R2HGYSGZ5Q6KUF2RXY7QA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.135363689 (81h57m8.832931996s) [noise=true , address=185.167.204.206:4052 , piece_id=FC3NDDRSTHZUER2ADWE3CYOMZXDQLKJ3PQ4ZT6GZWPHSEPXY2PEA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.135664291 (81h57m8.833232597s) [noise=true , address=89.149.201.147:4008 , piece_id=IGIPJKGGGSREGXSBQG644IVTVXNYW7TS6ALRGXSRNZ2SAEDJYAKA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.136041315 (81h57m8.833609631s) [noise=true , address=185.167.204.205:4001 , piece_id=WSZXNVFJ4MGMV3HUJELXRXDDBKSIDARXIFSQZRDJD5KOUXAMDR3A, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.137414409 (81h57m8.834982725s) [noise=true , address=81.171.14.70:4036 , piece_id=OVQWGWHUMFMSKOG5MYSEUXSY3OG7YCAKJZAKY2375RYLAGLSKIXQ, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.139702634 (81h57m8.837270941s) [noise=true , address=185.167.204.205:4015 , piece_id=3FOTB6XISVZZ423A5W46YZAI3CINP7I6TS6OBULTYLOR3QPBF52Q, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.140644615 (81h57m8.83821292s) [noise=true , address=185.167.204.205:4005 , piece_id=OAV24V43WPWUUR7BRJFVQYOCR4VFCUZGQEB4UEAMYIRSM2PUVTZA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.142941475 (81h57m8.840509781s) [noise=true , address=89.149.201.147:4015 , piece_id=YKV7MYYRYOIMUCMW35SX5CI7MY66OZLYC7IQKCM4H5NV2O3FQPWQ, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.645240170 (81h57m9.342808475s) [upload=71918]: Next returned nil segment Dec 9 01:26:21.645250509 (81h57m9.342818815s) [upload=71918]: Waiting for error group managing segments... Dec 9 01:26:21.847332132 (81h57m9.544900439s) [noise=true , address=185.167.204.206:4063 , piece_id=WJ6IEWKLAM5TZJYUY6N5NB54W24HABRKUR6P6PCFOMCORXKUF3OQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.851964756 (81h57m9.549533072s) [noise=true , address=81.171.14.70:4038 , piece_id=LRE67BYLMBTLEL4APTG6JWT2ULNZBC5CVZ4L7CPIKXIC54RZIK3A, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.855636315 (81h57m9.55320462s) [noise=true , address=81.171.14.70:4040 , piece_id=RJLUY5LUF5NLPO6SGRYM3MQEJNLLL4XHB6EOKJOANW5B3JFVNVKQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.856391406 (81h57m9.553959711s) [noise=true , address=81.171.14.70:4030 , piece_id=K3NHUHYBLAARBQMINJ2LKBSPBZ56MV3HGX3XID6LTN65RLRL5NNA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.857187321 (81h57m9.554755628s) [noise=true , address=185.167.204.205:4018 , piece_id=NS2AOBXSUKHBICPNS3ATQ3FLR7V4YB5ZEU7V2NY5WRXU2P7VKFDQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.861261362 (81h57m9.558829668s) [noise=true , address=185.167.204.206:4071 , piece_id=QVNE4LNSC4QWZF2WVS7PHUZNN4RJATDRLHCUJBL3MGJN7SF6ZSIQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.869441042 (81h57m9.567009348s) [noise=true , address=89.149.201.147:4005 , piece_id=YEJ4IILQKACR5PNAWPU5XC5V6R5T73Q5SMVV7ANWOENMEQ6LKISQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.874351294 (81h57m9.5719196s) [noise=true , address=89.149.201.147:4016 , piece_id=I6MEYHKCWYCTULCLEC7QHZAOIB5LPUINGZV2OEAQM4R3JZOSFOKA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.141691121 (81h57m9.839259447s) [noise=true , address=185.167.204.205:4015 , piece_id=3FOTB6XISVZZ423A5W46YZAI3CINP7I6TS6OBULTYLOR3QPBF52Q, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.179125058 (81h57m9.876693374s) [noise=true , address=81.171.14.70:4048 , piece_id=RL7D6BMSBR3G3STLIHPLR3LT56WOUD37LCTMT4RNVYSIFRASQBXA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.221424416 (81h57m9.918992732s) [noise=true , address=185.167.204.205:4014 , piece_id=4PIIA3ZQG65JZE2VHXDQNNV57KVOYMYWO4GEI4J3VQ4C7NEZHGXQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.221735806 (81h57m9.919304113s) [noise=true , address=81.171.14.70:4042 , piece_id=JC23GEREB4ADZZNWJ7MO7NUQE2ENW52R2HGYSGZ5Q6KUF2RXY7QA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.235756768 (81h57m9.933325074s) [noise=true , address=185.167.204.206:4051 , piece_id=NZS6DGCBOEXEVMVNUNX5FLKTPKULEAH4V22NTTXLZY3WFP3WRXHA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.252727751 (81h57m9.950296057s) [noise=true , address=185.167.204.205:4029 , piece_id=GHMY2UIASFMGBAWJDMQ5QB2J5NOQ3WNDAPAN5FYEPL7K4SUXQ5AA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.292437338 (81h57m9.990005654s) [noise=true , address=185.167.204.205:4030 , piece_id=QEBI4GZOJ6C3MDXC2SSQTRUO3DMTOWLRKFDZPMXOU4KGR6YO3PEA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.306794769 (81h57m10.004363074s) [noise=true , address=89.149.201.147:4008 , piece_id=IGIPJKGGGSREGXSBQG644IVTVXNYW7TS6ALRGXSRNZ2SAEDJYAKA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.324969600 (81h57m10.022537916s) [noise=true , address=89.149.201.147:4015 , piece_id=YKV7MYYRYOIMUCMW35SX5CI7MY66OZLYC7IQKCM4H5NV2O3FQPWQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.392595977 (81h57m10.090164283s) [noise=true , address=89.149.201.147:4017 , piece_id=ZJB2REXQ5RHXT2JGD2DRCXHWVZANN4F26VOIFIWWRK5QQWIE435Q, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.423117412 (81h57m10.120685718s) [noise=true , address=185.167.204.206:4054 , piece_id=ZSZ5NKFORG6IBNWPZYIAI5SYQFJ2WSVE5GKY626FSLKRVM2MFYTA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.513668302 (81h57m10.211236618s) [noise=true , address=89.149.201.147:4011 , piece_id=4354NZDLLWPQNEVVO6BCHAIKKCROKAJPMGYO3XN6SDSLRVDKV2QQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.575888201 (81h57m10.273456506s) [noise=true , address=89.149.201.147:4021 , piece_id=2K4XC4DAZ6JHL3OZ3MS4JXAAATMOBSVICLBJ2PZX6FD44XNTZD2Q, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.583090976 (81h57m10.280659292s) [noise=true , address=81.171.14.70:4041 , piece_id=OYVR4OKBP6GF2GTEVRHHWVE2URIHQRBO2HTUBWWKY52UEXTVNS7A, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.604254129 (81h57m10.301822445s) [noise=true , address=185.167.204.205:4005 , piece_id=OAV24V43WPWUUR7BRJFVQYOCR4VFCUZGQEB4UEAMYIRSM2PUVTZA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.694613544 (81h57m10.39218186s) [noise=true , address=185.167.204.206:4052 , piece_id=FC3NDDRSTHZUER2ADWE3CYOMZXDQLKJ3PQ4ZT6GZWPHSEPXY2PEA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.704271264 (81h57m10.40183958s) [noise=true , address=81.171.14.70:4036 , piece_id=OVQWGWHUMFMSKOG5MYSEUXSY3OG7YCAKJZAKY2375RYLAGLSKIXQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.746456667 (81h57m10.444024973s) [noise=true , address=185.167.204.205:4001 , piece_id=WSZXNVFJ4MGMV3HUJELXRXDDBKSIDARXIFSQZRDJD5KOUXAMDR3A, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.746471184 (81h57m10.444039491s) [seg_pos={0 0}, upload=71918]: Segment reached optimal threshold of 26 pieces. Dec 9 01:26:22.746650078 (81h57m10.444218394s) [noise=true , address=89.149.201.147:4019 , piece_id=LH46OTYNYXDYDN77O4WB2O7LWIARKEQVLY3GRSHCUPPNXMMUQSSA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: write tcp 5.161.89.252:15236->89.149.201.147:4019: use of closed network connection; write tcp 5.161.89.252:15236->89.149.201.147:4019: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:15236->89.149.201.147:4019: use of closed network connection Dec 9 01:26:22.746656770 (81h57m10.444225077s) [noise=true , address=89.149.201.147:4019 , piece_id=LH46OTYNYXDYDN77O4WB2O7LWIARKEQVLY3GRSHCUPPNXMMUQSSA, seg_pos={0 0}, upload=71918]: Long tail cancellation due to optimal threshold Dec 9 01:26:22.746700172 (81h57m10.444268478s) [noise=true , address=185.167.204.205:4033 , piece_id=F577SLHIMLXVHIOAMQTT7BWCEOKNGDAQLZGYFFRRKPB6HQJ7PTKA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: expected piece hash; context canceled; EOF Dec 9 01:26:22.746707656 (81h57m10.444275962s) [noise=true , address=185.167.204.205:4033 , piece_id=F577SLHIMLXVHIOAMQTT7BWCEOKNGDAQLZGYFFRRKPB6HQJ7PTKA, seg_pos={0 0}, upload=71918]: Long tail cancellation due to optimal threshold Dec 9 01:26:22.746721752 (81h57m10.444290068s) [seg_pos={0 0}, upload=71918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:26:22.746778107 (81h57m10.444346413s) [upload=71918]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:26:22.746781894 (81h57m10.4443502s) [upload=71918]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:26:22.899446395 (81h57m10.597014702s) [upload=71918]: Done uploading segments... Dec 9 01:26:22.899459901 (81h57m10.597028207s) [upload=71918]: Upload finished. err: <nil> Duration: 6.817162174s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 16 out of 60 is failed (threshold=3) [..XX..X...X.....X.X.......X...X.....X.X.X...X...X..X.X..X...] duration: 4.728143795s trace: https://jaeger.dev.storj.io/trace/26bc3f210589b51c FAIL (2025-12-09 01:28:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== .205:4030 , piece_id=QEBI4GZOJ6C3MDXC2SSQTRUO3DMTOWLRKFDZPMXOU4KGR6YO3PEA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.134813251 (81h57m8.832381558s) [noise=true , address=89.149.201.147:4019 , piece_id=LH46OTYNYXDYDN77O4WB2O7LWIARKEQVLY3GRSHCUPPNXMMUQSSA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.135086352 (81h57m8.832654668s) [noise=true , address=81.171.14.70:4042 , piece_id=JC23GEREB4ADZZNWJ7MO7NUQE2ENW52R2HGYSGZ5Q6KUF2RXY7QA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.135363689 (81h57m8.832931996s) [noise=true , address=185.167.204.206:4052 , piece_id=FC3NDDRSTHZUER2ADWE3CYOMZXDQLKJ3PQ4ZT6GZWPHSEPXY2PEA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.135664291 (81h57m8.833232597s) [noise=true , address=89.149.201.147:4008 , piece_id=IGIPJKGGGSREGXSBQG644IVTVXNYW7TS6ALRGXSRNZ2SAEDJYAKA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.136041315 (81h57m8.833609631s) [noise=true , address=185.167.204.205:4001 , piece_id=WSZXNVFJ4MGMV3HUJELXRXDDBKSIDARXIFSQZRDJD5KOUXAMDR3A, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.137414409 (81h57m8.834982725s) [noise=true , address=81.171.14.70:4036 , piece_id=OVQWGWHUMFMSKOG5MYSEUXSY3OG7YCAKJZAKY2375RYLAGLSKIXQ, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.139702634 (81h57m8.837270941s) [noise=true , address=185.167.204.205:4015 , piece_id=3FOTB6XISVZZ423A5W46YZAI3CINP7I6TS6OBULTYLOR3QPBF52Q, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.140644615 (81h57m8.83821292s) [noise=true , address=185.167.204.205:4005 , piece_id=OAV24V43WPWUUR7BRJFVQYOCR4VFCUZGQEB4UEAMYIRSM2PUVTZA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.142941475 (81h57m8.840509781s) [noise=true , address=89.149.201.147:4015 , piece_id=YKV7MYYRYOIMUCMW35SX5CI7MY66OZLYC7IQKCM4H5NV2O3FQPWQ, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.645240170 (81h57m9.342808475s) [upload=71918]: Next returned nil segment Dec 9 01:26:21.645250509 (81h57m9.342818815s) [upload=71918]: Waiting for error group managing segments... Dec 9 01:26:21.847332132 (81h57m9.544900439s) [noise=true , address=185.167.204.206:4063 , piece_id=WJ6IEWKLAM5TZJYUY6N5NB54W24HABRKUR6P6PCFOMCORXKUF3OQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.851964756 (81h57m9.549533072s) [noise=true , address=81.171.14.70:4038 , piece_id=LRE67BYLMBTLEL4APTG6JWT2ULNZBC5CVZ4L7CPIKXIC54RZIK3A, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.855636315 (81h57m9.55320462s) [noise=true , address=81.171.14.70:4040 , piece_id=RJLUY5LUF5NLPO6SGRYM3MQEJNLLL4XHB6EOKJOANW5B3JFVNVKQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.856391406 (81h57m9.553959711s) [noise=true , address=81.171.14.70:4030 , piece_id=K3NHUHYBLAARBQMINJ2LKBSPBZ56MV3HGX3XID6LTN65RLRL5NNA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.857187321 (81h57m9.554755628s) [noise=true , address=185.167.204.205:4018 , piece_id=NS2AOBXSUKHBICPNS3ATQ3FLR7V4YB5ZEU7V2NY5WRXU2P7VKFDQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.861261362 (81h57m9.558829668s) [noise=true , address=185.167.204.206:4071 , piece_id=QVNE4LNSC4QWZF2WVS7PHUZNN4RJATDRLHCUJBL3MGJN7SF6ZSIQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.869441042 (81h57m9.567009348s) [noise=true , address=89.149.201.147:4005 , piece_id=YEJ4IILQKACR5PNAWPU5XC5V6R5T73Q5SMVV7ANWOENMEQ6LKISQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.874351294 (81h57m9.5719196s) [noise=true , address=89.149.201.147:4016 , piece_id=I6MEYHKCWYCTULCLEC7QHZAOIB5LPUINGZV2OEAQM4R3JZOSFOKA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.141691121 (81h57m9.839259447s) [noise=true , address=185.167.204.205:4015 , piece_id=3FOTB6XISVZZ423A5W46YZAI3CINP7I6TS6OBULTYLOR3QPBF52Q, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.179125058 (81h57m9.876693374s) [noise=true , address=81.171.14.70:4048 , piece_id=RL7D6BMSBR3G3STLIHPLR3LT56WOUD37LCTMT4RNVYSIFRASQBXA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.221424416 (81h57m9.918992732s) [noise=true , address=185.167.204.205:4014 , piece_id=4PIIA3ZQG65JZE2VHXDQNNV57KVOYMYWO4GEI4J3VQ4C7NEZHGXQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.221735806 (81h57m9.919304113s) [noise=true , address=81.171.14.70:4042 , piece_id=JC23GEREB4ADZZNWJ7MO7NUQE2ENW52R2HGYSGZ5Q6KUF2RXY7QA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.235756768 (81h57m9.933325074s) [noise=true , address=185.167.204.206:4051 , piece_id=NZS6DGCBOEXEVMVNUNX5FLKTPKULEAH4V22NTTXLZY3WFP3WRXHA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.252727751 (81h57m9.950296057s) [noise=true , address=185.167.204.205:4029 , piece_id=GHMY2UIASFMGBAWJDMQ5QB2J5NOQ3WNDAPAN5FYEPL7K4SUXQ5AA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.292437338 (81h57m9.990005654s) [noise=true , address=185.167.204.205:4030 , piece_id=QEBI4GZOJ6C3MDXC2SSQTRUO3DMTOWLRKFDZPMXOU4KGR6YO3PEA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.306794769 (81h57m10.004363074s) [noise=true , address=89.149.201.147:4008 , piece_id=IGIPJKGGGSREGXSBQG644IVTVXNYW7TS6ALRGXSRNZ2SAEDJYAKA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.324969600 (81h57m10.022537916s) [noise=true , address=89.149.201.147:4015 , piece_id=YKV7MYYRYOIMUCMW35SX5CI7MY66OZLYC7IQKCM4H5NV2O3FQPWQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.392595977 (81h57m10.090164283s) [noise=true , address=89.149.201.147:4017 , piece_id=ZJB2REXQ5RHXT2JGD2DRCXHWVZANN4F26VOIFIWWRK5QQWIE435Q, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.423117412 (81h57m10.120685718s) [noise=true , address=185.167.204.206:4054 , piece_id=ZSZ5NKFORG6IBNWPZYIAI5SYQFJ2WSVE5GKY626FSLKRVM2MFYTA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.513668302 (81h57m10.211236618s) [noise=true , address=89.149.201.147:4011 , piece_id=4354NZDLLWPQNEVVO6BCHAIKKCROKAJPMGYO3XN6SDSLRVDKV2QQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.575888201 (81h57m10.273456506s) [noise=true , address=89.149.201.147:4021 , piece_id=2K4XC4DAZ6JHL3OZ3MS4JXAAATMOBSVICLBJ2PZX6FD44XNTZD2Q, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.583090976 (81h57m10.280659292s) [noise=true , address=81.171.14.70:4041 , piece_id=OYVR4OKBP6GF2GTEVRHHWVE2URIHQRBO2HTUBWWKY52UEXTVNS7A, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.604254129 (81h57m10.301822445s) [noise=true , address=185.167.204.205:4005 , piece_id=OAV24V43WPWUUR7BRJFVQYOCR4VFCUZGQEB4UEAMYIRSM2PUVTZA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.694613544 (81h57m10.39218186s) [noise=true , address=185.167.204.206:4052 , piece_id=FC3NDDRSTHZUER2ADWE3CYOMZXDQLKJ3PQ4ZT6GZWPHSEPXY2PEA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.704271264 (81h57m10.40183958s) [noise=true , address=81.171.14.70:4036 , piece_id=OVQWGWHUMFMSKOG5MYSEUXSY3OG7YCAKJZAKY2375RYLAGLSKIXQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.746456667 (81h57m10.444024973s) [noise=true , address=185.167.204.205:4001 , piece_id=WSZXNVFJ4MGMV3HUJELXRXDDBKSIDARXIFSQZRDJD5KOUXAMDR3A, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.746471184 (81h57m10.444039491s) [seg_pos={0 0}, upload=71918]: Segment reached optimal threshold of 26 pieces. Dec 9 01:26:22.746650078 (81h57m10.444218394s) [noise=true , address=89.149.201.147:4019 , piece_id=LH46OTYNYXDYDN77O4WB2O7LWIARKEQVLY3GRSHCUPPNXMMUQSSA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: write tcp 5.161.89.252:15236->89.149.201.147:4019: use of closed network connection; write tcp 5.161.89.252:15236->89.149.201.147:4019: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:15236->89.149.201.147:4019: use of closed network connection Dec 9 01:26:22.746656770 (81h57m10.444225077s) [noise=true , address=89.149.201.147:4019 , piece_id=LH46OTYNYXDYDN77O4WB2O7LWIARKEQVLY3GRSHCUPPNXMMUQSSA, seg_pos={0 0}, upload=71918]: Long tail cancellation due to optimal threshold Dec 9 01:26:22.746700172 (81h57m10.444268478s) [noise=true , address=185.167.204.205:4033 , piece_id=F577SLHIMLXVHIOAMQTT7BWCEOKNGDAQLZGYFFRRKPB6HQJ7PTKA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: expected piece hash; context canceled; EOF Dec 9 01:26:22.746707656 (81h57m10.444275962s) [noise=true , address=185.167.204.205:4033 , piece_id=F577SLHIMLXVHIOAMQTT7BWCEOKNGDAQLZGYFFRRKPB6HQJ7PTKA, seg_pos={0 0}, upload=71918]: Long tail cancellation due to optimal threshold Dec 9 01:26:22.746721752 (81h57m10.444290068s) [seg_pos={0 0}, upload=71918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:26:22.746778107 (81h57m10.444346413s) [upload=71918]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:26:22.746781894 (81h57m10.4443502s) [upload=71918]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:26:22.899446395 (81h57m10.597014702s) [upload=71918]: Done uploading segments... Dec 9 01:26:22.899459901 (81h57m10.597028207s) [upload=71918]: Upload finished. err: <nil> Duration: 4.728162771s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 16 out of 60 is failed (threshold=3) [...XX..X...X.....X.X.......X...X.....X.X.X...X...X..X.X..X..] duration: 6.062822915s trace: https://jaeger.dev.storj.io/trace/26bc3f210589b51c FAIL (2025-12-09 01:28:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== .205:4030 , piece_id=QEBI4GZOJ6C3MDXC2SSQTRUO3DMTOWLRKFDZPMXOU4KGR6YO3PEA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.134813251 (81h57m8.832381558s) [noise=true , address=89.149.201.147:4019 , piece_id=LH46OTYNYXDYDN77O4WB2O7LWIARKEQVLY3GRSHCUPPNXMMUQSSA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.135086352 (81h57m8.832654668s) [noise=true , address=81.171.14.70:4042 , piece_id=JC23GEREB4ADZZNWJ7MO7NUQE2ENW52R2HGYSGZ5Q6KUF2RXY7QA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.135363689 (81h57m8.832931996s) [noise=true , address=185.167.204.206:4052 , piece_id=FC3NDDRSTHZUER2ADWE3CYOMZXDQLKJ3PQ4ZT6GZWPHSEPXY2PEA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.135664291 (81h57m8.833232597s) [noise=true , address=89.149.201.147:4008 , piece_id=IGIPJKGGGSREGXSBQG644IVTVXNYW7TS6ALRGXSRNZ2SAEDJYAKA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.136041315 (81h57m8.833609631s) [noise=true , address=185.167.204.205:4001 , piece_id=WSZXNVFJ4MGMV3HUJELXRXDDBKSIDARXIFSQZRDJD5KOUXAMDR3A, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.137414409 (81h57m8.834982725s) [noise=true , address=81.171.14.70:4036 , piece_id=OVQWGWHUMFMSKOG5MYSEUXSY3OG7YCAKJZAKY2375RYLAGLSKIXQ, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.139702634 (81h57m8.837270941s) [noise=true , address=185.167.204.205:4015 , piece_id=3FOTB6XISVZZ423A5W46YZAI3CINP7I6TS6OBULTYLOR3QPBF52Q, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.140644615 (81h57m8.83821292s) [noise=true , address=185.167.204.205:4005 , piece_id=OAV24V43WPWUUR7BRJFVQYOCR4VFCUZGQEB4UEAMYIRSM2PUVTZA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.142941475 (81h57m8.840509781s) [noise=true , address=89.149.201.147:4015 , piece_id=YKV7MYYRYOIMUCMW35SX5CI7MY66OZLYC7IQKCM4H5NV2O3FQPWQ, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.645240170 (81h57m9.342808475s) [upload=71918]: Next returned nil segment Dec 9 01:26:21.645250509 (81h57m9.342818815s) [upload=71918]: Waiting for error group managing segments... Dec 9 01:26:21.847332132 (81h57m9.544900439s) [noise=true , address=185.167.204.206:4063 , piece_id=WJ6IEWKLAM5TZJYUY6N5NB54W24HABRKUR6P6PCFOMCORXKUF3OQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.851964756 (81h57m9.549533072s) [noise=true , address=81.171.14.70:4038 , piece_id=LRE67BYLMBTLEL4APTG6JWT2ULNZBC5CVZ4L7CPIKXIC54RZIK3A, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.855636315 (81h57m9.55320462s) [noise=true , address=81.171.14.70:4040 , piece_id=RJLUY5LUF5NLPO6SGRYM3MQEJNLLL4XHB6EOKJOANW5B3JFVNVKQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.856391406 (81h57m9.553959711s) [noise=true , address=81.171.14.70:4030 , piece_id=K3NHUHYBLAARBQMINJ2LKBSPBZ56MV3HGX3XID6LTN65RLRL5NNA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.857187321 (81h57m9.554755628s) [noise=true , address=185.167.204.205:4018 , piece_id=NS2AOBXSUKHBICPNS3ATQ3FLR7V4YB5ZEU7V2NY5WRXU2P7VKFDQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.861261362 (81h57m9.558829668s) [noise=true , address=185.167.204.206:4071 , piece_id=QVNE4LNSC4QWZF2WVS7PHUZNN4RJATDRLHCUJBL3MGJN7SF6ZSIQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.869441042 (81h57m9.567009348s) [noise=true , address=89.149.201.147:4005 , piece_id=YEJ4IILQKACR5PNAWPU5XC5V6R5T73Q5SMVV7ANWOENMEQ6LKISQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.874351294 (81h57m9.5719196s) [noise=true , address=89.149.201.147:4016 , piece_id=I6MEYHKCWYCTULCLEC7QHZAOIB5LPUINGZV2OEAQM4R3JZOSFOKA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.141691121 (81h57m9.839259447s) [noise=true , address=185.167.204.205:4015 , piece_id=3FOTB6XISVZZ423A5W46YZAI3CINP7I6TS6OBULTYLOR3QPBF52Q, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.179125058 (81h57m9.876693374s) [noise=true , address=81.171.14.70:4048 , piece_id=RL7D6BMSBR3G3STLIHPLR3LT56WOUD37LCTMT4RNVYSIFRASQBXA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.221424416 (81h57m9.918992732s) [noise=true , address=185.167.204.205:4014 , piece_id=4PIIA3ZQG65JZE2VHXDQNNV57KVOYMYWO4GEI4J3VQ4C7NEZHGXQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.221735806 (81h57m9.919304113s) [noise=true , address=81.171.14.70:4042 , piece_id=JC23GEREB4ADZZNWJ7MO7NUQE2ENW52R2HGYSGZ5Q6KUF2RXY7QA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.235756768 (81h57m9.933325074s) [noise=true , address=185.167.204.206:4051 , piece_id=NZS6DGCBOEXEVMVNUNX5FLKTPKULEAH4V22NTTXLZY3WFP3WRXHA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.252727751 (81h57m9.950296057s) [noise=true , address=185.167.204.205:4029 , piece_id=GHMY2UIASFMGBAWJDMQ5QB2J5NOQ3WNDAPAN5FYEPL7K4SUXQ5AA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.292437338 (81h57m9.990005654s) [noise=true , address=185.167.204.205:4030 , piece_id=QEBI4GZOJ6C3MDXC2SSQTRUO3DMTOWLRKFDZPMXOU4KGR6YO3PEA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.306794769 (81h57m10.004363074s) [noise=true , address=89.149.201.147:4008 , piece_id=IGIPJKGGGSREGXSBQG644IVTVXNYW7TS6ALRGXSRNZ2SAEDJYAKA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.324969600 (81h57m10.022537916s) [noise=true , address=89.149.201.147:4015 , piece_id=YKV7MYYRYOIMUCMW35SX5CI7MY66OZLYC7IQKCM4H5NV2O3FQPWQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.392595977 (81h57m10.090164283s) [noise=true , address=89.149.201.147:4017 , piece_id=ZJB2REXQ5RHXT2JGD2DRCXHWVZANN4F26VOIFIWWRK5QQWIE435Q, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.423117412 (81h57m10.120685718s) [noise=true , address=185.167.204.206:4054 , piece_id=ZSZ5NKFORG6IBNWPZYIAI5SYQFJ2WSVE5GKY626FSLKRVM2MFYTA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.513668302 (81h57m10.211236618s) [noise=true , address=89.149.201.147:4011 , piece_id=4354NZDLLWPQNEVVO6BCHAIKKCROKAJPMGYO3XN6SDSLRVDKV2QQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.575888201 (81h57m10.273456506s) [noise=true , address=89.149.201.147:4021 , piece_id=2K4XC4DAZ6JHL3OZ3MS4JXAAATMOBSVICLBJ2PZX6FD44XNTZD2Q, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.583090976 (81h57m10.280659292s) [noise=true , address=81.171.14.70:4041 , piece_id=OYVR4OKBP6GF2GTEVRHHWVE2URIHQRBO2HTUBWWKY52UEXTVNS7A, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.604254129 (81h57m10.301822445s) [noise=true , address=185.167.204.205:4005 , piece_id=OAV24V43WPWUUR7BRJFVQYOCR4VFCUZGQEB4UEAMYIRSM2PUVTZA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.694613544 (81h57m10.39218186s) [noise=true , address=185.167.204.206:4052 , piece_id=FC3NDDRSTHZUER2ADWE3CYOMZXDQLKJ3PQ4ZT6GZWPHSEPXY2PEA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.704271264 (81h57m10.40183958s) [noise=true , address=81.171.14.70:4036 , piece_id=OVQWGWHUMFMSKOG5MYSEUXSY3OG7YCAKJZAKY2375RYLAGLSKIXQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.746456667 (81h57m10.444024973s) [noise=true , address=185.167.204.205:4001 , piece_id=WSZXNVFJ4MGMV3HUJELXRXDDBKSIDARXIFSQZRDJD5KOUXAMDR3A, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.746471184 (81h57m10.444039491s) [seg_pos={0 0}, upload=71918]: Segment reached optimal threshold of 26 pieces. Dec 9 01:26:22.746650078 (81h57m10.444218394s) [noise=true , address=89.149.201.147:4019 , piece_id=LH46OTYNYXDYDN77O4WB2O7LWIARKEQVLY3GRSHCUPPNXMMUQSSA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: write tcp 5.161.89.252:15236->89.149.201.147:4019: use of closed network connection; write tcp 5.161.89.252:15236->89.149.201.147:4019: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:15236->89.149.201.147:4019: use of closed network connection Dec 9 01:26:22.746656770 (81h57m10.444225077s) [noise=true , address=89.149.201.147:4019 , piece_id=LH46OTYNYXDYDN77O4WB2O7LWIARKEQVLY3GRSHCUPPNXMMUQSSA, seg_pos={0 0}, upload=71918]: Long tail cancellation due to optimal threshold Dec 9 01:26:22.746700172 (81h57m10.444268478s) [noise=true , address=185.167.204.205:4033 , piece_id=F577SLHIMLXVHIOAMQTT7BWCEOKNGDAQLZGYFFRRKPB6HQJ7PTKA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: expected piece hash; context canceled; EOF Dec 9 01:26:22.746707656 (81h57m10.444275962s) [noise=true , address=185.167.204.205:4033 , piece_id=F577SLHIMLXVHIOAMQTT7BWCEOKNGDAQLZGYFFRRKPB6HQJ7PTKA, seg_pos={0 0}, upload=71918]: Long tail cancellation due to optimal threshold Dec 9 01:26:22.746721752 (81h57m10.444290068s) [seg_pos={0 0}, upload=71918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:26:22.746778107 (81h57m10.444346413s) [upload=71918]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:26:22.746781894 (81h57m10.4443502s) [upload=71918]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:26:22.899446395 (81h57m10.597014702s) [upload=71918]: Done uploading segments... Dec 9 01:26:22.899459901 (81h57m10.597028207s) [upload=71918]: Upload finished. err: <nil> Duration: 6.062837753s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 16 out of 60 is failed (threshold=3) [....XX..X...X.....X.X.......X...X.....X.X.X...X...X..X.X..X.] duration: 6.395793988s trace: https://jaeger.dev.storj.io/trace/26bc3f210589b51c FAIL (2025-12-09 01:27:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== .205:4030 , piece_id=QEBI4GZOJ6C3MDXC2SSQTRUO3DMTOWLRKFDZPMXOU4KGR6YO3PEA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.134813251 (81h57m8.832381558s) [noise=true , address=89.149.201.147:4019 , piece_id=LH46OTYNYXDYDN77O4WB2O7LWIARKEQVLY3GRSHCUPPNXMMUQSSA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.135086352 (81h57m8.832654668s) [noise=true , address=81.171.14.70:4042 , piece_id=JC23GEREB4ADZZNWJ7MO7NUQE2ENW52R2HGYSGZ5Q6KUF2RXY7QA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.135363689 (81h57m8.832931996s) [noise=true , address=185.167.204.206:4052 , piece_id=FC3NDDRSTHZUER2ADWE3CYOMZXDQLKJ3PQ4ZT6GZWPHSEPXY2PEA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.135664291 (81h57m8.833232597s) [noise=true , address=89.149.201.147:4008 , piece_id=IGIPJKGGGSREGXSBQG644IVTVXNYW7TS6ALRGXSRNZ2SAEDJYAKA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.136041315 (81h57m8.833609631s) [noise=true , address=185.167.204.205:4001 , piece_id=WSZXNVFJ4MGMV3HUJELXRXDDBKSIDARXIFSQZRDJD5KOUXAMDR3A, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.137414409 (81h57m8.834982725s) [noise=true , address=81.171.14.70:4036 , piece_id=OVQWGWHUMFMSKOG5MYSEUXSY3OG7YCAKJZAKY2375RYLAGLSKIXQ, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.139702634 (81h57m8.837270941s) [noise=true , address=185.167.204.205:4015 , piece_id=3FOTB6XISVZZ423A5W46YZAI3CINP7I6TS6OBULTYLOR3QPBF52Q, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.140644615 (81h57m8.83821292s) [noise=true , address=185.167.204.205:4005 , piece_id=OAV24V43WPWUUR7BRJFVQYOCR4VFCUZGQEB4UEAMYIRSM2PUVTZA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.142941475 (81h57m8.840509781s) [noise=true , address=89.149.201.147:4015 , piece_id=YKV7MYYRYOIMUCMW35SX5CI7MY66OZLYC7IQKCM4H5NV2O3FQPWQ, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.645240170 (81h57m9.342808475s) [upload=71918]: Next returned nil segment Dec 9 01:26:21.645250509 (81h57m9.342818815s) [upload=71918]: Waiting for error group managing segments... Dec 9 01:26:21.847332132 (81h57m9.544900439s) [noise=true , address=185.167.204.206:4063 , piece_id=WJ6IEWKLAM5TZJYUY6N5NB54W24HABRKUR6P6PCFOMCORXKUF3OQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.851964756 (81h57m9.549533072s) [noise=true , address=81.171.14.70:4038 , piece_id=LRE67BYLMBTLEL4APTG6JWT2ULNZBC5CVZ4L7CPIKXIC54RZIK3A, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.855636315 (81h57m9.55320462s) [noise=true , address=81.171.14.70:4040 , piece_id=RJLUY5LUF5NLPO6SGRYM3MQEJNLLL4XHB6EOKJOANW5B3JFVNVKQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.856391406 (81h57m9.553959711s) [noise=true , address=81.171.14.70:4030 , piece_id=K3NHUHYBLAARBQMINJ2LKBSPBZ56MV3HGX3XID6LTN65RLRL5NNA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.857187321 (81h57m9.554755628s) [noise=true , address=185.167.204.205:4018 , piece_id=NS2AOBXSUKHBICPNS3ATQ3FLR7V4YB5ZEU7V2NY5WRXU2P7VKFDQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.861261362 (81h57m9.558829668s) [noise=true , address=185.167.204.206:4071 , piece_id=QVNE4LNSC4QWZF2WVS7PHUZNN4RJATDRLHCUJBL3MGJN7SF6ZSIQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.869441042 (81h57m9.567009348s) [noise=true , address=89.149.201.147:4005 , piece_id=YEJ4IILQKACR5PNAWPU5XC5V6R5T73Q5SMVV7ANWOENMEQ6LKISQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.874351294 (81h57m9.5719196s) [noise=true , address=89.149.201.147:4016 , piece_id=I6MEYHKCWYCTULCLEC7QHZAOIB5LPUINGZV2OEAQM4R3JZOSFOKA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.141691121 (81h57m9.839259447s) [noise=true , address=185.167.204.205:4015 , piece_id=3FOTB6XISVZZ423A5W46YZAI3CINP7I6TS6OBULTYLOR3QPBF52Q, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.179125058 (81h57m9.876693374s) [noise=true , address=81.171.14.70:4048 , piece_id=RL7D6BMSBR3G3STLIHPLR3LT56WOUD37LCTMT4RNVYSIFRASQBXA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.221424416 (81h57m9.918992732s) [noise=true , address=185.167.204.205:4014 , piece_id=4PIIA3ZQG65JZE2VHXDQNNV57KVOYMYWO4GEI4J3VQ4C7NEZHGXQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.221735806 (81h57m9.919304113s) [noise=true , address=81.171.14.70:4042 , piece_id=JC23GEREB4ADZZNWJ7MO7NUQE2ENW52R2HGYSGZ5Q6KUF2RXY7QA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.235756768 (81h57m9.933325074s) [noise=true , address=185.167.204.206:4051 , piece_id=NZS6DGCBOEXEVMVNUNX5FLKTPKULEAH4V22NTTXLZY3WFP3WRXHA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.252727751 (81h57m9.950296057s) [noise=true , address=185.167.204.205:4029 , piece_id=GHMY2UIASFMGBAWJDMQ5QB2J5NOQ3WNDAPAN5FYEPL7K4SUXQ5AA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.292437338 (81h57m9.990005654s) [noise=true , address=185.167.204.205:4030 , piece_id=QEBI4GZOJ6C3MDXC2SSQTRUO3DMTOWLRKFDZPMXOU4KGR6YO3PEA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.306794769 (81h57m10.004363074s) [noise=true , address=89.149.201.147:4008 , piece_id=IGIPJKGGGSREGXSBQG644IVTVXNYW7TS6ALRGXSRNZ2SAEDJYAKA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.324969600 (81h57m10.022537916s) [noise=true , address=89.149.201.147:4015 , piece_id=YKV7MYYRYOIMUCMW35SX5CI7MY66OZLYC7IQKCM4H5NV2O3FQPWQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.392595977 (81h57m10.090164283s) [noise=true , address=89.149.201.147:4017 , piece_id=ZJB2REXQ5RHXT2JGD2DRCXHWVZANN4F26VOIFIWWRK5QQWIE435Q, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.423117412 (81h57m10.120685718s) [noise=true , address=185.167.204.206:4054 , piece_id=ZSZ5NKFORG6IBNWPZYIAI5SYQFJ2WSVE5GKY626FSLKRVM2MFYTA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.513668302 (81h57m10.211236618s) [noise=true , address=89.149.201.147:4011 , piece_id=4354NZDLLWPQNEVVO6BCHAIKKCROKAJPMGYO3XN6SDSLRVDKV2QQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.575888201 (81h57m10.273456506s) [noise=true , address=89.149.201.147:4021 , piece_id=2K4XC4DAZ6JHL3OZ3MS4JXAAATMOBSVICLBJ2PZX6FD44XNTZD2Q, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.583090976 (81h57m10.280659292s) [noise=true , address=81.171.14.70:4041 , piece_id=OYVR4OKBP6GF2GTEVRHHWVE2URIHQRBO2HTUBWWKY52UEXTVNS7A, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.604254129 (81h57m10.301822445s) [noise=true , address=185.167.204.205:4005 , piece_id=OAV24V43WPWUUR7BRJFVQYOCR4VFCUZGQEB4UEAMYIRSM2PUVTZA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.694613544 (81h57m10.39218186s) [noise=true , address=185.167.204.206:4052 , piece_id=FC3NDDRSTHZUER2ADWE3CYOMZXDQLKJ3PQ4ZT6GZWPHSEPXY2PEA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.704271264 (81h57m10.40183958s) [noise=true , address=81.171.14.70:4036 , piece_id=OVQWGWHUMFMSKOG5MYSEUXSY3OG7YCAKJZAKY2375RYLAGLSKIXQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.746456667 (81h57m10.444024973s) [noise=true , address=185.167.204.205:4001 , piece_id=WSZXNVFJ4MGMV3HUJELXRXDDBKSIDARXIFSQZRDJD5KOUXAMDR3A, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.746471184 (81h57m10.444039491s) [seg_pos={0 0}, upload=71918]: Segment reached optimal threshold of 26 pieces. Dec 9 01:26:22.746650078 (81h57m10.444218394s) [noise=true , address=89.149.201.147:4019 , piece_id=LH46OTYNYXDYDN77O4WB2O7LWIARKEQVLY3GRSHCUPPNXMMUQSSA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: write tcp 5.161.89.252:15236->89.149.201.147:4019: use of closed network connection; write tcp 5.161.89.252:15236->89.149.201.147:4019: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:15236->89.149.201.147:4019: use of closed network connection Dec 9 01:26:22.746656770 (81h57m10.444225077s) [noise=true , address=89.149.201.147:4019 , piece_id=LH46OTYNYXDYDN77O4WB2O7LWIARKEQVLY3GRSHCUPPNXMMUQSSA, seg_pos={0 0}, upload=71918]: Long tail cancellation due to optimal threshold Dec 9 01:26:22.746700172 (81h57m10.444268478s) [noise=true , address=185.167.204.205:4033 , piece_id=F577SLHIMLXVHIOAMQTT7BWCEOKNGDAQLZGYFFRRKPB6HQJ7PTKA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: expected piece hash; context canceled; EOF Dec 9 01:26:22.746707656 (81h57m10.444275962s) [noise=true , address=185.167.204.205:4033 , piece_id=F577SLHIMLXVHIOAMQTT7BWCEOKNGDAQLZGYFFRRKPB6HQJ7PTKA, seg_pos={0 0}, upload=71918]: Long tail cancellation due to optimal threshold Dec 9 01:26:22.746721752 (81h57m10.444290068s) [seg_pos={0 0}, upload=71918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:26:22.746778107 (81h57m10.444346413s) [upload=71918]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:26:22.746781894 (81h57m10.4443502s) [upload=71918]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:26:22.899446395 (81h57m10.597014702s) [upload=71918]: Done uploading segments... Dec 9 01:26:22.899459901 (81h57m10.597028207s) [upload=71918]: Upload finished. err: <nil> Duration: 6.39580541s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 400.049742ms trace: https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4 FAIL (2025-12-09 01:27:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload Dec 9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload Dec 9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments... Dec 9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false Dec 9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment... Dec 9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment. Dec 9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437 , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653 , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869 , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592 , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510 , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841 , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836 , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698 , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979 , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834 , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158 , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473 , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438 , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626 , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906 , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015 , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841 , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000 Dec 9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626 , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000 Dec 9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment Dec 9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments... Dec 9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979 , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836 , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438 , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015 , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906 , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437 , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158 , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869 , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510 , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473 , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834 , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653 , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592 , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Dec 9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698 , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF Dec 9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments... Dec 9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 400.070049ms core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 16 out of 60 is failed (threshold=3) [.....XX..X...X.....X.X.......X...X.....X.X.X...X...X..X.X..X] duration: 26.562445713s trace: https://jaeger.dev.storj.io/trace/26bc3f210589b51c FAIL (2025-12-09 01:26:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== .205:4030 , piece_id=QEBI4GZOJ6C3MDXC2SSQTRUO3DMTOWLRKFDZPMXOU4KGR6YO3PEA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.134813251 (81h57m8.832381558s) [noise=true , address=89.149.201.147:4019 , piece_id=LH46OTYNYXDYDN77O4WB2O7LWIARKEQVLY3GRSHCUPPNXMMUQSSA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.135086352 (81h57m8.832654668s) [noise=true , address=81.171.14.70:4042 , piece_id=JC23GEREB4ADZZNWJ7MO7NUQE2ENW52R2HGYSGZ5Q6KUF2RXY7QA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.135363689 (81h57m8.832931996s) [noise=true , address=185.167.204.206:4052 , piece_id=FC3NDDRSTHZUER2ADWE3CYOMZXDQLKJ3PQ4ZT6GZWPHSEPXY2PEA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.135664291 (81h57m8.833232597s) [noise=true , address=89.149.201.147:4008 , piece_id=IGIPJKGGGSREGXSBQG644IVTVXNYW7TS6ALRGXSRNZ2SAEDJYAKA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.136041315 (81h57m8.833609631s) [noise=true , address=185.167.204.205:4001 , piece_id=WSZXNVFJ4MGMV3HUJELXRXDDBKSIDARXIFSQZRDJD5KOUXAMDR3A, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.137414409 (81h57m8.834982725s) [noise=true , address=81.171.14.70:4036 , piece_id=OVQWGWHUMFMSKOG5MYSEUXSY3OG7YCAKJZAKY2375RYLAGLSKIXQ, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.139702634 (81h57m8.837270941s) [noise=true , address=185.167.204.205:4015 , piece_id=3FOTB6XISVZZ423A5W46YZAI3CINP7I6TS6OBULTYLOR3QPBF52Q, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.140644615 (81h57m8.83821292s) [noise=true , address=185.167.204.205:4005 , piece_id=OAV24V43WPWUUR7BRJFVQYOCR4VFCUZGQEB4UEAMYIRSM2PUVTZA, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.142941475 (81h57m8.840509781s) [noise=true , address=89.149.201.147:4015 , piece_id=YKV7MYYRYOIMUCMW35SX5CI7MY66OZLYC7IQKCM4H5NV2O3FQPWQ, seg_pos={0 0}, upload=71918]: Uploading piece... Dec 9 01:26:21.645240170 (81h57m9.342808475s) [upload=71918]: Next returned nil segment Dec 9 01:26:21.645250509 (81h57m9.342818815s) [upload=71918]: Waiting for error group managing segments... Dec 9 01:26:21.847332132 (81h57m9.544900439s) [noise=true , address=185.167.204.206:4063 , piece_id=WJ6IEWKLAM5TZJYUY6N5NB54W24HABRKUR6P6PCFOMCORXKUF3OQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.851964756 (81h57m9.549533072s) [noise=true , address=81.171.14.70:4038 , piece_id=LRE67BYLMBTLEL4APTG6JWT2ULNZBC5CVZ4L7CPIKXIC54RZIK3A, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.855636315 (81h57m9.55320462s) [noise=true , address=81.171.14.70:4040 , piece_id=RJLUY5LUF5NLPO6SGRYM3MQEJNLLL4XHB6EOKJOANW5B3JFVNVKQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.856391406 (81h57m9.553959711s) [noise=true , address=81.171.14.70:4030 , piece_id=K3NHUHYBLAARBQMINJ2LKBSPBZ56MV3HGX3XID6LTN65RLRL5NNA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.857187321 (81h57m9.554755628s) [noise=true , address=185.167.204.205:4018 , piece_id=NS2AOBXSUKHBICPNS3ATQ3FLR7V4YB5ZEU7V2NY5WRXU2P7VKFDQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.861261362 (81h57m9.558829668s) [noise=true , address=185.167.204.206:4071 , piece_id=QVNE4LNSC4QWZF2WVS7PHUZNN4RJATDRLHCUJBL3MGJN7SF6ZSIQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.869441042 (81h57m9.567009348s) [noise=true , address=89.149.201.147:4005 , piece_id=YEJ4IILQKACR5PNAWPU5XC5V6R5T73Q5SMVV7ANWOENMEQ6LKISQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:21.874351294 (81h57m9.5719196s) [noise=true , address=89.149.201.147:4016 , piece_id=I6MEYHKCWYCTULCLEC7QHZAOIB5LPUINGZV2OEAQM4R3JZOSFOKA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.141691121 (81h57m9.839259447s) [noise=true , address=185.167.204.205:4015 , piece_id=3FOTB6XISVZZ423A5W46YZAI3CINP7I6TS6OBULTYLOR3QPBF52Q, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.179125058 (81h57m9.876693374s) [noise=true , address=81.171.14.70:4048 , piece_id=RL7D6BMSBR3G3STLIHPLR3LT56WOUD37LCTMT4RNVYSIFRASQBXA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.221424416 (81h57m9.918992732s) [noise=true , address=185.167.204.205:4014 , piece_id=4PIIA3ZQG65JZE2VHXDQNNV57KVOYMYWO4GEI4J3VQ4C7NEZHGXQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.221735806 (81h57m9.919304113s) [noise=true , address=81.171.14.70:4042 , piece_id=JC23GEREB4ADZZNWJ7MO7NUQE2ENW52R2HGYSGZ5Q6KUF2RXY7QA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.235756768 (81h57m9.933325074s) [noise=true , address=185.167.204.206:4051 , piece_id=NZS6DGCBOEXEVMVNUNX5FLKTPKULEAH4V22NTTXLZY3WFP3WRXHA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.252727751 (81h57m9.950296057s) [noise=true , address=185.167.204.205:4029 , piece_id=GHMY2UIASFMGBAWJDMQ5QB2J5NOQ3WNDAPAN5FYEPL7K4SUXQ5AA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.292437338 (81h57m9.990005654s) [noise=true , address=185.167.204.205:4030 , piece_id=QEBI4GZOJ6C3MDXC2SSQTRUO3DMTOWLRKFDZPMXOU4KGR6YO3PEA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.306794769 (81h57m10.004363074s) [noise=true , address=89.149.201.147:4008 , piece_id=IGIPJKGGGSREGXSBQG644IVTVXNYW7TS6ALRGXSRNZ2SAEDJYAKA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.324969600 (81h57m10.022537916s) [noise=true , address=89.149.201.147:4015 , piece_id=YKV7MYYRYOIMUCMW35SX5CI7MY66OZLYC7IQKCM4H5NV2O3FQPWQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.392595977 (81h57m10.090164283s) [noise=true , address=89.149.201.147:4017 , piece_id=ZJB2REXQ5RHXT2JGD2DRCXHWVZANN4F26VOIFIWWRK5QQWIE435Q, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.423117412 (81h57m10.120685718s) [noise=true , address=185.167.204.206:4054 , piece_id=ZSZ5NKFORG6IBNWPZYIAI5SYQFJ2WSVE5GKY626FSLKRVM2MFYTA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.513668302 (81h57m10.211236618s) [noise=true , address=89.149.201.147:4011 , piece_id=4354NZDLLWPQNEVVO6BCHAIKKCROKAJPMGYO3XN6SDSLRVDKV2QQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.575888201 (81h57m10.273456506s) [noise=true , address=89.149.201.147:4021 , piece_id=2K4XC4DAZ6JHL3OZ3MS4JXAAATMOBSVICLBJ2PZX6FD44XNTZD2Q, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.583090976 (81h57m10.280659292s) [noise=true , address=81.171.14.70:4041 , piece_id=OYVR4OKBP6GF2GTEVRHHWVE2URIHQRBO2HTUBWWKY52UEXTVNS7A, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.604254129 (81h57m10.301822445s) [noise=true , address=185.167.204.205:4005 , piece_id=OAV24V43WPWUUR7BRJFVQYOCR4VFCUZGQEB4UEAMYIRSM2PUVTZA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.694613544 (81h57m10.39218186s) [noise=true , address=185.167.204.206:4052 , piece_id=FC3NDDRSTHZUER2ADWE3CYOMZXDQLKJ3PQ4ZT6GZWPHSEPXY2PEA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.704271264 (81h57m10.40183958s) [noise=true , address=81.171.14.70:4036 , piece_id=OVQWGWHUMFMSKOG5MYSEUXSY3OG7YCAKJZAKY2375RYLAGLSKIXQ, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.746456667 (81h57m10.444024973s) [noise=true , address=185.167.204.205:4001 , piece_id=WSZXNVFJ4MGMV3HUJELXRXDDBKSIDARXIFSQZRDJD5KOUXAMDR3A, seg_pos={0 0}, upload=71918]: Done uploading piece. err: <nil> Dec 9 01:26:22.746471184 (81h57m10.444039491s) [seg_pos={0 0}, upload=71918]: Segment reached optimal threshold of 26 pieces. Dec 9 01:26:22.746650078 (81h57m10.444218394s) [noise=true , address=89.149.201.147:4019 , piece_id=LH46OTYNYXDYDN77O4WB2O7LWIARKEQVLY3GRSHCUPPNXMMUQSSA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: write tcp 5.161.89.252:15236->89.149.201.147:4019: use of closed network connection; write tcp 5.161.89.252:15236->89.149.201.147:4019: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:15236->89.149.201.147:4019: use of closed network connection Dec 9 01:26:22.746656770 (81h57m10.444225077s) [noise=true , address=89.149.201.147:4019 , piece_id=LH46OTYNYXDYDN77O4WB2O7LWIARKEQVLY3GRSHCUPPNXMMUQSSA, seg_pos={0 0}, upload=71918]: Long tail cancellation due to optimal threshold Dec 9 01:26:22.746700172 (81h57m10.444268478s) [noise=true , address=185.167.204.205:4033 , piece_id=F577SLHIMLXVHIOAMQTT7BWCEOKNGDAQLZGYFFRRKPB6HQJ7PTKA, seg_pos={0 0}, upload=71918]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q73mXHLEfuX4VUbJ8PTjhMoXCrYSKjJbFxqjDdqF3U99N8FXe): protocol: expected piece hash; context canceled; EOF Dec 9 01:26:22.746707656 (81h57m10.444275962s) [noise=true , address=185.167.204.205:4033 , piece_id=F577SLHIMLXVHIOAMQTT7BWCEOKNGDAQLZGYFFRRKPB6HQJ7PTKA, seg_pos={0 0}, upload=71918]: Long tail cancellation due to optimal threshold Dec 9 01:26:22.746721752 (81h57m10.444290068s) [seg_pos={0 0}, upload=71918]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:26:22.746778107 (81h57m10.444346413s) [upload=71918]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:26:22.746781894 (81h57m10.4443502s) [upload=71918]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:26:22.899446395 (81h57m10.597014702s) [upload=71918]: Done uploading segments... Dec 9 01:26:22.899459901 (81h57m10.597028207s) [upload=71918]: Upload finished. err: <nil> Duration: 26.562485438s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 360.832222ms trace: https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4 FAIL (2025-12-09 01:26:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload Dec 9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload Dec 9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments... Dec 9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false Dec 9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment... Dec 9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment. Dec 9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437 , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653 , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869 , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592 , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510 , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841 , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836 , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698 , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979 , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834 , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158 , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473 , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438 , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626 , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906 , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015 , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841 , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000 Dec 9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626 , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000 Dec 9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment Dec 9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments... Dec 9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979 , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836 , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438 , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015 , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906 , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437 , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158 , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869 , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510 , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473 , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834 , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653 , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592 , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Dec 9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698 , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF Dec 9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments... Dec 9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 360.851419ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 562.308319ms trace: https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4 FAIL (2025-12-09 01:25:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload Dec 9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload Dec 9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments... Dec 9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false Dec 9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment... Dec 9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment. Dec 9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437 , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653 , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869 , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592 , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510 , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841 , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836 , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698 , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979 , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834 , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158 , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473 , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438 , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626 , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906 , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015 , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841 , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000 Dec 9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626 , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000 Dec 9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment Dec 9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments... Dec 9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979 , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836 , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438 , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015 , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906 , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437 , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158 , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869 , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510 , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473 , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834 , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653 , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592 , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Dec 9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698 , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF Dec 9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments... Dec 9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 562.327305ms core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 16 out of 60 is failed (threshold=3) [X.....XX..X...X.....X.X.......X...X.....X.X.X...X...X..X.X..] duration: 24.003429984s trace: https://jaeger.dev.storj.io/trace/20ac545f1cffa196 FAIL (2025-12-09 01:25:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== (81h55m4.161406093s) [noise=true , address=185.167.204.205:4036 , piece_id=UI3H6VZTOUPJSOXWH55XCC5MUHHAVFYDHC27KC5JMSCTXGCSZ5WQ, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.464049392 (81h55m4.161617708s) [noise=true , address=81.171.14.70:4043 , piece_id=UFHN6ZUT4DQZ22GQUJKPXFDALWVZJWJCYNCYB3C6AFO34WX5WSZQ, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.464144549 (81h55m4.161712855s) [noise=true , address=185.167.204.206:4063 , piece_id=OELO7NI2DV5UMSCRWZ2VLOCLOVYHINJXSSHHW3576L64PTI7IEKA, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.464284261 (81h55m4.161852577s) [noise=true , address=185.167.204.205:4024 , piece_id=UCOC25JDKJJ46MKQKKMPA3ETXZ5X4CGP47BINT2NO5KYILXSRSDQ, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.464450341 (81h55m4.162018657s) [noise=true , address=185.167.204.205:4034 , piece_id=AW2OUIYA3SK4526NNYJ7CW2CSPHTM7G34Q2VXMOV5YS4CTXNAXHA, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.464534037 (81h55m4.162102353s) [noise=true , address=89.149.201.147:4024 , piece_id=UL7JADLEPNW3SWPMRCGXZ5T4I4QNHGFB23ZIFUV2OMDSUCA2QE6Q, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.464766492 (81h55m4.162334808s) [noise=true , address=81.171.14.70:4025 , piece_id=UGJHHVCUJNS2RTTE26J4CIJ7MSF6WJRDTX7ZITJ4PGC4K6ETOSRA, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.464997253 (81h55m4.162565559s) [noise=true , address=81.171.14.70:4045 , piece_id=DU2EN4DL2VJIGKWI2K5IBNQT3UAIMKVXGEIC6QIDQDL7FPWVTO2A, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.465233003 (81h55m4.16280131s) [noise=true , address=185.167.204.206:4070 , piece_id=V6TBFZSUELHBFNNKM37HZ2OTCWIMCCKTPJ3H7ZH2UOXS2SILQBJA, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.465480595 (81h55m4.163048912s) [noise=true , address=81.171.14.70:4041 , piece_id=N3A7GJ3PN6Q6MNA44ZAFNVG3PBHOQ3GHKSKVSW5ZJB5OAJT6M62Q, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.466195161 (81h55m4.163763467s) [noise=true , address=81.171.14.70:4028 , piece_id=UYBGZEGNGRPKBUTDB4YEICXZPYWL77PGB4XKKPSU2SW767LGDRGQ, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.957514841 (81h55m4.655083147s) [upload=71887]: Next returned nil segment Dec 9 01:24:16.957525501 (81h55m4.655093817s) [upload=71887]: Waiting for error group managing segments... Dec 9 01:24:17.166291201 (81h55m4.863859517s) [noise=true , address=81.171.14.70:4035 , piece_id=Y7IN27GHWXF66EKH3CUSETUI4TJ7LW2I32DZKAJFOJJFOJHXGG2A, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.181486729 (81h55m4.879055036s) [noise=true , address=185.167.204.205:4023 , piece_id=AHCBY3PSXSZ7IM5O2PXL7K4GNWQRQDHHI7FGB466SULH6BEMFJTQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.187213327 (81h55m4.884781643s) [noise=true , address=185.167.204.205:4036 , piece_id=UI3H6VZTOUPJSOXWH55XCC5MUHHAVFYDHC27KC5JMSCTXGCSZ5WQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.198959511 (81h55m4.896527848s) [noise=true , address=89.149.201.147:4010 , piece_id=D4APFUUXLOOWIM3RHYQQZBC5NVPSTDG67BDORR2FXUL4KQF2GGZQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.207196600 (81h55m4.904764916s) [noise=true , address=185.167.204.206:4070 , piece_id=V6TBFZSUELHBFNNKM37HZ2OTCWIMCCKTPJ3H7ZH2UOXS2SILQBJA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.223129485 (81h55m4.920697832s) [noise=true , address=81.171.14.70:4043 , piece_id=UFHN6ZUT4DQZ22GQUJKPXFDALWVZJWJCYNCYB3C6AFO34WX5WSZQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.231999415 (81h55m4.929567772s) [noise=true , address=185.167.204.206:4063 , piece_id=OELO7NI2DV5UMSCRWZ2VLOCLOVYHINJXSSHHW3576L64PTI7IEKA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.264478983 (81h55m4.962047299s) [noise=true , address=81.171.14.70:4042 , piece_id=4RCMV6IXAXYHNYSR46DSG6OKYC443SVO6IKPX7NQNV4QEOWXGOAA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.269157092 (81h55m4.966725408s) [noise=true , address=81.171.14.70:4033 , piece_id=R5O33BH4A3EJKBLKV5KODVDM53PTBT4QSHYPJW6FMTPFMJ3YSQPQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.406996510 (81h55m5.104564846s) [noise=true , address=81.171.14.70:4036 , piece_id=7OFWJQKD4KSOJAFG4YBQMQBE5QES235DBZ5V63PAKX5YK63CHMVQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.549311400 (81h55m5.246879716s) [noise=true , address=185.167.204.205:4026 , piece_id=XFY2Y5FLAVP4GGYTKGJD5LL2TAY4VEHB77KQQKWQR4A37O6KVMKQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.629362198 (81h55m5.326930505s) [noise=true , address=81.171.14.70:4044 , piece_id=3HSSK2QLVJA2VXUHYDRMOJV2CF326VUU2HYNHVZASRDU6KGP6HJA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.636167071 (81h55m5.333735377s) [noise=true , address=81.171.14.70:4028 , piece_id=UYBGZEGNGRPKBUTDB4YEICXZPYWL77PGB4XKKPSU2SW767LGDRGQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.718867590 (81h55m5.416435906s) [noise=true , address=89.149.201.147:4018 , piece_id=J5CVPDPTKLIL3VDZXA6N3W2VIVTY67QRLFECI6A4TBCALQVHVTXA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.841899444 (81h55m5.53946776s) [noise=true , address=81.171.14.70:4031 , piece_id=OREWPNXS4LJQFRVR22O7YBAWTOPXZPELLR2TCDZEJDQKYL5MW3WA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.850287134 (81h55m5.54785544s) [noise=true , address=185.167.204.205:4034 , piece_id=AW2OUIYA3SK4526NNYJ7CW2CSPHTM7G34Q2VXMOV5YS4CTXNAXHA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.901950500 (81h55m5.599518847s) [noise=true , address=81.171.14.70:4041 , piece_id=N3A7GJ3PN6Q6MNA44ZAFNVG3PBHOQ3GHKSKVSW5ZJB5OAJT6M62Q, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.999746159 (81h55m5.697314496s) [noise=true , address=81.171.14.70:4048 , piece_id=BLA6JHKOHBZODO3NPDLNBCLQYSTZPY4YCSAK65WEX3SLYOUM2CBA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.082346230 (81h55m5.779914567s) [noise=true , address=81.171.14.70:4045 , piece_id=DU2EN4DL2VJIGKWI2K5IBNQT3UAIMKVXGEIC6QIDQDL7FPWVTO2A, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.157010607 (81h55m5.854578912s) [noise=true , address=81.171.14.70:4029 , piece_id=BUXT2NLALOY63CM2ZA4PTCEWUQHK3XDPV3B7GNQHWOFIK2SNYAJQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.205125142 (81h55m5.902693448s) [noise=true , address=89.149.201.147:4001 , piece_id=JZLVLPKODNGZ3KNMF2VOSWEU4FMXL4MCRO2ONUE3WUMMF4MVPBRA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.409747413 (81h55m6.107315749s) [noise=true , address=81.171.14.70:4025 , piece_id=UGJHHVCUJNS2RTTE26J4CIJ7MSF6WJRDTX7ZITJ4PGC4K6ETOSRA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.476553538 (81h55m6.174121874s) [noise=true , address=185.167.204.205:4002 , piece_id=D3OVPLP7QVEDZOBISBO6267J4DBZEGPGWBN6CNULDSJ5JSBBHGFA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.522057488 (81h55m6.219625834s) [noise=true , address=185.167.204.205:4024 , piece_id=UCOC25JDKJJ46MKQKKMPA3ETXZ5X4CGP47BINT2NO5KYILXSRSDQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.537781502 (81h55m6.235349849s) [noise=true , address=81.171.14.70:4038 , piece_id=TCB3IETDPZQQ322HGR4QDMBCYU7SJT5J33UMH6P4SLB4MWMQYUPA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.672204288 (81h55m6.369772594s) [noise=true , address=89.149.201.147:4024 , piece_id=UL7JADLEPNW3SWPMRCGXZ5T4I4QNHGFB23ZIFUV2OMDSUCA2QE6Q, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.672223364 (81h55m6.36979167s) [seg_pos={0 0}, upload=71887]: Segment reached optimal threshold of 26 pieces. Dec 9 01:24:18.672400846 (81h55m6.369969162s) [noise=true , address=81.171.14.70:4047 , piece_id=W2YN5JEXQXQS5QX3YXDPZYVD2Q2ZC4PSW3DEQNLOWYCIBL3NSPKQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Dec 9 01:24:18.672408540 (81h55m6.369976856s) [noise=true , address=81.171.14.70:4047 , piece_id=W2YN5JEXQXQS5QX3YXDPZYVD2Q2ZC4PSW3DEQNLOWYCIBL3NSPKQ, seg_pos={0 0}, upload=71887]: Long tail cancellation due to optimal threshold Dec 9 01:24:18.672535968 (81h55m6.370104274s) [noise=true , address=185.167.204.206:4049 , piece_id=44A5UMHCZ2DTBHJKZDNHSHQQYL53V363PS7TVOFFHUA3R7FAJPTQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM): protocol: expected piece hash; context canceled; EOF Dec 9 01:24:18.672550726 (81h55m6.370119062s) [noise=true , address=185.167.204.206:4049 , piece_id=44A5UMHCZ2DTBHJKZDNHSHQQYL53V363PS7TVOFFHUA3R7FAJPTQ, seg_pos={0 0}, upload=71887]: Long tail cancellation due to optimal threshold Dec 9 01:24:18.672575993 (81h55m6.370144309s) [seg_pos={0 0}, upload=71887]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:24:18.672649800 (81h55m6.370218107s) [upload=71887]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:24:18.672679556 (81h55m6.370247902s) [upload=71887]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:24:18.820521330 (81h55m6.518089647s) [upload=71887]: Done uploading segments... Dec 9 01:24:18.820536609 (81h55m6.518104925s) [upload=71887]: Upload finished. err: <nil> Duration: 24.003444461s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 17 out of 60 is failed (threshold=3) [XX.....XX..X...X.....X.X.......X...X.....X.X.X...X...X..X.X.] duration: 23.163328124s trace: https://jaeger.dev.storj.io/trace/20ac545f1cffa196 FAIL (2025-12-09 01:25:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== (81h55m4.161406093s) [noise=true , address=185.167.204.205:4036 , piece_id=UI3H6VZTOUPJSOXWH55XCC5MUHHAVFYDHC27KC5JMSCTXGCSZ5WQ, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.464049392 (81h55m4.161617708s) [noise=true , address=81.171.14.70:4043 , piece_id=UFHN6ZUT4DQZ22GQUJKPXFDALWVZJWJCYNCYB3C6AFO34WX5WSZQ, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.464144549 (81h55m4.161712855s) [noise=true , address=185.167.204.206:4063 , piece_id=OELO7NI2DV5UMSCRWZ2VLOCLOVYHINJXSSHHW3576L64PTI7IEKA, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.464284261 (81h55m4.161852577s) [noise=true , address=185.167.204.205:4024 , piece_id=UCOC25JDKJJ46MKQKKMPA3ETXZ5X4CGP47BINT2NO5KYILXSRSDQ, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.464450341 (81h55m4.162018657s) [noise=true , address=185.167.204.205:4034 , piece_id=AW2OUIYA3SK4526NNYJ7CW2CSPHTM7G34Q2VXMOV5YS4CTXNAXHA, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.464534037 (81h55m4.162102353s) [noise=true , address=89.149.201.147:4024 , piece_id=UL7JADLEPNW3SWPMRCGXZ5T4I4QNHGFB23ZIFUV2OMDSUCA2QE6Q, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.464766492 (81h55m4.162334808s) [noise=true , address=81.171.14.70:4025 , piece_id=UGJHHVCUJNS2RTTE26J4CIJ7MSF6WJRDTX7ZITJ4PGC4K6ETOSRA, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.464997253 (81h55m4.162565559s) [noise=true , address=81.171.14.70:4045 , piece_id=DU2EN4DL2VJIGKWI2K5IBNQT3UAIMKVXGEIC6QIDQDL7FPWVTO2A, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.465233003 (81h55m4.16280131s) [noise=true , address=185.167.204.206:4070 , piece_id=V6TBFZSUELHBFNNKM37HZ2OTCWIMCCKTPJ3H7ZH2UOXS2SILQBJA, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.465480595 (81h55m4.163048912s) [noise=true , address=81.171.14.70:4041 , piece_id=N3A7GJ3PN6Q6MNA44ZAFNVG3PBHOQ3GHKSKVSW5ZJB5OAJT6M62Q, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.466195161 (81h55m4.163763467s) [noise=true , address=81.171.14.70:4028 , piece_id=UYBGZEGNGRPKBUTDB4YEICXZPYWL77PGB4XKKPSU2SW767LGDRGQ, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.957514841 (81h55m4.655083147s) [upload=71887]: Next returned nil segment Dec 9 01:24:16.957525501 (81h55m4.655093817s) [upload=71887]: Waiting for error group managing segments... Dec 9 01:24:17.166291201 (81h55m4.863859517s) [noise=true , address=81.171.14.70:4035 , piece_id=Y7IN27GHWXF66EKH3CUSETUI4TJ7LW2I32DZKAJFOJJFOJHXGG2A, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.181486729 (81h55m4.879055036s) [noise=true , address=185.167.204.205:4023 , piece_id=AHCBY3PSXSZ7IM5O2PXL7K4GNWQRQDHHI7FGB466SULH6BEMFJTQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.187213327 (81h55m4.884781643s) [noise=true , address=185.167.204.205:4036 , piece_id=UI3H6VZTOUPJSOXWH55XCC5MUHHAVFYDHC27KC5JMSCTXGCSZ5WQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.198959511 (81h55m4.896527848s) [noise=true , address=89.149.201.147:4010 , piece_id=D4APFUUXLOOWIM3RHYQQZBC5NVPSTDG67BDORR2FXUL4KQF2GGZQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.207196600 (81h55m4.904764916s) [noise=true , address=185.167.204.206:4070 , piece_id=V6TBFZSUELHBFNNKM37HZ2OTCWIMCCKTPJ3H7ZH2UOXS2SILQBJA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.223129485 (81h55m4.920697832s) [noise=true , address=81.171.14.70:4043 , piece_id=UFHN6ZUT4DQZ22GQUJKPXFDALWVZJWJCYNCYB3C6AFO34WX5WSZQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.231999415 (81h55m4.929567772s) [noise=true , address=185.167.204.206:4063 , piece_id=OELO7NI2DV5UMSCRWZ2VLOCLOVYHINJXSSHHW3576L64PTI7IEKA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.264478983 (81h55m4.962047299s) [noise=true , address=81.171.14.70:4042 , piece_id=4RCMV6IXAXYHNYSR46DSG6OKYC443SVO6IKPX7NQNV4QEOWXGOAA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.269157092 (81h55m4.966725408s) [noise=true , address=81.171.14.70:4033 , piece_id=R5O33BH4A3EJKBLKV5KODVDM53PTBT4QSHYPJW6FMTPFMJ3YSQPQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.406996510 (81h55m5.104564846s) [noise=true , address=81.171.14.70:4036 , piece_id=7OFWJQKD4KSOJAFG4YBQMQBE5QES235DBZ5V63PAKX5YK63CHMVQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.549311400 (81h55m5.246879716s) [noise=true , address=185.167.204.205:4026 , piece_id=XFY2Y5FLAVP4GGYTKGJD5LL2TAY4VEHB77KQQKWQR4A37O6KVMKQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.629362198 (81h55m5.326930505s) [noise=true , address=81.171.14.70:4044 , piece_id=3HSSK2QLVJA2VXUHYDRMOJV2CF326VUU2HYNHVZASRDU6KGP6HJA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.636167071 (81h55m5.333735377s) [noise=true , address=81.171.14.70:4028 , piece_id=UYBGZEGNGRPKBUTDB4YEICXZPYWL77PGB4XKKPSU2SW767LGDRGQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.718867590 (81h55m5.416435906s) [noise=true , address=89.149.201.147:4018 , piece_id=J5CVPDPTKLIL3VDZXA6N3W2VIVTY67QRLFECI6A4TBCALQVHVTXA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.841899444 (81h55m5.53946776s) [noise=true , address=81.171.14.70:4031 , piece_id=OREWPNXS4LJQFRVR22O7YBAWTOPXZPELLR2TCDZEJDQKYL5MW3WA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.850287134 (81h55m5.54785544s) [noise=true , address=185.167.204.205:4034 , piece_id=AW2OUIYA3SK4526NNYJ7CW2CSPHTM7G34Q2VXMOV5YS4CTXNAXHA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.901950500 (81h55m5.599518847s) [noise=true , address=81.171.14.70:4041 , piece_id=N3A7GJ3PN6Q6MNA44ZAFNVG3PBHOQ3GHKSKVSW5ZJB5OAJT6M62Q, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.999746159 (81h55m5.697314496s) [noise=true , address=81.171.14.70:4048 , piece_id=BLA6JHKOHBZODO3NPDLNBCLQYSTZPY4YCSAK65WEX3SLYOUM2CBA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.082346230 (81h55m5.779914567s) [noise=true , address=81.171.14.70:4045 , piece_id=DU2EN4DL2VJIGKWI2K5IBNQT3UAIMKVXGEIC6QIDQDL7FPWVTO2A, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.157010607 (81h55m5.854578912s) [noise=true , address=81.171.14.70:4029 , piece_id=BUXT2NLALOY63CM2ZA4PTCEWUQHK3XDPV3B7GNQHWOFIK2SNYAJQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.205125142 (81h55m5.902693448s) [noise=true , address=89.149.201.147:4001 , piece_id=JZLVLPKODNGZ3KNMF2VOSWEU4FMXL4MCRO2ONUE3WUMMF4MVPBRA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.409747413 (81h55m6.107315749s) [noise=true , address=81.171.14.70:4025 , piece_id=UGJHHVCUJNS2RTTE26J4CIJ7MSF6WJRDTX7ZITJ4PGC4K6ETOSRA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.476553538 (81h55m6.174121874s) [noise=true , address=185.167.204.205:4002 , piece_id=D3OVPLP7QVEDZOBISBO6267J4DBZEGPGWBN6CNULDSJ5JSBBHGFA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.522057488 (81h55m6.219625834s) [noise=true , address=185.167.204.205:4024 , piece_id=UCOC25JDKJJ46MKQKKMPA3ETXZ5X4CGP47BINT2NO5KYILXSRSDQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.537781502 (81h55m6.235349849s) [noise=true , address=81.171.14.70:4038 , piece_id=TCB3IETDPZQQ322HGR4QDMBCYU7SJT5J33UMH6P4SLB4MWMQYUPA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.672204288 (81h55m6.369772594s) [noise=true , address=89.149.201.147:4024 , piece_id=UL7JADLEPNW3SWPMRCGXZ5T4I4QNHGFB23ZIFUV2OMDSUCA2QE6Q, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.672223364 (81h55m6.36979167s) [seg_pos={0 0}, upload=71887]: Segment reached optimal threshold of 26 pieces. Dec 9 01:24:18.672400846 (81h55m6.369969162s) [noise=true , address=81.171.14.70:4047 , piece_id=W2YN5JEXQXQS5QX3YXDPZYVD2Q2ZC4PSW3DEQNLOWYCIBL3NSPKQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Dec 9 01:24:18.672408540 (81h55m6.369976856s) [noise=true , address=81.171.14.70:4047 , piece_id=W2YN5JEXQXQS5QX3YXDPZYVD2Q2ZC4PSW3DEQNLOWYCIBL3NSPKQ, seg_pos={0 0}, upload=71887]: Long tail cancellation due to optimal threshold Dec 9 01:24:18.672535968 (81h55m6.370104274s) [noise=true , address=185.167.204.206:4049 , piece_id=44A5UMHCZ2DTBHJKZDNHSHQQYL53V363PS7TVOFFHUA3R7FAJPTQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM): protocol: expected piece hash; context canceled; EOF Dec 9 01:24:18.672550726 (81h55m6.370119062s) [noise=true , address=185.167.204.206:4049 , piece_id=44A5UMHCZ2DTBHJKZDNHSHQQYL53V363PS7TVOFFHUA3R7FAJPTQ, seg_pos={0 0}, upload=71887]: Long tail cancellation due to optimal threshold Dec 9 01:24:18.672575993 (81h55m6.370144309s) [seg_pos={0 0}, upload=71887]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:24:18.672649800 (81h55m6.370218107s) [upload=71887]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:24:18.672679556 (81h55m6.370247902s) [upload=71887]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:24:18.820521330 (81h55m6.518089647s) [upload=71887]: Done uploading segments... Dec 9 01:24:18.820536609 (81h55m6.518104925s) [upload=71887]: Upload finished. err: <nil> Duration: 23.163342139s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 459.43233ms trace: https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4 FAIL (2025-12-09 01:24:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload Dec 9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload Dec 9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments... Dec 9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false Dec 9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment... Dec 9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment. Dec 9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437 , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653 , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869 , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592 , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510 , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841 , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836 , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698 , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979 , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834 , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158 , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473 , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438 , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626 , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906 , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015 , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841 , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000 Dec 9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626 , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000 Dec 9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment Dec 9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments... Dec 9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979 , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836 , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438 , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015 , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906 , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437 , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158 , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869 , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510 , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473 , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834 , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653 , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592 , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Dec 9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698 , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF Dec 9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments... Dec 9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 459.451495ms core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 17 out of 60 is failed (threshold=3) [.XX.....XX..X...X.....X.X.......X...X.....X.X.X...X...X..X.X] duration: 32.199289387s trace: https://jaeger.dev.storj.io/trace/20ac545f1cffa196 FAIL (2025-12-09 01:24:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== (81h55m4.161406093s) [noise=true , address=185.167.204.205:4036 , piece_id=UI3H6VZTOUPJSOXWH55XCC5MUHHAVFYDHC27KC5JMSCTXGCSZ5WQ, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.464049392 (81h55m4.161617708s) [noise=true , address=81.171.14.70:4043 , piece_id=UFHN6ZUT4DQZ22GQUJKPXFDALWVZJWJCYNCYB3C6AFO34WX5WSZQ, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.464144549 (81h55m4.161712855s) [noise=true , address=185.167.204.206:4063 , piece_id=OELO7NI2DV5UMSCRWZ2VLOCLOVYHINJXSSHHW3576L64PTI7IEKA, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.464284261 (81h55m4.161852577s) [noise=true , address=185.167.204.205:4024 , piece_id=UCOC25JDKJJ46MKQKKMPA3ETXZ5X4CGP47BINT2NO5KYILXSRSDQ, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.464450341 (81h55m4.162018657s) [noise=true , address=185.167.204.205:4034 , piece_id=AW2OUIYA3SK4526NNYJ7CW2CSPHTM7G34Q2VXMOV5YS4CTXNAXHA, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.464534037 (81h55m4.162102353s) [noise=true , address=89.149.201.147:4024 , piece_id=UL7JADLEPNW3SWPMRCGXZ5T4I4QNHGFB23ZIFUV2OMDSUCA2QE6Q, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.464766492 (81h55m4.162334808s) [noise=true , address=81.171.14.70:4025 , piece_id=UGJHHVCUJNS2RTTE26J4CIJ7MSF6WJRDTX7ZITJ4PGC4K6ETOSRA, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.464997253 (81h55m4.162565559s) [noise=true , address=81.171.14.70:4045 , piece_id=DU2EN4DL2VJIGKWI2K5IBNQT3UAIMKVXGEIC6QIDQDL7FPWVTO2A, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.465233003 (81h55m4.16280131s) [noise=true , address=185.167.204.206:4070 , piece_id=V6TBFZSUELHBFNNKM37HZ2OTCWIMCCKTPJ3H7ZH2UOXS2SILQBJA, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.465480595 (81h55m4.163048912s) [noise=true , address=81.171.14.70:4041 , piece_id=N3A7GJ3PN6Q6MNA44ZAFNVG3PBHOQ3GHKSKVSW5ZJB5OAJT6M62Q, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.466195161 (81h55m4.163763467s) [noise=true , address=81.171.14.70:4028 , piece_id=UYBGZEGNGRPKBUTDB4YEICXZPYWL77PGB4XKKPSU2SW767LGDRGQ, seg_pos={0 0}, upload=71887]: Uploading piece... Dec 9 01:24:16.957514841 (81h55m4.655083147s) [upload=71887]: Next returned nil segment Dec 9 01:24:16.957525501 (81h55m4.655093817s) [upload=71887]: Waiting for error group managing segments... Dec 9 01:24:17.166291201 (81h55m4.863859517s) [noise=true , address=81.171.14.70:4035 , piece_id=Y7IN27GHWXF66EKH3CUSETUI4TJ7LW2I32DZKAJFOJJFOJHXGG2A, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.181486729 (81h55m4.879055036s) [noise=true , address=185.167.204.205:4023 , piece_id=AHCBY3PSXSZ7IM5O2PXL7K4GNWQRQDHHI7FGB466SULH6BEMFJTQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.187213327 (81h55m4.884781643s) [noise=true , address=185.167.204.205:4036 , piece_id=UI3H6VZTOUPJSOXWH55XCC5MUHHAVFYDHC27KC5JMSCTXGCSZ5WQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.198959511 (81h55m4.896527848s) [noise=true , address=89.149.201.147:4010 , piece_id=D4APFUUXLOOWIM3RHYQQZBC5NVPSTDG67BDORR2FXUL4KQF2GGZQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.207196600 (81h55m4.904764916s) [noise=true , address=185.167.204.206:4070 , piece_id=V6TBFZSUELHBFNNKM37HZ2OTCWIMCCKTPJ3H7ZH2UOXS2SILQBJA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.223129485 (81h55m4.920697832s) [noise=true , address=81.171.14.70:4043 , piece_id=UFHN6ZUT4DQZ22GQUJKPXFDALWVZJWJCYNCYB3C6AFO34WX5WSZQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.231999415 (81h55m4.929567772s) [noise=true , address=185.167.204.206:4063 , piece_id=OELO7NI2DV5UMSCRWZ2VLOCLOVYHINJXSSHHW3576L64PTI7IEKA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.264478983 (81h55m4.962047299s) [noise=true , address=81.171.14.70:4042 , piece_id=4RCMV6IXAXYHNYSR46DSG6OKYC443SVO6IKPX7NQNV4QEOWXGOAA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.269157092 (81h55m4.966725408s) [noise=true , address=81.171.14.70:4033 , piece_id=R5O33BH4A3EJKBLKV5KODVDM53PTBT4QSHYPJW6FMTPFMJ3YSQPQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.406996510 (81h55m5.104564846s) [noise=true , address=81.171.14.70:4036 , piece_id=7OFWJQKD4KSOJAFG4YBQMQBE5QES235DBZ5V63PAKX5YK63CHMVQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.549311400 (81h55m5.246879716s) [noise=true , address=185.167.204.205:4026 , piece_id=XFY2Y5FLAVP4GGYTKGJD5LL2TAY4VEHB77KQQKWQR4A37O6KVMKQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.629362198 (81h55m5.326930505s) [noise=true , address=81.171.14.70:4044 , piece_id=3HSSK2QLVJA2VXUHYDRMOJV2CF326VUU2HYNHVZASRDU6KGP6HJA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.636167071 (81h55m5.333735377s) [noise=true , address=81.171.14.70:4028 , piece_id=UYBGZEGNGRPKBUTDB4YEICXZPYWL77PGB4XKKPSU2SW767LGDRGQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.718867590 (81h55m5.416435906s) [noise=true , address=89.149.201.147:4018 , piece_id=J5CVPDPTKLIL3VDZXA6N3W2VIVTY67QRLFECI6A4TBCALQVHVTXA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.841899444 (81h55m5.53946776s) [noise=true , address=81.171.14.70:4031 , piece_id=OREWPNXS4LJQFRVR22O7YBAWTOPXZPELLR2TCDZEJDQKYL5MW3WA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.850287134 (81h55m5.54785544s) [noise=true , address=185.167.204.205:4034 , piece_id=AW2OUIYA3SK4526NNYJ7CW2CSPHTM7G34Q2VXMOV5YS4CTXNAXHA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.901950500 (81h55m5.599518847s) [noise=true , address=81.171.14.70:4041 , piece_id=N3A7GJ3PN6Q6MNA44ZAFNVG3PBHOQ3GHKSKVSW5ZJB5OAJT6M62Q, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:17.999746159 (81h55m5.697314496s) [noise=true , address=81.171.14.70:4048 , piece_id=BLA6JHKOHBZODO3NPDLNBCLQYSTZPY4YCSAK65WEX3SLYOUM2CBA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.082346230 (81h55m5.779914567s) [noise=true , address=81.171.14.70:4045 , piece_id=DU2EN4DL2VJIGKWI2K5IBNQT3UAIMKVXGEIC6QIDQDL7FPWVTO2A, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.157010607 (81h55m5.854578912s) [noise=true , address=81.171.14.70:4029 , piece_id=BUXT2NLALOY63CM2ZA4PTCEWUQHK3XDPV3B7GNQHWOFIK2SNYAJQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.205125142 (81h55m5.902693448s) [noise=true , address=89.149.201.147:4001 , piece_id=JZLVLPKODNGZ3KNMF2VOSWEU4FMXL4MCRO2ONUE3WUMMF4MVPBRA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.409747413 (81h55m6.107315749s) [noise=true , address=81.171.14.70:4025 , piece_id=UGJHHVCUJNS2RTTE26J4CIJ7MSF6WJRDTX7ZITJ4PGC4K6ETOSRA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.476553538 (81h55m6.174121874s) [noise=true , address=185.167.204.205:4002 , piece_id=D3OVPLP7QVEDZOBISBO6267J4DBZEGPGWBN6CNULDSJ5JSBBHGFA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.522057488 (81h55m6.219625834s) [noise=true , address=185.167.204.205:4024 , piece_id=UCOC25JDKJJ46MKQKKMPA3ETXZ5X4CGP47BINT2NO5KYILXSRSDQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.537781502 (81h55m6.235349849s) [noise=true , address=81.171.14.70:4038 , piece_id=TCB3IETDPZQQ322HGR4QDMBCYU7SJT5J33UMH6P4SLB4MWMQYUPA, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.672204288 (81h55m6.369772594s) [noise=true , address=89.149.201.147:4024 , piece_id=UL7JADLEPNW3SWPMRCGXZ5T4I4QNHGFB23ZIFUV2OMDSUCA2QE6Q, seg_pos={0 0}, upload=71887]: Done uploading piece. err: <nil> Dec 9 01:24:18.672223364 (81h55m6.36979167s) [seg_pos={0 0}, upload=71887]: Segment reached optimal threshold of 26 pieces. Dec 9 01:24:18.672400846 (81h55m6.369969162s) [noise=true , address=81.171.14.70:4047 , piece_id=W2YN5JEXQXQS5QX3YXDPZYVD2Q2ZC4PSW3DEQNLOWYCIBL3NSPKQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m): protocol: expected piece hash; context canceled; EOF Dec 9 01:24:18.672408540 (81h55m6.369976856s) [noise=true , address=81.171.14.70:4047 , piece_id=W2YN5JEXQXQS5QX3YXDPZYVD2Q2ZC4PSW3DEQNLOWYCIBL3NSPKQ, seg_pos={0 0}, upload=71887]: Long tail cancellation due to optimal threshold Dec 9 01:24:18.672535968 (81h55m6.370104274s) [noise=true , address=185.167.204.206:4049 , piece_id=44A5UMHCZ2DTBHJKZDNHSHQQYL53V363PS7TVOFFHUA3R7FAJPTQ, seg_pos={0 0}, upload=71887]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VQJie7zan6SRJRmRm36gsVfY8UsYqtJeFRgKZy6m5d6B1aLFM): protocol: expected piece hash; context canceled; EOF Dec 9 01:24:18.672550726 (81h55m6.370119062s) [noise=true , address=185.167.204.206:4049 , piece_id=44A5UMHCZ2DTBHJKZDNHSHQQYL53V363PS7TVOFFHUA3R7FAJPTQ, seg_pos={0 0}, upload=71887]: Long tail cancellation due to optimal threshold Dec 9 01:24:18.672575993 (81h55m6.370144309s) [seg_pos={0 0}, upload=71887]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:24:18.672649800 (81h55m6.370218107s) [upload=71887]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:24:18.672679556 (81h55m6.370247902s) [upload=71887]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:24:18.820521330 (81h55m6.518089647s) [upload=71887]: Done uploading segments... Dec 9 01:24:18.820536609 (81h55m6.518104925s) [upload=71887]: Upload finished. err: <nil> Duration: 32.199337185s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 418.697188ms trace: https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4 FAIL (2025-12-09 01:24:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload Dec 9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload Dec 9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments... Dec 9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false Dec 9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment... Dec 9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment. Dec 9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437 , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653 , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869 , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592 , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510 , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841 , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836 , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698 , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979 , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834 , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158 , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473 , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438 , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626 , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906 , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015 , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841 , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000 Dec 9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626 , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000 Dec 9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment Dec 9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments... Dec 9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979 , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836 , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438 , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015 , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906 , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437 , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158 , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869 , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510 , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473 , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834 , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653 , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592 , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Dec 9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698 , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF Dec 9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments... Dec 9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 418.70888ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 473.533732ms trace: https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4 FAIL (2025-12-09 01:24:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload Dec 9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload Dec 9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments... Dec 9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false Dec 9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment... Dec 9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment. Dec 9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437 , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653 , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869 , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592 , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510 , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841 , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836 , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698 , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979 , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834 , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158 , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473 , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438 , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626 , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906 , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015 , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841 , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000 Dec 9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626 , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000 Dec 9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment Dec 9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments... Dec 9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979 , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836 , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438 , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015 , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906 , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437 , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158 , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869 , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510 , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473 , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834 , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653 , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592 , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Dec 9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698 , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF Dec 9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments... Dec 9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 473.557246ms core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 16 out of 60 is failed (threshold=3) [..XX.....XX..X...X.....X.X.......X...X.....X.X.X...X...X..X.] duration: 3.99152601s trace: https://jaeger.dev.storj.io/trace/16f41bbca9e9be4a FAIL (2025-12-09 01:24:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 49.201.147:4009 , piece_id=4BENLKOFYIBQLHEZQ2LBBAFSLRUN3MJS6G5KEUDBMKLZ35WXGUDQ, seg_pos={0 0}, upload=71864]: Uploading piece... Dec 9 01:22:49.434020401 (81h53m37.131588708s) [noise=true , address=185.167.204.206:4038 , piece_id=RAGVTGYBPPPLR2PVTRYLD6BE42YBY2DMDVT3OM3GSJY33TAX7BYA, seg_pos={0 0}, upload=71864]: Uploading piece... Dec 9 01:22:49.435328937 (81h53m37.132897253s) [noise=true , address=185.167.204.205:4020 , piece_id=ZEG2NYYKCYW35XSHKXJNL6HDEX4LB7JXLA6VIKLUBYW2XVJAIIMQ, seg_pos={0 0}, upload=71864]: Uploading piece... Dec 9 01:22:49.436577700 (81h53m37.134146016s) [noise=true , address=185.167.204.205:4003 , piece_id=XNLIFQV66BUZ35ETYLQ77RN3AXKX5LYB6MPKJSY7OAMH62P62IWA, seg_pos={0 0}, upload=71864]: Uploading piece... Dec 9 01:22:49.437317071 (81h53m37.134885448s) [noise=true , address=185.167.204.206:4040 , piece_id=MHBCD6Q5SSUZVFJIR5T7TQM4J2WRU2CHFVITVZAQBJ4Q6SR7DEWA, seg_pos={0 0}, upload=71864]: Uploading piece... Dec 9 01:22:49.438819678 (81h53m37.136388024s) [noise=true , address=89.149.201.147:4011 , piece_id=Y6VTVPHKWKRI26E7ZQV6WSWKOXBX3PCHIMES5QPHR7EB6LFP7CAQ, seg_pos={0 0}, upload=71864]: Uploading piece... Dec 9 01:22:49.443597925 (81h53m37.141166261s) [noise=true , address=81.171.14.70:4036 , piece_id=HXITU6EXPINVPEBWOPH4ZVHTKYHMVWHJSOTREQX2N7GNGMY24CBQ, seg_pos={0 0}, upload=71864]: Uploading piece... Dec 9 01:22:49.444229745 (81h53m37.141798082s) [noise=true , address=185.167.204.206:4063 , piece_id=TETBXRVSRSRBTNI4RGSX46LXVIHURGND3POGCKCAUPAJYJN2AKZQ, seg_pos={0 0}, upload=71864]: Uploading piece... Dec 9 01:22:49.446095591 (81h53m37.143663907s) [noise=true , address=81.171.14.70:4042 , piece_id=Y4NNBQQRUJPKU5EYRWEPQ4ABQFJOM3JOZNFLHJ3PWVUACPM4UXWA, seg_pos={0 0}, upload=71864]: Uploading piece... Dec 9 01:22:49.447636990 (81h53m37.145205306s) [noise=true , address=185.167.204.205:4028 , piece_id=XEFO4CPWIZ6XO7YJRCNGTDRW7SLXZK2Z4WLTJY6HTXUQ75MKLRLA, seg_pos={0 0}, upload=71864]: Uploading piece... Dec 9 01:22:49.447805675 (81h53m37.145373982s) [noise=true , address=185.167.204.206:4066 , piece_id=FZISY5PC6VKQLAU25J67NKHMDUXGF54EQOXDQ3IKD6UIV4WOCH4A, seg_pos={0 0}, upload=71864]: Uploading piece... Dec 9 01:22:49.934191899 (81h53m37.631760204s) [upload=71864]: Next returned nil segment Dec 9 01:22:49.934201286 (81h53m37.631769593s) [upload=71864]: Waiting for error group managing segments... Dec 9 01:22:50.129107464 (81h53m37.826675771s) [noise=true , address=89.149.201.147:4009 , piece_id=4BENLKOFYIBQLHEZQ2LBBAFSLRUN3MJS6G5KEUDBMKLZ35WXGUDQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.137719844 (81h53m37.83528815s) [noise=true , address=185.167.204.206:4038 , piece_id=RAGVTGYBPPPLR2PVTRYLD6BE42YBY2DMDVT3OM3GSJY33TAX7BYA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.203271186 (81h53m37.900839502s) [noise=true , address=81.171.14.70:4042 , piece_id=Y4NNBQQRUJPKU5EYRWEPQ4ABQFJOM3JOZNFLHJ3PWVUACPM4UXWA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.228765974 (81h53m37.92633429s) [noise=true , address=89.149.201.147:4017 , piece_id=FM7W4TSAFOHO4Z2FKCVFL7PB46Y566ZPB5XMYZK4DWJUUNJQPSLQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.354209925 (81h53m38.051778241s) [noise=true , address=185.167.204.206:4064 , piece_id=6PKSR6PYDZ2QK62Q7MIZFFL2SUZUM4PRGP4H7VRLBJYT66ZCAXSA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.508975163 (81h53m38.206543479s) [noise=true , address=185.167.204.205:4020 , piece_id=ZEG2NYYKCYW35XSHKXJNL6HDEX4LB7JXLA6VIKLUBYW2XVJAIIMQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.512785281 (81h53m38.210353597s) [noise=true , address=185.167.204.206:4048 , piece_id=2G36U67DGUWKY4UAZLTLECKWFPVSK2ZM5FI2RLOBADRCFY67J4VA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.525661226 (81h53m38.223229531s) [noise=true , address=81.171.14.70:4036 , piece_id=HXITU6EXPINVPEBWOPH4ZVHTKYHMVWHJSOTREQX2N7GNGMY24CBQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.537466019 (81h53m38.235034335s) [noise=true , address=89.149.201.147:4005 , piece_id=KDE7F6A3J5WSIQLQSRDIOFM6T3OQ2FPVF32A2TNBQWR7V5CQN7ZQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.550426772 (81h53m38.247995088s) [noise=true , address=185.167.204.206:4037 , piece_id=CIPOGE47REBLKHVJVSHVXUB67MVLWA62YLY3LH3AIQWYXHZ4JZOA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.556398467 (81h53m38.253966774s) [noise=true , address=185.167.204.206:4054 , piece_id=QAQHG6RKAW23EGB4V3Y3EY7LA2ZFKDKNXJAEMZEI2SSX7V756NUA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.592530609 (81h53m38.290098916s) [noise=true , address=185.167.204.206:4040 , piece_id=MHBCD6Q5SSUZVFJIR5T7TQM4J2WRU2CHFVITVZAQBJ4Q6SR7DEWA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.612148519 (81h53m38.309716824s) [noise=true , address=185.167.204.205:4003 , piece_id=XNLIFQV66BUZ35ETYLQ77RN3AXKX5LYB6MPKJSY7OAMH62P62IWA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.629404666 (81h53m38.326972972s) [noise=true , address=185.167.204.205:4010 , piece_id=JBXCRBEA57RKEV22HNG5OQJTE423F453JZIPWFJ2T3OGH2VMLCOA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.675582154 (81h53m38.37315047s) [noise=true , address=89.149.201.147:4021 , piece_id=NZSZ2PEWHV7E5NEIXNYSIBIGF6I46CN5HTHRPRRTLL47NUSN6L3Q, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.743160953 (81h53m38.440729269s) [noise=true , address=89.149.201.147:4011 , piece_id=Y6VTVPHKWKRI26E7ZQV6WSWKOXBX3PCHIMES5QPHR7EB6LFP7CAQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.836871360 (81h53m38.534439707s) [noise=true , address=81.171.14.70:4030 , piece_id=CUF5XVYQ7PXWWTGFKVQAXMUOLF4LPYXZ72MBXT37FRXYTZ3PMH6A, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.899154796 (81h53m38.596723112s) [noise=true , address=185.167.204.206:4062 , piece_id=HDYZEETQ3WYTQWQ62AZ3RDHDFCYRPR3C5334D7EZLF2GIFQAH4ZA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.927833603 (81h53m38.625401919s) [noise=true , address=185.167.204.206:4063 , piece_id=TETBXRVSRSRBTNI4RGSX46LXVIHURGND3POGCKCAUPAJYJN2AKZQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:51.036542020 (81h53m38.734110336s) [noise=true , address=81.171.14.70:4026 , piece_id=W4YJO6XCGLC76UILMOPMOMN7MV3KCFPZ25FN3R7MF6Y5HM5PNSBQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:51.141860743 (81h53m38.839429059s) [noise=true , address=81.171.14.70:4047 , piece_id=ZDPRTAXSY6ZPV7SZPELCK6KM4HSL4XU5ML6WN4DE35USMJBI2ESQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:51.162120031 (81h53m38.859688347s) [noise=true , address=185.167.204.206:4066 , piece_id=FZISY5PC6VKQLAU25J67NKHMDUXGF54EQOXDQ3IKD6UIV4WOCH4A, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:51.275122349 (81h53m38.972690654s) [noise=true , address=185.167.204.205:4035 , piece_id=O5W5XLRPQDOJOZ57OMCHZRIEO3DACWATUQWPTTKT2ZPPPP7CRNRA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:51.480474091 (81h53m39.178042397s) [noise=true , address=89.149.201.147:4004 , piece_id=LH54SGNDUTS3GWI3XWMGEHDT7QPURFO5UDVISMN7YUQU3AWSWRGQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:51.720414853 (81h53m39.417983159s) [noise=true , address=81.171.14.70:4034 , piece_id=5BUHUTTGQE7WNMR46Q3GKAF4MI5KJO5XK5LYMU4IXXYFG4WAYUQQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:51.763265586 (81h53m39.460833902s) [noise=true , address=89.149.201.147:4020 , piece_id=GJPXYHAWCCM5F6KLI5DNZ6D5OB5DHWV5NBERWH6ZL6TYROBNJYCQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:51.763281516 (81h53m39.460849832s) [seg_pos={0 0}, upload=71864]: Segment reached optimal threshold of 26 pieces. Dec 9 01:22:51.763519540 (81h53m39.461087856s) [noise=true , address=89.149.201.147:4007 , piece_id=PTEXFVFULOD2KTTIJSMNDZUCRFTAF363V2GBD45ZWSMKS4BEJHCA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Dec 9 01:22:51.763528387 (81h53m39.461096703s) [noise=true , address=89.149.201.147:4007 , piece_id=PTEXFVFULOD2KTTIJSMNDZUCRFTAF363V2GBD45ZWSMKS4BEJHCA, seg_pos={0 0}, upload=71864]: Long tail cancellation due to optimal threshold Dec 9 01:22:51.763598859 (81h53m39.461167175s) [noise=true , address=185.167.204.205:4028 , piece_id=XEFO4CPWIZ6XO7YJRCNGTDRW7SLXZK2Z4WLTJY6HTXUQ75MKLRLA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61): protocol: expected piece hash; context canceled; EOF Dec 9 01:22:51.763610370 (81h53m39.461178686s) [noise=true , address=185.167.204.205:4028 , piece_id=XEFO4CPWIZ6XO7YJRCNGTDRW7SLXZK2Z4WLTJY6HTXUQ75MKLRLA, seg_pos={0 0}, upload=71864]: Long tail cancellation due to optimal threshold Dec 9 01:22:51.763632721 (81h53m39.461201037s) [seg_pos={0 0}, upload=71864]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:22:51.763700258 (81h53m39.461268574s) [upload=71864]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:22:51.763704186 (81h53m39.461272491s) [upload=71864]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:22:51.915202580 (81h53m39.612770916s) [upload=71864]: Done uploading segments... Dec 9 01:22:51.915222758 (81h53m39.612791094s) [upload=71864]: Upload finished. err: <nil> Duration: 3.991544345s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 563.460122ms trace: https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4 FAIL (2025-12-09 01:23:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload Dec 9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload Dec 9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments... Dec 9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false Dec 9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment... Dec 9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment. Dec 9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437 , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653 , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869 , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592 , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510 , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841 , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836 , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698 , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979 , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834 , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158 , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473 , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438 , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626 , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906 , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015 , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841 , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000 Dec 9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626 , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000 Dec 9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment Dec 9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments... Dec 9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979 , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836 , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438 , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015 , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906 , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437 , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158 , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869 , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510 , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473 , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834 , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653 , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592 , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Dec 9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698 , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF Dec 9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments... Dec 9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 563.484699ms core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 16 out of 60 is failed (threshold=3) [...XX.....XX..X...X.....X.X.......X...X.....X.X.X...X...X..X] duration: 37.332332458s trace: https://jaeger.dev.storj.io/trace/16f41bbca9e9be4a FAIL (2025-12-09 01:23:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 49.201.147:4009 , piece_id=4BENLKOFYIBQLHEZQ2LBBAFSLRUN3MJS6G5KEUDBMKLZ35WXGUDQ, seg_pos={0 0}, upload=71864]: Uploading piece... Dec 9 01:22:49.434020401 (81h53m37.131588708s) [noise=true , address=185.167.204.206:4038 , piece_id=RAGVTGYBPPPLR2PVTRYLD6BE42YBY2DMDVT3OM3GSJY33TAX7BYA, seg_pos={0 0}, upload=71864]: Uploading piece... Dec 9 01:22:49.435328937 (81h53m37.132897253s) [noise=true , address=185.167.204.205:4020 , piece_id=ZEG2NYYKCYW35XSHKXJNL6HDEX4LB7JXLA6VIKLUBYW2XVJAIIMQ, seg_pos={0 0}, upload=71864]: Uploading piece... Dec 9 01:22:49.436577700 (81h53m37.134146016s) [noise=true , address=185.167.204.205:4003 , piece_id=XNLIFQV66BUZ35ETYLQ77RN3AXKX5LYB6MPKJSY7OAMH62P62IWA, seg_pos={0 0}, upload=71864]: Uploading piece... Dec 9 01:22:49.437317071 (81h53m37.134885448s) [noise=true , address=185.167.204.206:4040 , piece_id=MHBCD6Q5SSUZVFJIR5T7TQM4J2WRU2CHFVITVZAQBJ4Q6SR7DEWA, seg_pos={0 0}, upload=71864]: Uploading piece... Dec 9 01:22:49.438819678 (81h53m37.136388024s) [noise=true , address=89.149.201.147:4011 , piece_id=Y6VTVPHKWKRI26E7ZQV6WSWKOXBX3PCHIMES5QPHR7EB6LFP7CAQ, seg_pos={0 0}, upload=71864]: Uploading piece... Dec 9 01:22:49.443597925 (81h53m37.141166261s) [noise=true , address=81.171.14.70:4036 , piece_id=HXITU6EXPINVPEBWOPH4ZVHTKYHMVWHJSOTREQX2N7GNGMY24CBQ, seg_pos={0 0}, upload=71864]: Uploading piece... Dec 9 01:22:49.444229745 (81h53m37.141798082s) [noise=true , address=185.167.204.206:4063 , piece_id=TETBXRVSRSRBTNI4RGSX46LXVIHURGND3POGCKCAUPAJYJN2AKZQ, seg_pos={0 0}, upload=71864]: Uploading piece... Dec 9 01:22:49.446095591 (81h53m37.143663907s) [noise=true , address=81.171.14.70:4042 , piece_id=Y4NNBQQRUJPKU5EYRWEPQ4ABQFJOM3JOZNFLHJ3PWVUACPM4UXWA, seg_pos={0 0}, upload=71864]: Uploading piece... Dec 9 01:22:49.447636990 (81h53m37.145205306s) [noise=true , address=185.167.204.205:4028 , piece_id=XEFO4CPWIZ6XO7YJRCNGTDRW7SLXZK2Z4WLTJY6HTXUQ75MKLRLA, seg_pos={0 0}, upload=71864]: Uploading piece... Dec 9 01:22:49.447805675 (81h53m37.145373982s) [noise=true , address=185.167.204.206:4066 , piece_id=FZISY5PC6VKQLAU25J67NKHMDUXGF54EQOXDQ3IKD6UIV4WOCH4A, seg_pos={0 0}, upload=71864]: Uploading piece... Dec 9 01:22:49.934191899 (81h53m37.631760204s) [upload=71864]: Next returned nil segment Dec 9 01:22:49.934201286 (81h53m37.631769593s) [upload=71864]: Waiting for error group managing segments... Dec 9 01:22:50.129107464 (81h53m37.826675771s) [noise=true , address=89.149.201.147:4009 , piece_id=4BENLKOFYIBQLHEZQ2LBBAFSLRUN3MJS6G5KEUDBMKLZ35WXGUDQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.137719844 (81h53m37.83528815s) [noise=true , address=185.167.204.206:4038 , piece_id=RAGVTGYBPPPLR2PVTRYLD6BE42YBY2DMDVT3OM3GSJY33TAX7BYA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.203271186 (81h53m37.900839502s) [noise=true , address=81.171.14.70:4042 , piece_id=Y4NNBQQRUJPKU5EYRWEPQ4ABQFJOM3JOZNFLHJ3PWVUACPM4UXWA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.228765974 (81h53m37.92633429s) [noise=true , address=89.149.201.147:4017 , piece_id=FM7W4TSAFOHO4Z2FKCVFL7PB46Y566ZPB5XMYZK4DWJUUNJQPSLQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.354209925 (81h53m38.051778241s) [noise=true , address=185.167.204.206:4064 , piece_id=6PKSR6PYDZ2QK62Q7MIZFFL2SUZUM4PRGP4H7VRLBJYT66ZCAXSA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.508975163 (81h53m38.206543479s) [noise=true , address=185.167.204.205:4020 , piece_id=ZEG2NYYKCYW35XSHKXJNL6HDEX4LB7JXLA6VIKLUBYW2XVJAIIMQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.512785281 (81h53m38.210353597s) [noise=true , address=185.167.204.206:4048 , piece_id=2G36U67DGUWKY4UAZLTLECKWFPVSK2ZM5FI2RLOBADRCFY67J4VA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.525661226 (81h53m38.223229531s) [noise=true , address=81.171.14.70:4036 , piece_id=HXITU6EXPINVPEBWOPH4ZVHTKYHMVWHJSOTREQX2N7GNGMY24CBQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.537466019 (81h53m38.235034335s) [noise=true , address=89.149.201.147:4005 , piece_id=KDE7F6A3J5WSIQLQSRDIOFM6T3OQ2FPVF32A2TNBQWR7V5CQN7ZQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.550426772 (81h53m38.247995088s) [noise=true , address=185.167.204.206:4037 , piece_id=CIPOGE47REBLKHVJVSHVXUB67MVLWA62YLY3LH3AIQWYXHZ4JZOA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.556398467 (81h53m38.253966774s) [noise=true , address=185.167.204.206:4054 , piece_id=QAQHG6RKAW23EGB4V3Y3EY7LA2ZFKDKNXJAEMZEI2SSX7V756NUA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.592530609 (81h53m38.290098916s) [noise=true , address=185.167.204.206:4040 , piece_id=MHBCD6Q5SSUZVFJIR5T7TQM4J2WRU2CHFVITVZAQBJ4Q6SR7DEWA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.612148519 (81h53m38.309716824s) [noise=true , address=185.167.204.205:4003 , piece_id=XNLIFQV66BUZ35ETYLQ77RN3AXKX5LYB6MPKJSY7OAMH62P62IWA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.629404666 (81h53m38.326972972s) [noise=true , address=185.167.204.205:4010 , piece_id=JBXCRBEA57RKEV22HNG5OQJTE423F453JZIPWFJ2T3OGH2VMLCOA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.675582154 (81h53m38.37315047s) [noise=true , address=89.149.201.147:4021 , piece_id=NZSZ2PEWHV7E5NEIXNYSIBIGF6I46CN5HTHRPRRTLL47NUSN6L3Q, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.743160953 (81h53m38.440729269s) [noise=true , address=89.149.201.147:4011 , piece_id=Y6VTVPHKWKRI26E7ZQV6WSWKOXBX3PCHIMES5QPHR7EB6LFP7CAQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.836871360 (81h53m38.534439707s) [noise=true , address=81.171.14.70:4030 , piece_id=CUF5XVYQ7PXWWTGFKVQAXMUOLF4LPYXZ72MBXT37FRXYTZ3PMH6A, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.899154796 (81h53m38.596723112s) [noise=true , address=185.167.204.206:4062 , piece_id=HDYZEETQ3WYTQWQ62AZ3RDHDFCYRPR3C5334D7EZLF2GIFQAH4ZA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:50.927833603 (81h53m38.625401919s) [noise=true , address=185.167.204.206:4063 , piece_id=TETBXRVSRSRBTNI4RGSX46LXVIHURGND3POGCKCAUPAJYJN2AKZQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:51.036542020 (81h53m38.734110336s) [noise=true , address=81.171.14.70:4026 , piece_id=W4YJO6XCGLC76UILMOPMOMN7MV3KCFPZ25FN3R7MF6Y5HM5PNSBQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:51.141860743 (81h53m38.839429059s) [noise=true , address=81.171.14.70:4047 , piece_id=ZDPRTAXSY6ZPV7SZPELCK6KM4HSL4XU5ML6WN4DE35USMJBI2ESQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:51.162120031 (81h53m38.859688347s) [noise=true , address=185.167.204.206:4066 , piece_id=FZISY5PC6VKQLAU25J67NKHMDUXGF54EQOXDQ3IKD6UIV4WOCH4A, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:51.275122349 (81h53m38.972690654s) [noise=true , address=185.167.204.205:4035 , piece_id=O5W5XLRPQDOJOZ57OMCHZRIEO3DACWATUQWPTTKT2ZPPPP7CRNRA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:51.480474091 (81h53m39.178042397s) [noise=true , address=89.149.201.147:4004 , piece_id=LH54SGNDUTS3GWI3XWMGEHDT7QPURFO5UDVISMN7YUQU3AWSWRGQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:51.720414853 (81h53m39.417983159s) [noise=true , address=81.171.14.70:4034 , piece_id=5BUHUTTGQE7WNMR46Q3GKAF4MI5KJO5XK5LYMU4IXXYFG4WAYUQQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:51.763265586 (81h53m39.460833902s) [noise=true , address=89.149.201.147:4020 , piece_id=GJPXYHAWCCM5F6KLI5DNZ6D5OB5DHWV5NBERWH6ZL6TYROBNJYCQ, seg_pos={0 0}, upload=71864]: Done uploading piece. err: <nil> Dec 9 01:22:51.763281516 (81h53m39.460849832s) [seg_pos={0 0}, upload=71864]: Segment reached optimal threshold of 26 pieces. Dec 9 01:22:51.763519540 (81h53m39.461087856s) [noise=true , address=89.149.201.147:4007 , piece_id=PTEXFVFULOD2KTTIJSMNDZUCRFTAF363V2GBD45ZWSMKS4BEJHCA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF Dec 9 01:22:51.763528387 (81h53m39.461096703s) [noise=true , address=89.149.201.147:4007 , piece_id=PTEXFVFULOD2KTTIJSMNDZUCRFTAF363V2GBD45ZWSMKS4BEJHCA, seg_pos={0 0}, upload=71864]: Long tail cancellation due to optimal threshold Dec 9 01:22:51.763598859 (81h53m39.461167175s) [noise=true , address=185.167.204.205:4028 , piece_id=XEFO4CPWIZ6XO7YJRCNGTDRW7SLXZK2Z4WLTJY6HTXUQ75MKLRLA, seg_pos={0 0}, upload=71864]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61): protocol: expected piece hash; context canceled; EOF Dec 9 01:22:51.763610370 (81h53m39.461178686s) [noise=true , address=185.167.204.205:4028 , piece_id=XEFO4CPWIZ6XO7YJRCNGTDRW7SLXZK2Z4WLTJY6HTXUQ75MKLRLA, seg_pos={0 0}, upload=71864]: Long tail cancellation due to optimal threshold Dec 9 01:22:51.763632721 (81h53m39.461201037s) [seg_pos={0 0}, upload=71864]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:22:51.763700258 (81h53m39.461268574s) [upload=71864]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:22:51.763704186 (81h53m39.461272491s) [upload=71864]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:22:51.915202580 (81h53m39.612770916s) [upload=71864]: Done uploading segments... Dec 9 01:22:51.915222758 (81h53m39.612791094s) [upload=71864]: Upload finished. err: <nil> Duration: 37.332370488s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 16 out of 60 is failed (threshold=3) [X...XX.....XX..X...X.....X.X.......X...X.....X.X.X...X...X..] duration: 33.92964032s trace: https://jaeger.dev.storj.io/trace/42a7be80af97e50f FAIL (2025-12-09 01:22:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== .167.204.205:4011 , piece_id=PV7EEHBLDN6NDTJLCLYTUD7SNRBAPG4FT2KNP73FQGOBMFWOWNLA, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.381913079 (81h50m56.079481395s) [noise=true , address=81.171.14.70:4028 , piece_id=W4BQKTYF3BWUQ6U23JXCAOQIGUUNIBMSMMYG45IYRPHIG2ILGAMA, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.383672136 (81h50m56.081240452s) [noise=true , address=81.171.14.70:4033 , piece_id=DSCBZQEDCMJSX5VUBQI3SBQDTGVGYRNQNY2ST4VTV7ZEOFDMX7YA, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.384163643 (81h50m56.081731959s) [noise=true , address=81.171.14.70:4026 , piece_id=BN3UDLDI6LLCUQB42ODU4SGPNJFPEIQL6ITZS5BKQ7O2LHUJZF6A, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.385586612 (81h50m56.083154918s) [noise=true , address=81.171.14.70:4044 , piece_id=7FFBWCSV32VF5OSLCKK7UGATH5KUNG2WLKPKWOSDXI4V4PIIMNFQ, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.387023626 (81h50m56.084591932s) [noise=true , address=185.167.204.206:4070 , piece_id=I6D47OABKPFO2QROLJPRUCYLE53TXPVGVKXIQDGJMILL2VDKZODA, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.388500877 (81h50m56.086069193s) [noise=true , address=81.171.14.70:4048 , piece_id=7PBYGT5JPUN7TF4YFGTQW2HI6VARNQY6ML7J4HI6AVRI6OFU46TQ, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.389722008 (81h50m56.087290324s) [noise=true , address=185.167.204.206:4057 , piece_id=KN7WTE4NOZ3GQMZPU44PTCI2SXH5GG4WX7BATLBYKH5Z7AJRJHYA, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.390850687 (81h50m56.088418993s) [noise=true , address=89.149.201.147:4014 , piece_id=PXDZZMWULFTMLDQJDHJ7YVO5ZED3RPZLRITHFW3BQXFEIPKL25LQ, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.392092476 (81h50m56.089660782s) [noise=true , address=89.149.201.147:4022 , piece_id=VCQWMRSWBYESLNGJIYWOBTO5NOP6RBDRE2XGCAA5SEKR3WAHX4HQ, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.393539519 (81h50m56.091107835s) [noise=true , address=185.167.204.205:4001 , piece_id=DSD2SAR27XEM4DPYGHSL54OGJSSMDOYFYJM6B2RUAGIOQBJR4KVA, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.895558647 (81h50m56.593126963s) [upload=71828]: Next returned nil segment Dec 9 01:20:08.895568566 (81h50m56.593136871s) [upload=71828]: Waiting for error group managing segments... Dec 9 01:20:09.103253778 (81h50m56.800822094s) [noise=true , address=185.167.204.205:4030 , piece_id=QHVKMOUH7VV2BYFBVIWCW647VTT34PWKEKC4WFZOLKEIFAQHI72Q, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.104813602 (81h50m56.802381908s) [noise=true , address=185.167.204.206:4049 , piece_id=EMCRK4EXOTGBI4DRPLVJUGW3G7ZK5ZDPFBTQWJJCF63GH62AQCTQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.110264585 (81h50m56.807832892s) [noise=true , address=185.167.204.206:4059 , piece_id=OD6YOWZQ4ETXGF4OTW5YVAFXUH7VDHY2RNXCXZMOJN7M42TUS5QQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.110726548 (81h50m56.808294854s) [noise=true , address=185.167.204.205:4015 , piece_id=4YJZX7RLIWNQREC22IHDXXAKBEK33AX4YB7VTRH5WRAAPJEPHFSQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.114824504 (81h50m56.81239282s) [noise=true , address=89.149.201.147:4022 , piece_id=VCQWMRSWBYESLNGJIYWOBTO5NOP6RBDRE2XGCAA5SEKR3WAHX4HQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.115702193 (81h50m56.8132705s) [noise=true , address=185.167.204.206:4041 , piece_id=3YNDFXCXB2XF2QVCTLCBY24ICIWYXW463J5FK3WC5NXZ577MY7ZQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.117899840 (81h50m56.815468145s) [noise=true , address=81.171.14.70:4028 , piece_id=W4BQKTYF3BWUQ6U23JXCAOQIGUUNIBMSMMYG45IYRPHIG2ILGAMA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.171330387 (81h50m56.868898693s) [noise=true , address=185.167.204.205:4003 , piece_id=BZWCDDA42DYXLI4L4NCKYPYX6QBNBWZXKAJ2LFYJB4TDXMUM57TQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.420331113 (81h50m57.117899429s) [noise=true , address=81.171.14.70:4033 , piece_id=DSCBZQEDCMJSX5VUBQI3SBQDTGVGYRNQNY2ST4VTV7ZEOFDMX7YA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.444798874 (81h50m57.14236719s) [noise=true , address=185.167.204.206:4061 , piece_id=BDZCEIA66CMQRH7T7BBZR6MKE5CRTFUD5Z5NTFXRTWUSCEV2TB2A, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.515893741 (81h50m57.213462058s) [noise=true , address=81.171.14.70:4026 , piece_id=BN3UDLDI6LLCUQB42ODU4SGPNJFPEIQL6ITZS5BKQ7O2LHUJZF6A, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.528672865 (81h50m57.226241181s) [noise=true , address=185.167.204.206:4043 , piece_id=OUYOIZ3OYD6IJODD6JAOX2BNWWTGGJPIL4FTOCOKDSHQHMM3RDZQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.564947412 (81h50m57.262515728s) [noise=true , address=185.167.204.206:4057 , piece_id=KN7WTE4NOZ3GQMZPU44PTCI2SXH5GG4WX7BATLBYKH5Z7AJRJHYA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.575548586 (81h50m57.273116902s) [noise=true , address=185.167.204.205:4024 , piece_id=VKGV2TYCJ47WMXBNSMXWJHBYYBFMZW33JLUML4LQFGGPHJQTNPOQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.606071949 (81h50m57.303640255s) [noise=true , address=185.167.204.205:4001 , piece_id=DSD2SAR27XEM4DPYGHSL54OGJSSMDOYFYJM6B2RUAGIOQBJR4KVA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.643767581 (81h50m57.341335897s) [noise=true , address=81.171.14.70:4039 , piece_id=A4BC4SKRRWBAQPUYHCBV6EE56N64XDVH5ANWV4SB7VNQN4LRHLZA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.699686567 (81h50m57.397254893s) [noise=true , address=89.149.201.147:4005 , piece_id=EFULPYYT2QAPNSA4IZMVUY5UXZMKU3ATJKOLRSGBSQF2ROGE5GVA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.900637587 (81h50m57.598205924s) [noise=true , address=81.171.14.70:4035 , piece_id=PSBL3OWA3WFVSR5HFIZHOUPC5PS2SUF4QA7PTLJRPWTE6JVTN3HA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.940878094 (81h50m57.63844649s) [noise=true , address=81.171.14.70:4048 , piece_id=7PBYGT5JPUN7TF4YFGTQW2HI6VARNQY6ML7J4HI6AVRI6OFU46TQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.961377601 (81h50m57.658945937s) [noise=true , address=185.167.204.205:4011 , piece_id=PV7EEHBLDN6NDTJLCLYTUD7SNRBAPG4FT2KNP73FQGOBMFWOWNLA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:10.037256686 (81h50m57.734825022s) [noise=true , address=81.171.14.70:4037 , piece_id=OD3XIAMG7E5H3MEQJZTAA26Y5UTBUJ24UVQ5IZFA2MVWMMOGSX5Q, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:10.053031477 (81h50m57.750599812s) [noise=true , address=81.171.14.70:4034 , piece_id=6J5SRCY2MIST65OBOOAYZPSBUB7FLDWWKHVBJHYMDFKJAQNKYU6Q, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:10.056428161 (81h50m57.753996477s) [noise=true , address=185.167.204.206:4054 , piece_id=UYM6Q64L7P65B7WMBZ3V5UEIEPXYSXBAH4CIXMJMSL6QIMJAMHUQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:10.180318280 (81h50m57.877886586s) [noise=true , address=81.171.14.70:4044 , piece_id=7FFBWCSV32VF5OSLCKK7UGATH5KUNG2WLKPKWOSDXI4V4PIIMNFQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:10.228417648 (81h50m57.925985974s) [noise=true , address=89.149.201.147:4014 , piece_id=PXDZZMWULFTMLDQJDHJ7YVO5ZED3RPZLRITHFW3BQXFEIPKL25LQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:10.532469801 (81h50m58.230038108s) [noise=true , address=185.167.204.206:4070 , piece_id=I6D47OABKPFO2QROLJPRUCYLE53TXPVGVKXIQDGJMILL2VDKZODA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:10.532496281 (81h50m58.230064597s) [seg_pos={0 0}, upload=71828]: Segment reached optimal threshold of 26 pieces. Dec 9 01:20:10.532650399 (81h50m58.230218715s) [noise=true , address=81.171.14.70:4040 , piece_id=F2WG2MNIZP5J36VDPE5JJF6NM7ABPYPFGWDDQO5PUTLE446RDOAA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV): protocol: expected piece hash; context canceled; EOF Dec 9 01:20:10.532657232 (81h50m58.230225538s) [noise=true , address=81.171.14.70:4040 , piece_id=F2WG2MNIZP5J36VDPE5JJF6NM7ABPYPFGWDDQO5PUTLE446RDOAA, seg_pos={0 0}, upload=71828]: Long tail cancellation due to optimal threshold Dec 9 01:20:10.532665908 (81h50m58.230234225s) [noise=true , address=89.149.201.147:4015 , piece_id=ZA66LVGKUDMPO3D6UZ3GPZFK2ADISEBOGWARZ5ICRWKVXCKQUBOA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K): protocol: expected piece hash; context canceled; EOF Dec 9 01:20:10.532669745 (81h50m58.230238061s) [noise=true , address=89.149.201.147:4015 , piece_id=ZA66LVGKUDMPO3D6UZ3GPZFK2ADISEBOGWARZ5ICRWKVXCKQUBOA, seg_pos={0 0}, upload=71828]: Long tail cancellation due to optimal threshold Dec 9 01:20:10.532681026 (81h50m58.230249342s) [seg_pos={0 0}, upload=71828]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:20:10.532740557 (81h50m58.230308873s) [upload=71828]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:20:10.532745767 (81h50m58.230314083s) [upload=71828]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:20:10.680757778 (81h50m58.378326094s) [upload=71828]: Done uploading segments... Dec 9 01:20:10.680771253 (81h50m58.378339559s) [upload=71828]: Upload finished. err: <nil> Duration: 33.929663063s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 424.114921ms trace: https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4 FAIL (2025-12-09 01:22:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload Dec 9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload Dec 9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments... Dec 9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false Dec 9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment... Dec 9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment. Dec 9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437 , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653 , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869 , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592 , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510 , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841 , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836 , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698 , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979 , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834 , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158 , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473 , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438 , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626 , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906 , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015 , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841 , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000 Dec 9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626 , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000 Dec 9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment Dec 9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments... Dec 9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979 , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836 , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438 , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015 , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906 , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437 , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158 , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869 , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510 , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473 , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834 , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653 , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592 , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Dec 9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698 , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF Dec 9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments... Dec 9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 424.138434ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 461.217393ms trace: https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4 FAIL (2025-12-09 01:21:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload Dec 9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload Dec 9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments... Dec 9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false Dec 9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment... Dec 9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment. Dec 9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437 , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653 , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869 , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592 , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510 , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841 , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836 , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698 , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979 , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834 , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158 , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473 , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438 , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626 , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906 , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015 , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841 , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000 Dec 9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626 , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000 Dec 9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment Dec 9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments... Dec 9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979 , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836 , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438 , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015 , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906 , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437 , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158 , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869 , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510 , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473 , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834 , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653 , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592 , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Dec 9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698 , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF Dec 9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments... Dec 9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 461.243542ms core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 16 out of 60 is failed (threshold=3) [.X...XX.....XX..X...X.....X.X.......X...X.....X.X.X...X...X.] duration: 7.712309555s trace: https://jaeger.dev.storj.io/trace/42a7be80af97e50f FAIL (2025-12-09 01:21:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== .167.204.205:4011 , piece_id=PV7EEHBLDN6NDTJLCLYTUD7SNRBAPG4FT2KNP73FQGOBMFWOWNLA, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.381913079 (81h50m56.079481395s) [noise=true , address=81.171.14.70:4028 , piece_id=W4BQKTYF3BWUQ6U23JXCAOQIGUUNIBMSMMYG45IYRPHIG2ILGAMA, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.383672136 (81h50m56.081240452s) [noise=true , address=81.171.14.70:4033 , piece_id=DSCBZQEDCMJSX5VUBQI3SBQDTGVGYRNQNY2ST4VTV7ZEOFDMX7YA, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.384163643 (81h50m56.081731959s) [noise=true , address=81.171.14.70:4026 , piece_id=BN3UDLDI6LLCUQB42ODU4SGPNJFPEIQL6ITZS5BKQ7O2LHUJZF6A, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.385586612 (81h50m56.083154918s) [noise=true , address=81.171.14.70:4044 , piece_id=7FFBWCSV32VF5OSLCKK7UGATH5KUNG2WLKPKWOSDXI4V4PIIMNFQ, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.387023626 (81h50m56.084591932s) [noise=true , address=185.167.204.206:4070 , piece_id=I6D47OABKPFO2QROLJPRUCYLE53TXPVGVKXIQDGJMILL2VDKZODA, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.388500877 (81h50m56.086069193s) [noise=true , address=81.171.14.70:4048 , piece_id=7PBYGT5JPUN7TF4YFGTQW2HI6VARNQY6ML7J4HI6AVRI6OFU46TQ, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.389722008 (81h50m56.087290324s) [noise=true , address=185.167.204.206:4057 , piece_id=KN7WTE4NOZ3GQMZPU44PTCI2SXH5GG4WX7BATLBYKH5Z7AJRJHYA, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.390850687 (81h50m56.088418993s) [noise=true , address=89.149.201.147:4014 , piece_id=PXDZZMWULFTMLDQJDHJ7YVO5ZED3RPZLRITHFW3BQXFEIPKL25LQ, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.392092476 (81h50m56.089660782s) [noise=true , address=89.149.201.147:4022 , piece_id=VCQWMRSWBYESLNGJIYWOBTO5NOP6RBDRE2XGCAA5SEKR3WAHX4HQ, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.393539519 (81h50m56.091107835s) [noise=true , address=185.167.204.205:4001 , piece_id=DSD2SAR27XEM4DPYGHSL54OGJSSMDOYFYJM6B2RUAGIOQBJR4KVA, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.895558647 (81h50m56.593126963s) [upload=71828]: Next returned nil segment Dec 9 01:20:08.895568566 (81h50m56.593136871s) [upload=71828]: Waiting for error group managing segments... Dec 9 01:20:09.103253778 (81h50m56.800822094s) [noise=true , address=185.167.204.205:4030 , piece_id=QHVKMOUH7VV2BYFBVIWCW647VTT34PWKEKC4WFZOLKEIFAQHI72Q, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.104813602 (81h50m56.802381908s) [noise=true , address=185.167.204.206:4049 , piece_id=EMCRK4EXOTGBI4DRPLVJUGW3G7ZK5ZDPFBTQWJJCF63GH62AQCTQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.110264585 (81h50m56.807832892s) [noise=true , address=185.167.204.206:4059 , piece_id=OD6YOWZQ4ETXGF4OTW5YVAFXUH7VDHY2RNXCXZMOJN7M42TUS5QQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.110726548 (81h50m56.808294854s) [noise=true , address=185.167.204.205:4015 , piece_id=4YJZX7RLIWNQREC22IHDXXAKBEK33AX4YB7VTRH5WRAAPJEPHFSQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.114824504 (81h50m56.81239282s) [noise=true , address=89.149.201.147:4022 , piece_id=VCQWMRSWBYESLNGJIYWOBTO5NOP6RBDRE2XGCAA5SEKR3WAHX4HQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.115702193 (81h50m56.8132705s) [noise=true , address=185.167.204.206:4041 , piece_id=3YNDFXCXB2XF2QVCTLCBY24ICIWYXW463J5FK3WC5NXZ577MY7ZQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.117899840 (81h50m56.815468145s) [noise=true , address=81.171.14.70:4028 , piece_id=W4BQKTYF3BWUQ6U23JXCAOQIGUUNIBMSMMYG45IYRPHIG2ILGAMA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.171330387 (81h50m56.868898693s) [noise=true , address=185.167.204.205:4003 , piece_id=BZWCDDA42DYXLI4L4NCKYPYX6QBNBWZXKAJ2LFYJB4TDXMUM57TQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.420331113 (81h50m57.117899429s) [noise=true , address=81.171.14.70:4033 , piece_id=DSCBZQEDCMJSX5VUBQI3SBQDTGVGYRNQNY2ST4VTV7ZEOFDMX7YA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.444798874 (81h50m57.14236719s) [noise=true , address=185.167.204.206:4061 , piece_id=BDZCEIA66CMQRH7T7BBZR6MKE5CRTFUD5Z5NTFXRTWUSCEV2TB2A, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.515893741 (81h50m57.213462058s) [noise=true , address=81.171.14.70:4026 , piece_id=BN3UDLDI6LLCUQB42ODU4SGPNJFPEIQL6ITZS5BKQ7O2LHUJZF6A, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.528672865 (81h50m57.226241181s) [noise=true , address=185.167.204.206:4043 , piece_id=OUYOIZ3OYD6IJODD6JAOX2BNWWTGGJPIL4FTOCOKDSHQHMM3RDZQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.564947412 (81h50m57.262515728s) [noise=true , address=185.167.204.206:4057 , piece_id=KN7WTE4NOZ3GQMZPU44PTCI2SXH5GG4WX7BATLBYKH5Z7AJRJHYA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.575548586 (81h50m57.273116902s) [noise=true , address=185.167.204.205:4024 , piece_id=VKGV2TYCJ47WMXBNSMXWJHBYYBFMZW33JLUML4LQFGGPHJQTNPOQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.606071949 (81h50m57.303640255s) [noise=true , address=185.167.204.205:4001 , piece_id=DSD2SAR27XEM4DPYGHSL54OGJSSMDOYFYJM6B2RUAGIOQBJR4KVA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.643767581 (81h50m57.341335897s) [noise=true , address=81.171.14.70:4039 , piece_id=A4BC4SKRRWBAQPUYHCBV6EE56N64XDVH5ANWV4SB7VNQN4LRHLZA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.699686567 (81h50m57.397254893s) [noise=true , address=89.149.201.147:4005 , piece_id=EFULPYYT2QAPNSA4IZMVUY5UXZMKU3ATJKOLRSGBSQF2ROGE5GVA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.900637587 (81h50m57.598205924s) [noise=true , address=81.171.14.70:4035 , piece_id=PSBL3OWA3WFVSR5HFIZHOUPC5PS2SUF4QA7PTLJRPWTE6JVTN3HA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.940878094 (81h50m57.63844649s) [noise=true , address=81.171.14.70:4048 , piece_id=7PBYGT5JPUN7TF4YFGTQW2HI6VARNQY6ML7J4HI6AVRI6OFU46TQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.961377601 (81h50m57.658945937s) [noise=true , address=185.167.204.205:4011 , piece_id=PV7EEHBLDN6NDTJLCLYTUD7SNRBAPG4FT2KNP73FQGOBMFWOWNLA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:10.037256686 (81h50m57.734825022s) [noise=true , address=81.171.14.70:4037 , piece_id=OD3XIAMG7E5H3MEQJZTAA26Y5UTBUJ24UVQ5IZFA2MVWMMOGSX5Q, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:10.053031477 (81h50m57.750599812s) [noise=true , address=81.171.14.70:4034 , piece_id=6J5SRCY2MIST65OBOOAYZPSBUB7FLDWWKHVBJHYMDFKJAQNKYU6Q, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:10.056428161 (81h50m57.753996477s) [noise=true , address=185.167.204.206:4054 , piece_id=UYM6Q64L7P65B7WMBZ3V5UEIEPXYSXBAH4CIXMJMSL6QIMJAMHUQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:10.180318280 (81h50m57.877886586s) [noise=true , address=81.171.14.70:4044 , piece_id=7FFBWCSV32VF5OSLCKK7UGATH5KUNG2WLKPKWOSDXI4V4PIIMNFQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:10.228417648 (81h50m57.925985974s) [noise=true , address=89.149.201.147:4014 , piece_id=PXDZZMWULFTMLDQJDHJ7YVO5ZED3RPZLRITHFW3BQXFEIPKL25LQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:10.532469801 (81h50m58.230038108s) [noise=true , address=185.167.204.206:4070 , piece_id=I6D47OABKPFO2QROLJPRUCYLE53TXPVGVKXIQDGJMILL2VDKZODA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:10.532496281 (81h50m58.230064597s) [seg_pos={0 0}, upload=71828]: Segment reached optimal threshold of 26 pieces. Dec 9 01:20:10.532650399 (81h50m58.230218715s) [noise=true , address=81.171.14.70:4040 , piece_id=F2WG2MNIZP5J36VDPE5JJF6NM7ABPYPFGWDDQO5PUTLE446RDOAA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV): protocol: expected piece hash; context canceled; EOF Dec 9 01:20:10.532657232 (81h50m58.230225538s) [noise=true , address=81.171.14.70:4040 , piece_id=F2WG2MNIZP5J36VDPE5JJF6NM7ABPYPFGWDDQO5PUTLE446RDOAA, seg_pos={0 0}, upload=71828]: Long tail cancellation due to optimal threshold Dec 9 01:20:10.532665908 (81h50m58.230234225s) [noise=true , address=89.149.201.147:4015 , piece_id=ZA66LVGKUDMPO3D6UZ3GPZFK2ADISEBOGWARZ5ICRWKVXCKQUBOA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K): protocol: expected piece hash; context canceled; EOF Dec 9 01:20:10.532669745 (81h50m58.230238061s) [noise=true , address=89.149.201.147:4015 , piece_id=ZA66LVGKUDMPO3D6UZ3GPZFK2ADISEBOGWARZ5ICRWKVXCKQUBOA, seg_pos={0 0}, upload=71828]: Long tail cancellation due to optimal threshold Dec 9 01:20:10.532681026 (81h50m58.230249342s) [seg_pos={0 0}, upload=71828]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:20:10.532740557 (81h50m58.230308873s) [upload=71828]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:20:10.532745767 (81h50m58.230314083s) [upload=71828]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:20:10.680757778 (81h50m58.378326094s) [upload=71828]: Done uploading segments... Dec 9 01:20:10.680771253 (81h50m58.378339559s) [upload=71828]: Upload finished. err: <nil> Duration: 7.712322758s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 16 out of 60 is failed (threshold=3) [..X...XX.....XX..X...X.....X.X.......X...X.....X.X.X...X...X] duration: 52.161831518s trace: https://jaeger.dev.storj.io/trace/42a7be80af97e50f FAIL (2025-12-09 01:21:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== .167.204.205:4011 , piece_id=PV7EEHBLDN6NDTJLCLYTUD7SNRBAPG4FT2KNP73FQGOBMFWOWNLA, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.381913079 (81h50m56.079481395s) [noise=true , address=81.171.14.70:4028 , piece_id=W4BQKTYF3BWUQ6U23JXCAOQIGUUNIBMSMMYG45IYRPHIG2ILGAMA, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.383672136 (81h50m56.081240452s) [noise=true , address=81.171.14.70:4033 , piece_id=DSCBZQEDCMJSX5VUBQI3SBQDTGVGYRNQNY2ST4VTV7ZEOFDMX7YA, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.384163643 (81h50m56.081731959s) [noise=true , address=81.171.14.70:4026 , piece_id=BN3UDLDI6LLCUQB42ODU4SGPNJFPEIQL6ITZS5BKQ7O2LHUJZF6A, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.385586612 (81h50m56.083154918s) [noise=true , address=81.171.14.70:4044 , piece_id=7FFBWCSV32VF5OSLCKK7UGATH5KUNG2WLKPKWOSDXI4V4PIIMNFQ, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.387023626 (81h50m56.084591932s) [noise=true , address=185.167.204.206:4070 , piece_id=I6D47OABKPFO2QROLJPRUCYLE53TXPVGVKXIQDGJMILL2VDKZODA, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.388500877 (81h50m56.086069193s) [noise=true , address=81.171.14.70:4048 , piece_id=7PBYGT5JPUN7TF4YFGTQW2HI6VARNQY6ML7J4HI6AVRI6OFU46TQ, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.389722008 (81h50m56.087290324s) [noise=true , address=185.167.204.206:4057 , piece_id=KN7WTE4NOZ3GQMZPU44PTCI2SXH5GG4WX7BATLBYKH5Z7AJRJHYA, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.390850687 (81h50m56.088418993s) [noise=true , address=89.149.201.147:4014 , piece_id=PXDZZMWULFTMLDQJDHJ7YVO5ZED3RPZLRITHFW3BQXFEIPKL25LQ, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.392092476 (81h50m56.089660782s) [noise=true , address=89.149.201.147:4022 , piece_id=VCQWMRSWBYESLNGJIYWOBTO5NOP6RBDRE2XGCAA5SEKR3WAHX4HQ, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.393539519 (81h50m56.091107835s) [noise=true , address=185.167.204.205:4001 , piece_id=DSD2SAR27XEM4DPYGHSL54OGJSSMDOYFYJM6B2RUAGIOQBJR4KVA, seg_pos={0 0}, upload=71828]: Uploading piece... Dec 9 01:20:08.895558647 (81h50m56.593126963s) [upload=71828]: Next returned nil segment Dec 9 01:20:08.895568566 (81h50m56.593136871s) [upload=71828]: Waiting for error group managing segments... Dec 9 01:20:09.103253778 (81h50m56.800822094s) [noise=true , address=185.167.204.205:4030 , piece_id=QHVKMOUH7VV2BYFBVIWCW647VTT34PWKEKC4WFZOLKEIFAQHI72Q, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.104813602 (81h50m56.802381908s) [noise=true , address=185.167.204.206:4049 , piece_id=EMCRK4EXOTGBI4DRPLVJUGW3G7ZK5ZDPFBTQWJJCF63GH62AQCTQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.110264585 (81h50m56.807832892s) [noise=true , address=185.167.204.206:4059 , piece_id=OD6YOWZQ4ETXGF4OTW5YVAFXUH7VDHY2RNXCXZMOJN7M42TUS5QQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.110726548 (81h50m56.808294854s) [noise=true , address=185.167.204.205:4015 , piece_id=4YJZX7RLIWNQREC22IHDXXAKBEK33AX4YB7VTRH5WRAAPJEPHFSQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.114824504 (81h50m56.81239282s) [noise=true , address=89.149.201.147:4022 , piece_id=VCQWMRSWBYESLNGJIYWOBTO5NOP6RBDRE2XGCAA5SEKR3WAHX4HQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.115702193 (81h50m56.8132705s) [noise=true , address=185.167.204.206:4041 , piece_id=3YNDFXCXB2XF2QVCTLCBY24ICIWYXW463J5FK3WC5NXZ577MY7ZQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.117899840 (81h50m56.815468145s) [noise=true , address=81.171.14.70:4028 , piece_id=W4BQKTYF3BWUQ6U23JXCAOQIGUUNIBMSMMYG45IYRPHIG2ILGAMA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.171330387 (81h50m56.868898693s) [noise=true , address=185.167.204.205:4003 , piece_id=BZWCDDA42DYXLI4L4NCKYPYX6QBNBWZXKAJ2LFYJB4TDXMUM57TQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.420331113 (81h50m57.117899429s) [noise=true , address=81.171.14.70:4033 , piece_id=DSCBZQEDCMJSX5VUBQI3SBQDTGVGYRNQNY2ST4VTV7ZEOFDMX7YA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.444798874 (81h50m57.14236719s) [noise=true , address=185.167.204.206:4061 , piece_id=BDZCEIA66CMQRH7T7BBZR6MKE5CRTFUD5Z5NTFXRTWUSCEV2TB2A, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.515893741 (81h50m57.213462058s) [noise=true , address=81.171.14.70:4026 , piece_id=BN3UDLDI6LLCUQB42ODU4SGPNJFPEIQL6ITZS5BKQ7O2LHUJZF6A, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.528672865 (81h50m57.226241181s) [noise=true , address=185.167.204.206:4043 , piece_id=OUYOIZ3OYD6IJODD6JAOX2BNWWTGGJPIL4FTOCOKDSHQHMM3RDZQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.564947412 (81h50m57.262515728s) [noise=true , address=185.167.204.206:4057 , piece_id=KN7WTE4NOZ3GQMZPU44PTCI2SXH5GG4WX7BATLBYKH5Z7AJRJHYA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.575548586 (81h50m57.273116902s) [noise=true , address=185.167.204.205:4024 , piece_id=VKGV2TYCJ47WMXBNSMXWJHBYYBFMZW33JLUML4LQFGGPHJQTNPOQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.606071949 (81h50m57.303640255s) [noise=true , address=185.167.204.205:4001 , piece_id=DSD2SAR27XEM4DPYGHSL54OGJSSMDOYFYJM6B2RUAGIOQBJR4KVA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.643767581 (81h50m57.341335897s) [noise=true , address=81.171.14.70:4039 , piece_id=A4BC4SKRRWBAQPUYHCBV6EE56N64XDVH5ANWV4SB7VNQN4LRHLZA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.699686567 (81h50m57.397254893s) [noise=true , address=89.149.201.147:4005 , piece_id=EFULPYYT2QAPNSA4IZMVUY5UXZMKU3ATJKOLRSGBSQF2ROGE5GVA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.900637587 (81h50m57.598205924s) [noise=true , address=81.171.14.70:4035 , piece_id=PSBL3OWA3WFVSR5HFIZHOUPC5PS2SUF4QA7PTLJRPWTE6JVTN3HA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.940878094 (81h50m57.63844649s) [noise=true , address=81.171.14.70:4048 , piece_id=7PBYGT5JPUN7TF4YFGTQW2HI6VARNQY6ML7J4HI6AVRI6OFU46TQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:09.961377601 (81h50m57.658945937s) [noise=true , address=185.167.204.205:4011 , piece_id=PV7EEHBLDN6NDTJLCLYTUD7SNRBAPG4FT2KNP73FQGOBMFWOWNLA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:10.037256686 (81h50m57.734825022s) [noise=true , address=81.171.14.70:4037 , piece_id=OD3XIAMG7E5H3MEQJZTAA26Y5UTBUJ24UVQ5IZFA2MVWMMOGSX5Q, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:10.053031477 (81h50m57.750599812s) [noise=true , address=81.171.14.70:4034 , piece_id=6J5SRCY2MIST65OBOOAYZPSBUB7FLDWWKHVBJHYMDFKJAQNKYU6Q, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:10.056428161 (81h50m57.753996477s) [noise=true , address=185.167.204.206:4054 , piece_id=UYM6Q64L7P65B7WMBZ3V5UEIEPXYSXBAH4CIXMJMSL6QIMJAMHUQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:10.180318280 (81h50m57.877886586s) [noise=true , address=81.171.14.70:4044 , piece_id=7FFBWCSV32VF5OSLCKK7UGATH5KUNG2WLKPKWOSDXI4V4PIIMNFQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:10.228417648 (81h50m57.925985974s) [noise=true , address=89.149.201.147:4014 , piece_id=PXDZZMWULFTMLDQJDHJ7YVO5ZED3RPZLRITHFW3BQXFEIPKL25LQ, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:10.532469801 (81h50m58.230038108s) [noise=true , address=185.167.204.206:4070 , piece_id=I6D47OABKPFO2QROLJPRUCYLE53TXPVGVKXIQDGJMILL2VDKZODA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: <nil> Dec 9 01:20:10.532496281 (81h50m58.230064597s) [seg_pos={0 0}, upload=71828]: Segment reached optimal threshold of 26 pieces. Dec 9 01:20:10.532650399 (81h50m58.230218715s) [noise=true , address=81.171.14.70:4040 , piece_id=F2WG2MNIZP5J36VDPE5JJF6NM7ABPYPFGWDDQO5PUTLE446RDOAA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV): protocol: expected piece hash; context canceled; EOF Dec 9 01:20:10.532657232 (81h50m58.230225538s) [noise=true , address=81.171.14.70:4040 , piece_id=F2WG2MNIZP5J36VDPE5JJF6NM7ABPYPFGWDDQO5PUTLE446RDOAA, seg_pos={0 0}, upload=71828]: Long tail cancellation due to optimal threshold Dec 9 01:20:10.532665908 (81h50m58.230234225s) [noise=true , address=89.149.201.147:4015 , piece_id=ZA66LVGKUDMPO3D6UZ3GPZFK2ADISEBOGWARZ5ICRWKVXCKQUBOA, seg_pos={0 0}, upload=71828]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K): protocol: expected piece hash; context canceled; EOF Dec 9 01:20:10.532669745 (81h50m58.230238061s) [noise=true , address=89.149.201.147:4015 , piece_id=ZA66LVGKUDMPO3D6UZ3GPZFK2ADISEBOGWARZ5ICRWKVXCKQUBOA, seg_pos={0 0}, upload=71828]: Long tail cancellation due to optimal threshold Dec 9 01:20:10.532681026 (81h50m58.230249342s) [seg_pos={0 0}, upload=71828]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 01:20:10.532740557 (81h50m58.230308873s) [upload=71828]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 01:20:10.532745767 (81h50m58.230314083s) [upload=71828]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 01:20:10.680757778 (81h50m58.378326094s) [upload=71828]: Done uploading segments... Dec 9 01:20:10.680771253 (81h50m58.378339559s) [upload=71828]: Upload finished. err: <nil> Duration: 52.161878396s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 433.253351ms trace: https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4 FAIL (2025-12-09 01:20:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload Dec 9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload Dec 9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments... Dec 9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false Dec 9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment... Dec 9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment. Dec 9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437 , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653 , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869 , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592 , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510 , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841 , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836 , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698 , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979 , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834 , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158 , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473 , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438 , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626 , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906 , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015 , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece... Dec 9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841 , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000 Dec 9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626 , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000 Dec 9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment Dec 9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments... Dec 9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979 , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836 , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438 , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015 , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906 , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437 , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158 , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869 , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510 , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473 , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834 , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653 , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil> Dec 9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592 , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF Dec 9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698 , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF Dec 9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments... Dec 9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 433.266215ms core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)