Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 110759 reports (Page 166 of 2216)
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
14 out of 60 is failed (threshold=3) [XX...X...X.........X........X...XX.....XX..X...X.....X.X....]
duration: 
4.322869047s
trace: 
https://jaeger.dev.storj.io/trace/73cbc41c8163da51
FAIL (2025-12-09 01:00:28 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=89.149.201.147:4019  , piece_id=44XAWC4PX6JDYDNQES7RFJOL44BKSMZL6JXD4VSNSJ63EFCU6IGA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.653731184 (81h27m19.35129949s) [noise=true , address=89.149.201.147:4020  , piece_id=6UT7ISSBNWIIRYDAJ7AFVXYNPNB2AJD36BWEX5UBM5ZUXYNZZBOA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.654018120 (81h27m19.351586436s) [noise=true , address=81.171.14.70:4047    , piece_id=Y3IFJKBSGE47TODR4FTRYSCQFPXYDAQK6PIPO4ARTIC7CLR56S4Q, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.654327128 (81h27m19.351895434s) [noise=true , address=185.167.204.205:4032 , piece_id=ZRKSY5TYZ47BN5NJD734DAXN544U6TDJJNSYDVU7KPHEF2BTJAMA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.654782739 (81h27m19.352351055s) [noise=true , address=185.167.204.205:4015 , piece_id=D5IU7DJK5QUUXDZSJST7LMPOTQ43LMPPRQ3P46VKORYA7QWHRB2Q, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.655140286 (81h27m19.352708602s) [noise=true , address=185.167.204.205:4035 , piece_id=EKHXDUJ6JUKWPGLRZI5QJGUBF4QQKJDBSKF64H7RNVS6Q3UXOSHA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.655534964 (81h27m19.35310328s) [noise=true , address=185.167.204.206:4066 , piece_id=KW6JXLGMA66TJ2X3BSQ53MYERCPKIBT76PPBVE3PFIUMUKIKPBIA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.655963444 (81h27m19.35353175s) [noise=true , address=89.149.201.147:4010  , piece_id=RKCPZSXPW6PL3CJZMOWMWWC6NRU3MRLZMUFX5ZPFHJI55U7ZIP7Q, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.656381366 (81h27m19.353949672s) [noise=true , address=185.167.204.205:4030 , piece_id=2WEVN7VFRXBRV277D5W5B42L3WDGYT2V4WSJTKSTMD3WBKFUUVNQ, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.656743802 (81h27m19.354312108s) [noise=true , address=89.149.201.147:4021  , piece_id=QXEVXQODAXU2YMITYDM7VYD2ZKM5CRLEOKN5VRBTOLRJ6ZIVEYXQ, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.657206457 (81h27m19.354774763s) [noise=true , address=89.149.201.147:4006  , piece_id=KGZQZGUW3HO7HT5R3NX4NSKZTSB7ND537INBKOGAKFQGRBNHJ3TA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:32.160763915 (81h27m19.858332231s) [upload=71490]: Next returned nil segment
Dec  9 00:56:32.160772261 (81h27m19.858340566s) [upload=71490]: Waiting for error group managing segments...
Dec  9 00:56:32.367091113 (81h27m20.06465945s) [noise=true , address=185.167.204.205:4013 , piece_id=NNBGYPP6DGVX3FC4DZMC43ZAMHFPSZMY7KGRRIIGLFKCM3SQHHPA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.382359607 (81h27m20.079927943s) [noise=true , address=185.167.204.205:4009 , piece_id=QAL7FK7ZORITTNCJT4MNNFNPKNBQ54DXRCH2J6X6E4OEYOMAG5AQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.401869895 (81h27m20.099438232s) [noise=true , address=89.149.201.147:4004  , piece_id=63FVBOL7WODTHOLQFC75CWPSUQCJWS7LODV5FBRH2SICL3K3XWCQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.406066094 (81h27m20.103634431s) [noise=true , address=89.149.201.147:4021  , piece_id=QXEVXQODAXU2YMITYDM7VYD2ZKM5CRLEOKN5VRBTOLRJ6ZIVEYXQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.411331421 (81h27m20.108899797s) [noise=true , address=185.167.204.205:4015 , piece_id=D5IU7DJK5QUUXDZSJST7LMPOTQ43LMPPRQ3P46VKORYA7QWHRB2Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.418812968 (81h27m20.116381303s) [noise=true , address=89.149.201.147:4005  , piece_id=BYT4SLGEUH2AKLMHKBZ6QSQVJKOY2RVWQJC56BRV62QEKTBWKFRA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.420572304 (81h27m20.118140651s) [noise=true , address=81.171.14.70:4047    , piece_id=Y3IFJKBSGE47TODR4FTRYSCQFPXYDAQK6PIPO4ARTIC7CLR56S4Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.527718158 (81h27m20.225286494s) [noise=true , address=81.171.14.70:4044    , piece_id=PKZTY4JWVBCHCUHLL5MXXVWQ5MWWMUWR7I6SVQNI7BTR27IDPRRQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.574245548 (81h27m20.271813885s) [noise=true , address=185.167.204.206:4066 , piece_id=KW6JXLGMA66TJ2X3BSQ53MYERCPKIBT76PPBVE3PFIUMUKIKPBIA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.811440733 (81h27m20.509009049s) [noise=true , address=89.149.201.147:4015  , piece_id=EYC7EULWHAVARKFIMAQEDCMWHPTUSJBDFCYJT4RVSLSLYA4LV2CA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.814580629 (81h27m20.512148934s) [noise=true , address=89.149.201.147:4006  , piece_id=KGZQZGUW3HO7HT5R3NX4NSKZTSB7ND537INBKOGAKFQGRBNHJ3TA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.842364613 (81h27m20.539932918s) [noise=true , address=89.149.201.147:4017  , piece_id=H4BUDJVTVHDT7KYBJCBYXVHSHW6XVUICOHPAWFDWUCAFDRSLGX3Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.873751909 (81h27m20.571320235s) [noise=true , address=89.149.201.147:4019  , piece_id=44XAWC4PX6JDYDNQES7RFJOL44BKSMZL6JXD4VSNSJ63EFCU6IGA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.887103492 (81h27m20.584671828s) [noise=true , address=81.171.14.70:4025    , piece_id=AHLEQXU6UBZR2AANMXY72UGDKKCNW5RTDGD7MMQO4W2MMHUPQLUA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.908520581 (81h27m20.606088898s) [noise=true , address=185.167.204.205:4026 , piece_id=2W4DN6TY7AJJWQXYWSS6YZIGN563IXIQ2RMYWG3XHEL47PC7CJYQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.952690147 (81h27m20.650258454s) [noise=true , address=185.167.204.206:4049 , piece_id=WJOGRXIB3TD7JRCE7EZA6Q2JYL3SVHWKCIGBQ7JPBXSUFEOK4I3A, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.008828632 (81h27m20.706396977s) [noise=true , address=81.171.14.70:4038    , piece_id=BACFOGLKUZOOCDGQJIYHQVCDTUOGFGNAEEDZK246ULZSNFIYEOMA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.103114172 (81h27m20.800682508s) [noise=true , address=185.167.204.206:4070 , piece_id=ELEURNR5CXP7624QVG2M2ZK7HHZM2GHQXL5CPYSA2ODQAOXE3NKA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.134718753 (81h27m20.832287079s) [noise=true , address=81.171.14.70:4045    , piece_id=JYLMRVFZJQQMYNJVJ2GFM3QABGZZIPZCGNO4JVKOUISUSF2ZGGZQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.208666869 (81h27m20.906235185s) [noise=true , address=89.149.201.147:4020  , piece_id=6UT7ISSBNWIIRYDAJ7AFVXYNPNB2AJD36BWEX5UBM5ZUXYNZZBOA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.502522334 (81h27m21.20009065s) [noise=true , address=81.171.14.70:4040    , piece_id=LS33AXEKVAVNEVBJZ4XVVNIVW54Y3GCPI3RY4QPA5JNLJ32PBS5Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.520716964 (81h27m21.2182853s) [noise=true , address=89.149.201.147:4010  , piece_id=RKCPZSXPW6PL3CJZMOWMWWC6NRU3MRLZMUFX5ZPFHJI55U7ZIP7Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.541974847 (81h27m21.239543173s) [noise=true , address=185.167.204.205:4035 , piece_id=EKHXDUJ6JUKWPGLRZI5QJGUBF4QQKJDBSKF64H7RNVS6Q3UXOSHA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.901468573 (81h27m21.599036879s) [noise=true , address=185.167.204.205:4030 , piece_id=2WEVN7VFRXBRV277D5W5B42L3WDGYT2V4WSJTKSTMD3WBKFUUVNQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.908515979 (81h27m21.606084295s) [noise=true , address=185.167.204.205:4032 , piece_id=ZRKSY5TYZ47BN5NJD734DAXN544U6TDJJNSYDVU7KPHEF2BTJAMA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:34.121817866 (81h27m21.819386183s) [noise=true , address=81.171.14.70:4048    , piece_id=7W4TKSAVVTAZTOWVSI4PMDF57WOARYODCQOOYDBMTEUBDK26FM5A, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:34.121835138 (81h27m21.819403454s) [seg_pos={0 0}, upload=71490]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:56:34.122000397 (81h27m21.819568713s) [noise=true , address=89.149.201.147:4007  , piece_id=O52IHBKR3GBNALB7E2OCMVZJ6A4CXVNEPUDUQANAF2VATGZ5U46Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF
Dec  9 00:56:34.122006168 (81h27m21.819574484s) [noise=true , address=89.149.201.147:4007  , piece_id=O52IHBKR3GBNALB7E2OCMVZJ6A4CXVNEPUDUQANAF2VATGZ5U46Q, seg_pos={0 0}, upload=71490]: Long tail cancellation due to optimal threshold
Dec  9 00:56:34.122138234 (81h27m21.81970655s) [noise=true , address=81.171.14.70:4046    , piece_id=Q27COUPBROIQC4IVWVO55AJLV7BKYZACQI57NIDFOYNWLV5NITJQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec  9 00:56:34.122166547 (81h27m21.819734864s) [noise=true , address=81.171.14.70:4046    , piece_id=Q27COUPBROIQC4IVWVO55AJLV7BKYZACQI57NIDFOYNWLV5NITJQ, seg_pos={0 0}, upload=71490]: Long tail cancellation due to optimal threshold
Dec  9 00:56:34.122190121 (81h27m21.819758438s) [seg_pos={0 0}, upload=71490]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:56:34.122256786 (81h27m21.819825102s) [upload=71490]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:56:34.122261705 (81h27m21.819830011s) [upload=71490]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:56:34.272548935 (81h27m21.970117241s) [upload=71490]: Done uploading segments...
Dec  9 00:56:34.272567188 (81h27m21.970135495s) [upload=71490]: Upload finished. err: <nil>
Duration: 4.322900576s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...................................X........................]
duration: 
481.970912ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 01:00:10 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 481.989948ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration: 
424.137149ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:59:40 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 424.157678ms core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
14 out of 60 is failed (threshold=3) [.XX...X...X.........X........X...XX.....XX..X...X.....X.X...]
duration: 
5.979452359s
trace: 
https://jaeger.dev.storj.io/trace/73cbc41c8163da51
FAIL (2025-12-09 00:59:18 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=89.149.201.147:4019  , piece_id=44XAWC4PX6JDYDNQES7RFJOL44BKSMZL6JXD4VSNSJ63EFCU6IGA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.653731184 (81h27m19.35129949s) [noise=true , address=89.149.201.147:4020  , piece_id=6UT7ISSBNWIIRYDAJ7AFVXYNPNB2AJD36BWEX5UBM5ZUXYNZZBOA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.654018120 (81h27m19.351586436s) [noise=true , address=81.171.14.70:4047    , piece_id=Y3IFJKBSGE47TODR4FTRYSCQFPXYDAQK6PIPO4ARTIC7CLR56S4Q, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.654327128 (81h27m19.351895434s) [noise=true , address=185.167.204.205:4032 , piece_id=ZRKSY5TYZ47BN5NJD734DAXN544U6TDJJNSYDVU7KPHEF2BTJAMA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.654782739 (81h27m19.352351055s) [noise=true , address=185.167.204.205:4015 , piece_id=D5IU7DJK5QUUXDZSJST7LMPOTQ43LMPPRQ3P46VKORYA7QWHRB2Q, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.655140286 (81h27m19.352708602s) [noise=true , address=185.167.204.205:4035 , piece_id=EKHXDUJ6JUKWPGLRZI5QJGUBF4QQKJDBSKF64H7RNVS6Q3UXOSHA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.655534964 (81h27m19.35310328s) [noise=true , address=185.167.204.206:4066 , piece_id=KW6JXLGMA66TJ2X3BSQ53MYERCPKIBT76PPBVE3PFIUMUKIKPBIA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.655963444 (81h27m19.35353175s) [noise=true , address=89.149.201.147:4010  , piece_id=RKCPZSXPW6PL3CJZMOWMWWC6NRU3MRLZMUFX5ZPFHJI55U7ZIP7Q, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.656381366 (81h27m19.353949672s) [noise=true , address=185.167.204.205:4030 , piece_id=2WEVN7VFRXBRV277D5W5B42L3WDGYT2V4WSJTKSTMD3WBKFUUVNQ, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.656743802 (81h27m19.354312108s) [noise=true , address=89.149.201.147:4021  , piece_id=QXEVXQODAXU2YMITYDM7VYD2ZKM5CRLEOKN5VRBTOLRJ6ZIVEYXQ, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.657206457 (81h27m19.354774763s) [noise=true , address=89.149.201.147:4006  , piece_id=KGZQZGUW3HO7HT5R3NX4NSKZTSB7ND537INBKOGAKFQGRBNHJ3TA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:32.160763915 (81h27m19.858332231s) [upload=71490]: Next returned nil segment
Dec  9 00:56:32.160772261 (81h27m19.858340566s) [upload=71490]: Waiting for error group managing segments...
Dec  9 00:56:32.367091113 (81h27m20.06465945s) [noise=true , address=185.167.204.205:4013 , piece_id=NNBGYPP6DGVX3FC4DZMC43ZAMHFPSZMY7KGRRIIGLFKCM3SQHHPA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.382359607 (81h27m20.079927943s) [noise=true , address=185.167.204.205:4009 , piece_id=QAL7FK7ZORITTNCJT4MNNFNPKNBQ54DXRCH2J6X6E4OEYOMAG5AQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.401869895 (81h27m20.099438232s) [noise=true , address=89.149.201.147:4004  , piece_id=63FVBOL7WODTHOLQFC75CWPSUQCJWS7LODV5FBRH2SICL3K3XWCQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.406066094 (81h27m20.103634431s) [noise=true , address=89.149.201.147:4021  , piece_id=QXEVXQODAXU2YMITYDM7VYD2ZKM5CRLEOKN5VRBTOLRJ6ZIVEYXQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.411331421 (81h27m20.108899797s) [noise=true , address=185.167.204.205:4015 , piece_id=D5IU7DJK5QUUXDZSJST7LMPOTQ43LMPPRQ3P46VKORYA7QWHRB2Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.418812968 (81h27m20.116381303s) [noise=true , address=89.149.201.147:4005  , piece_id=BYT4SLGEUH2AKLMHKBZ6QSQVJKOY2RVWQJC56BRV62QEKTBWKFRA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.420572304 (81h27m20.118140651s) [noise=true , address=81.171.14.70:4047    , piece_id=Y3IFJKBSGE47TODR4FTRYSCQFPXYDAQK6PIPO4ARTIC7CLR56S4Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.527718158 (81h27m20.225286494s) [noise=true , address=81.171.14.70:4044    , piece_id=PKZTY4JWVBCHCUHLL5MXXVWQ5MWWMUWR7I6SVQNI7BTR27IDPRRQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.574245548 (81h27m20.271813885s) [noise=true , address=185.167.204.206:4066 , piece_id=KW6JXLGMA66TJ2X3BSQ53MYERCPKIBT76PPBVE3PFIUMUKIKPBIA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.811440733 (81h27m20.509009049s) [noise=true , address=89.149.201.147:4015  , piece_id=EYC7EULWHAVARKFIMAQEDCMWHPTUSJBDFCYJT4RVSLSLYA4LV2CA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.814580629 (81h27m20.512148934s) [noise=true , address=89.149.201.147:4006  , piece_id=KGZQZGUW3HO7HT5R3NX4NSKZTSB7ND537INBKOGAKFQGRBNHJ3TA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.842364613 (81h27m20.539932918s) [noise=true , address=89.149.201.147:4017  , piece_id=H4BUDJVTVHDT7KYBJCBYXVHSHW6XVUICOHPAWFDWUCAFDRSLGX3Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.873751909 (81h27m20.571320235s) [noise=true , address=89.149.201.147:4019  , piece_id=44XAWC4PX6JDYDNQES7RFJOL44BKSMZL6JXD4VSNSJ63EFCU6IGA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.887103492 (81h27m20.584671828s) [noise=true , address=81.171.14.70:4025    , piece_id=AHLEQXU6UBZR2AANMXY72UGDKKCNW5RTDGD7MMQO4W2MMHUPQLUA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.908520581 (81h27m20.606088898s) [noise=true , address=185.167.204.205:4026 , piece_id=2W4DN6TY7AJJWQXYWSS6YZIGN563IXIQ2RMYWG3XHEL47PC7CJYQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.952690147 (81h27m20.650258454s) [noise=true , address=185.167.204.206:4049 , piece_id=WJOGRXIB3TD7JRCE7EZA6Q2JYL3SVHWKCIGBQ7JPBXSUFEOK4I3A, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.008828632 (81h27m20.706396977s) [noise=true , address=81.171.14.70:4038    , piece_id=BACFOGLKUZOOCDGQJIYHQVCDTUOGFGNAEEDZK246ULZSNFIYEOMA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.103114172 (81h27m20.800682508s) [noise=true , address=185.167.204.206:4070 , piece_id=ELEURNR5CXP7624QVG2M2ZK7HHZM2GHQXL5CPYSA2ODQAOXE3NKA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.134718753 (81h27m20.832287079s) [noise=true , address=81.171.14.70:4045    , piece_id=JYLMRVFZJQQMYNJVJ2GFM3QABGZZIPZCGNO4JVKOUISUSF2ZGGZQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.208666869 (81h27m20.906235185s) [noise=true , address=89.149.201.147:4020  , piece_id=6UT7ISSBNWIIRYDAJ7AFVXYNPNB2AJD36BWEX5UBM5ZUXYNZZBOA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.502522334 (81h27m21.20009065s) [noise=true , address=81.171.14.70:4040    , piece_id=LS33AXEKVAVNEVBJZ4XVVNIVW54Y3GCPI3RY4QPA5JNLJ32PBS5Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.520716964 (81h27m21.2182853s) [noise=true , address=89.149.201.147:4010  , piece_id=RKCPZSXPW6PL3CJZMOWMWWC6NRU3MRLZMUFX5ZPFHJI55U7ZIP7Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.541974847 (81h27m21.239543173s) [noise=true , address=185.167.204.205:4035 , piece_id=EKHXDUJ6JUKWPGLRZI5QJGUBF4QQKJDBSKF64H7RNVS6Q3UXOSHA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.901468573 (81h27m21.599036879s) [noise=true , address=185.167.204.205:4030 , piece_id=2WEVN7VFRXBRV277D5W5B42L3WDGYT2V4WSJTKSTMD3WBKFUUVNQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.908515979 (81h27m21.606084295s) [noise=true , address=185.167.204.205:4032 , piece_id=ZRKSY5TYZ47BN5NJD734DAXN544U6TDJJNSYDVU7KPHEF2BTJAMA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:34.121817866 (81h27m21.819386183s) [noise=true , address=81.171.14.70:4048    , piece_id=7W4TKSAVVTAZTOWVSI4PMDF57WOARYODCQOOYDBMTEUBDK26FM5A, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:34.121835138 (81h27m21.819403454s) [seg_pos={0 0}, upload=71490]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:56:34.122000397 (81h27m21.819568713s) [noise=true , address=89.149.201.147:4007  , piece_id=O52IHBKR3GBNALB7E2OCMVZJ6A4CXVNEPUDUQANAF2VATGZ5U46Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF
Dec  9 00:56:34.122006168 (81h27m21.819574484s) [noise=true , address=89.149.201.147:4007  , piece_id=O52IHBKR3GBNALB7E2OCMVZJ6A4CXVNEPUDUQANAF2VATGZ5U46Q, seg_pos={0 0}, upload=71490]: Long tail cancellation due to optimal threshold
Dec  9 00:56:34.122138234 (81h27m21.81970655s) [noise=true , address=81.171.14.70:4046    , piece_id=Q27COUPBROIQC4IVWVO55AJLV7BKYZACQI57NIDFOYNWLV5NITJQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec  9 00:56:34.122166547 (81h27m21.819734864s) [noise=true , address=81.171.14.70:4046    , piece_id=Q27COUPBROIQC4IVWVO55AJLV7BKYZACQI57NIDFOYNWLV5NITJQ, seg_pos={0 0}, upload=71490]: Long tail cancellation due to optimal threshold
Dec  9 00:56:34.122190121 (81h27m21.819758438s) [seg_pos={0 0}, upload=71490]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:56:34.122256786 (81h27m21.819825102s) [upload=71490]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:56:34.122261705 (81h27m21.819830011s) [upload=71490]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:56:34.272548935 (81h27m21.970117241s) [upload=71490]: Done uploading segments...
Dec  9 00:56:34.272567188 (81h27m21.970135495s) [upload=71490]: Upload finished. err: <nil>
Duration: 5.979470181s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration: 
513.441073ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:58:47 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 513.458315ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [......................................X.....................]
duration: 
450.918712ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:58:25 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 450.935313ms core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
14 out of 60 is failed (threshold=3) [..XX...X...X.........X........X...XX.....XX..X...X.....X.X..]
duration: 
19.799516069s
trace: 
https://jaeger.dev.storj.io/trace/73cbc41c8163da51
FAIL (2025-12-09 00:58:20 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=89.149.201.147:4019  , piece_id=44XAWC4PX6JDYDNQES7RFJOL44BKSMZL6JXD4VSNSJ63EFCU6IGA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.653731184 (81h27m19.35129949s) [noise=true , address=89.149.201.147:4020  , piece_id=6UT7ISSBNWIIRYDAJ7AFVXYNPNB2AJD36BWEX5UBM5ZUXYNZZBOA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.654018120 (81h27m19.351586436s) [noise=true , address=81.171.14.70:4047    , piece_id=Y3IFJKBSGE47TODR4FTRYSCQFPXYDAQK6PIPO4ARTIC7CLR56S4Q, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.654327128 (81h27m19.351895434s) [noise=true , address=185.167.204.205:4032 , piece_id=ZRKSY5TYZ47BN5NJD734DAXN544U6TDJJNSYDVU7KPHEF2BTJAMA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.654782739 (81h27m19.352351055s) [noise=true , address=185.167.204.205:4015 , piece_id=D5IU7DJK5QUUXDZSJST7LMPOTQ43LMPPRQ3P46VKORYA7QWHRB2Q, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.655140286 (81h27m19.352708602s) [noise=true , address=185.167.204.205:4035 , piece_id=EKHXDUJ6JUKWPGLRZI5QJGUBF4QQKJDBSKF64H7RNVS6Q3UXOSHA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.655534964 (81h27m19.35310328s) [noise=true , address=185.167.204.206:4066 , piece_id=KW6JXLGMA66TJ2X3BSQ53MYERCPKIBT76PPBVE3PFIUMUKIKPBIA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.655963444 (81h27m19.35353175s) [noise=true , address=89.149.201.147:4010  , piece_id=RKCPZSXPW6PL3CJZMOWMWWC6NRU3MRLZMUFX5ZPFHJI55U7ZIP7Q, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.656381366 (81h27m19.353949672s) [noise=true , address=185.167.204.205:4030 , piece_id=2WEVN7VFRXBRV277D5W5B42L3WDGYT2V4WSJTKSTMD3WBKFUUVNQ, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.656743802 (81h27m19.354312108s) [noise=true , address=89.149.201.147:4021  , piece_id=QXEVXQODAXU2YMITYDM7VYD2ZKM5CRLEOKN5VRBTOLRJ6ZIVEYXQ, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.657206457 (81h27m19.354774763s) [noise=true , address=89.149.201.147:4006  , piece_id=KGZQZGUW3HO7HT5R3NX4NSKZTSB7ND537INBKOGAKFQGRBNHJ3TA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:32.160763915 (81h27m19.858332231s) [upload=71490]: Next returned nil segment
Dec  9 00:56:32.160772261 (81h27m19.858340566s) [upload=71490]: Waiting for error group managing segments...
Dec  9 00:56:32.367091113 (81h27m20.06465945s) [noise=true , address=185.167.204.205:4013 , piece_id=NNBGYPP6DGVX3FC4DZMC43ZAMHFPSZMY7KGRRIIGLFKCM3SQHHPA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.382359607 (81h27m20.079927943s) [noise=true , address=185.167.204.205:4009 , piece_id=QAL7FK7ZORITTNCJT4MNNFNPKNBQ54DXRCH2J6X6E4OEYOMAG5AQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.401869895 (81h27m20.099438232s) [noise=true , address=89.149.201.147:4004  , piece_id=63FVBOL7WODTHOLQFC75CWPSUQCJWS7LODV5FBRH2SICL3K3XWCQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.406066094 (81h27m20.103634431s) [noise=true , address=89.149.201.147:4021  , piece_id=QXEVXQODAXU2YMITYDM7VYD2ZKM5CRLEOKN5VRBTOLRJ6ZIVEYXQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.411331421 (81h27m20.108899797s) [noise=true , address=185.167.204.205:4015 , piece_id=D5IU7DJK5QUUXDZSJST7LMPOTQ43LMPPRQ3P46VKORYA7QWHRB2Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.418812968 (81h27m20.116381303s) [noise=true , address=89.149.201.147:4005  , piece_id=BYT4SLGEUH2AKLMHKBZ6QSQVJKOY2RVWQJC56BRV62QEKTBWKFRA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.420572304 (81h27m20.118140651s) [noise=true , address=81.171.14.70:4047    , piece_id=Y3IFJKBSGE47TODR4FTRYSCQFPXYDAQK6PIPO4ARTIC7CLR56S4Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.527718158 (81h27m20.225286494s) [noise=true , address=81.171.14.70:4044    , piece_id=PKZTY4JWVBCHCUHLL5MXXVWQ5MWWMUWR7I6SVQNI7BTR27IDPRRQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.574245548 (81h27m20.271813885s) [noise=true , address=185.167.204.206:4066 , piece_id=KW6JXLGMA66TJ2X3BSQ53MYERCPKIBT76PPBVE3PFIUMUKIKPBIA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.811440733 (81h27m20.509009049s) [noise=true , address=89.149.201.147:4015  , piece_id=EYC7EULWHAVARKFIMAQEDCMWHPTUSJBDFCYJT4RVSLSLYA4LV2CA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.814580629 (81h27m20.512148934s) [noise=true , address=89.149.201.147:4006  , piece_id=KGZQZGUW3HO7HT5R3NX4NSKZTSB7ND537INBKOGAKFQGRBNHJ3TA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.842364613 (81h27m20.539932918s) [noise=true , address=89.149.201.147:4017  , piece_id=H4BUDJVTVHDT7KYBJCBYXVHSHW6XVUICOHPAWFDWUCAFDRSLGX3Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.873751909 (81h27m20.571320235s) [noise=true , address=89.149.201.147:4019  , piece_id=44XAWC4PX6JDYDNQES7RFJOL44BKSMZL6JXD4VSNSJ63EFCU6IGA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.887103492 (81h27m20.584671828s) [noise=true , address=81.171.14.70:4025    , piece_id=AHLEQXU6UBZR2AANMXY72UGDKKCNW5RTDGD7MMQO4W2MMHUPQLUA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.908520581 (81h27m20.606088898s) [noise=true , address=185.167.204.205:4026 , piece_id=2W4DN6TY7AJJWQXYWSS6YZIGN563IXIQ2RMYWG3XHEL47PC7CJYQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.952690147 (81h27m20.650258454s) [noise=true , address=185.167.204.206:4049 , piece_id=WJOGRXIB3TD7JRCE7EZA6Q2JYL3SVHWKCIGBQ7JPBXSUFEOK4I3A, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.008828632 (81h27m20.706396977s) [noise=true , address=81.171.14.70:4038    , piece_id=BACFOGLKUZOOCDGQJIYHQVCDTUOGFGNAEEDZK246ULZSNFIYEOMA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.103114172 (81h27m20.800682508s) [noise=true , address=185.167.204.206:4070 , piece_id=ELEURNR5CXP7624QVG2M2ZK7HHZM2GHQXL5CPYSA2ODQAOXE3NKA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.134718753 (81h27m20.832287079s) [noise=true , address=81.171.14.70:4045    , piece_id=JYLMRVFZJQQMYNJVJ2GFM3QABGZZIPZCGNO4JVKOUISUSF2ZGGZQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.208666869 (81h27m20.906235185s) [noise=true , address=89.149.201.147:4020  , piece_id=6UT7ISSBNWIIRYDAJ7AFVXYNPNB2AJD36BWEX5UBM5ZUXYNZZBOA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.502522334 (81h27m21.20009065s) [noise=true , address=81.171.14.70:4040    , piece_id=LS33AXEKVAVNEVBJZ4XVVNIVW54Y3GCPI3RY4QPA5JNLJ32PBS5Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.520716964 (81h27m21.2182853s) [noise=true , address=89.149.201.147:4010  , piece_id=RKCPZSXPW6PL3CJZMOWMWWC6NRU3MRLZMUFX5ZPFHJI55U7ZIP7Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.541974847 (81h27m21.239543173s) [noise=true , address=185.167.204.205:4035 , piece_id=EKHXDUJ6JUKWPGLRZI5QJGUBF4QQKJDBSKF64H7RNVS6Q3UXOSHA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.901468573 (81h27m21.599036879s) [noise=true , address=185.167.204.205:4030 , piece_id=2WEVN7VFRXBRV277D5W5B42L3WDGYT2V4WSJTKSTMD3WBKFUUVNQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.908515979 (81h27m21.606084295s) [noise=true , address=185.167.204.205:4032 , piece_id=ZRKSY5TYZ47BN5NJD734DAXN544U6TDJJNSYDVU7KPHEF2BTJAMA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:34.121817866 (81h27m21.819386183s) [noise=true , address=81.171.14.70:4048    , piece_id=7W4TKSAVVTAZTOWVSI4PMDF57WOARYODCQOOYDBMTEUBDK26FM5A, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:34.121835138 (81h27m21.819403454s) [seg_pos={0 0}, upload=71490]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:56:34.122000397 (81h27m21.819568713s) [noise=true , address=89.149.201.147:4007  , piece_id=O52IHBKR3GBNALB7E2OCMVZJ6A4CXVNEPUDUQANAF2VATGZ5U46Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF
Dec  9 00:56:34.122006168 (81h27m21.819574484s) [noise=true , address=89.149.201.147:4007  , piece_id=O52IHBKR3GBNALB7E2OCMVZJ6A4CXVNEPUDUQANAF2VATGZ5U46Q, seg_pos={0 0}, upload=71490]: Long tail cancellation due to optimal threshold
Dec  9 00:56:34.122138234 (81h27m21.81970655s) [noise=true , address=81.171.14.70:4046    , piece_id=Q27COUPBROIQC4IVWVO55AJLV7BKYZACQI57NIDFOYNWLV5NITJQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec  9 00:56:34.122166547 (81h27m21.819734864s) [noise=true , address=81.171.14.70:4046    , piece_id=Q27COUPBROIQC4IVWVO55AJLV7BKYZACQI57NIDFOYNWLV5NITJQ, seg_pos={0 0}, upload=71490]: Long tail cancellation due to optimal threshold
Dec  9 00:56:34.122190121 (81h27m21.819758438s) [seg_pos={0 0}, upload=71490]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:56:34.122256786 (81h27m21.819825102s) [upload=71490]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:56:34.122261705 (81h27m21.819830011s) [upload=71490]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:56:34.272548935 (81h27m21.970117241s) [upload=71490]: Done uploading segments...
Dec  9 00:56:34.272567188 (81h27m21.970135495s) [upload=71490]: Upload finished. err: <nil>
Duration: 19.799537529s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.......................................X....................]
duration: 
489.494497ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:57:52 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 489.516659ms core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
15 out of 60 is failed (threshold=3) [X..XX...X...X.........X........X...XX.....XX..X...X.....X.X.]
duration: 
7.127166385s
trace: 
https://jaeger.dev.storj.io/trace/73cbc41c8163da51
FAIL (2025-12-09 00:57:47 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=89.149.201.147:4019  , piece_id=44XAWC4PX6JDYDNQES7RFJOL44BKSMZL6JXD4VSNSJ63EFCU6IGA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.653731184 (81h27m19.35129949s) [noise=true , address=89.149.201.147:4020  , piece_id=6UT7ISSBNWIIRYDAJ7AFVXYNPNB2AJD36BWEX5UBM5ZUXYNZZBOA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.654018120 (81h27m19.351586436s) [noise=true , address=81.171.14.70:4047    , piece_id=Y3IFJKBSGE47TODR4FTRYSCQFPXYDAQK6PIPO4ARTIC7CLR56S4Q, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.654327128 (81h27m19.351895434s) [noise=true , address=185.167.204.205:4032 , piece_id=ZRKSY5TYZ47BN5NJD734DAXN544U6TDJJNSYDVU7KPHEF2BTJAMA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.654782739 (81h27m19.352351055s) [noise=true , address=185.167.204.205:4015 , piece_id=D5IU7DJK5QUUXDZSJST7LMPOTQ43LMPPRQ3P46VKORYA7QWHRB2Q, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.655140286 (81h27m19.352708602s) [noise=true , address=185.167.204.205:4035 , piece_id=EKHXDUJ6JUKWPGLRZI5QJGUBF4QQKJDBSKF64H7RNVS6Q3UXOSHA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.655534964 (81h27m19.35310328s) [noise=true , address=185.167.204.206:4066 , piece_id=KW6JXLGMA66TJ2X3BSQ53MYERCPKIBT76PPBVE3PFIUMUKIKPBIA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.655963444 (81h27m19.35353175s) [noise=true , address=89.149.201.147:4010  , piece_id=RKCPZSXPW6PL3CJZMOWMWWC6NRU3MRLZMUFX5ZPFHJI55U7ZIP7Q, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.656381366 (81h27m19.353949672s) [noise=true , address=185.167.204.205:4030 , piece_id=2WEVN7VFRXBRV277D5W5B42L3WDGYT2V4WSJTKSTMD3WBKFUUVNQ, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.656743802 (81h27m19.354312108s) [noise=true , address=89.149.201.147:4021  , piece_id=QXEVXQODAXU2YMITYDM7VYD2ZKM5CRLEOKN5VRBTOLRJ6ZIVEYXQ, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.657206457 (81h27m19.354774763s) [noise=true , address=89.149.201.147:4006  , piece_id=KGZQZGUW3HO7HT5R3NX4NSKZTSB7ND537INBKOGAKFQGRBNHJ3TA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:32.160763915 (81h27m19.858332231s) [upload=71490]: Next returned nil segment
Dec  9 00:56:32.160772261 (81h27m19.858340566s) [upload=71490]: Waiting for error group managing segments...
Dec  9 00:56:32.367091113 (81h27m20.06465945s) [noise=true , address=185.167.204.205:4013 , piece_id=NNBGYPP6DGVX3FC4DZMC43ZAMHFPSZMY7KGRRIIGLFKCM3SQHHPA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.382359607 (81h27m20.079927943s) [noise=true , address=185.167.204.205:4009 , piece_id=QAL7FK7ZORITTNCJT4MNNFNPKNBQ54DXRCH2J6X6E4OEYOMAG5AQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.401869895 (81h27m20.099438232s) [noise=true , address=89.149.201.147:4004  , piece_id=63FVBOL7WODTHOLQFC75CWPSUQCJWS7LODV5FBRH2SICL3K3XWCQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.406066094 (81h27m20.103634431s) [noise=true , address=89.149.201.147:4021  , piece_id=QXEVXQODAXU2YMITYDM7VYD2ZKM5CRLEOKN5VRBTOLRJ6ZIVEYXQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.411331421 (81h27m20.108899797s) [noise=true , address=185.167.204.205:4015 , piece_id=D5IU7DJK5QUUXDZSJST7LMPOTQ43LMPPRQ3P46VKORYA7QWHRB2Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.418812968 (81h27m20.116381303s) [noise=true , address=89.149.201.147:4005  , piece_id=BYT4SLGEUH2AKLMHKBZ6QSQVJKOY2RVWQJC56BRV62QEKTBWKFRA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.420572304 (81h27m20.118140651s) [noise=true , address=81.171.14.70:4047    , piece_id=Y3IFJKBSGE47TODR4FTRYSCQFPXYDAQK6PIPO4ARTIC7CLR56S4Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.527718158 (81h27m20.225286494s) [noise=true , address=81.171.14.70:4044    , piece_id=PKZTY4JWVBCHCUHLL5MXXVWQ5MWWMUWR7I6SVQNI7BTR27IDPRRQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.574245548 (81h27m20.271813885s) [noise=true , address=185.167.204.206:4066 , piece_id=KW6JXLGMA66TJ2X3BSQ53MYERCPKIBT76PPBVE3PFIUMUKIKPBIA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.811440733 (81h27m20.509009049s) [noise=true , address=89.149.201.147:4015  , piece_id=EYC7EULWHAVARKFIMAQEDCMWHPTUSJBDFCYJT4RVSLSLYA4LV2CA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.814580629 (81h27m20.512148934s) [noise=true , address=89.149.201.147:4006  , piece_id=KGZQZGUW3HO7HT5R3NX4NSKZTSB7ND537INBKOGAKFQGRBNHJ3TA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.842364613 (81h27m20.539932918s) [noise=true , address=89.149.201.147:4017  , piece_id=H4BUDJVTVHDT7KYBJCBYXVHSHW6XVUICOHPAWFDWUCAFDRSLGX3Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.873751909 (81h27m20.571320235s) [noise=true , address=89.149.201.147:4019  , piece_id=44XAWC4PX6JDYDNQES7RFJOL44BKSMZL6JXD4VSNSJ63EFCU6IGA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.887103492 (81h27m20.584671828s) [noise=true , address=81.171.14.70:4025    , piece_id=AHLEQXU6UBZR2AANMXY72UGDKKCNW5RTDGD7MMQO4W2MMHUPQLUA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.908520581 (81h27m20.606088898s) [noise=true , address=185.167.204.205:4026 , piece_id=2W4DN6TY7AJJWQXYWSS6YZIGN563IXIQ2RMYWG3XHEL47PC7CJYQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.952690147 (81h27m20.650258454s) [noise=true , address=185.167.204.206:4049 , piece_id=WJOGRXIB3TD7JRCE7EZA6Q2JYL3SVHWKCIGBQ7JPBXSUFEOK4I3A, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.008828632 (81h27m20.706396977s) [noise=true , address=81.171.14.70:4038    , piece_id=BACFOGLKUZOOCDGQJIYHQVCDTUOGFGNAEEDZK246ULZSNFIYEOMA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.103114172 (81h27m20.800682508s) [noise=true , address=185.167.204.206:4070 , piece_id=ELEURNR5CXP7624QVG2M2ZK7HHZM2GHQXL5CPYSA2ODQAOXE3NKA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.134718753 (81h27m20.832287079s) [noise=true , address=81.171.14.70:4045    , piece_id=JYLMRVFZJQQMYNJVJ2GFM3QABGZZIPZCGNO4JVKOUISUSF2ZGGZQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.208666869 (81h27m20.906235185s) [noise=true , address=89.149.201.147:4020  , piece_id=6UT7ISSBNWIIRYDAJ7AFVXYNPNB2AJD36BWEX5UBM5ZUXYNZZBOA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.502522334 (81h27m21.20009065s) [noise=true , address=81.171.14.70:4040    , piece_id=LS33AXEKVAVNEVBJZ4XVVNIVW54Y3GCPI3RY4QPA5JNLJ32PBS5Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.520716964 (81h27m21.2182853s) [noise=true , address=89.149.201.147:4010  , piece_id=RKCPZSXPW6PL3CJZMOWMWWC6NRU3MRLZMUFX5ZPFHJI55U7ZIP7Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.541974847 (81h27m21.239543173s) [noise=true , address=185.167.204.205:4035 , piece_id=EKHXDUJ6JUKWPGLRZI5QJGUBF4QQKJDBSKF64H7RNVS6Q3UXOSHA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.901468573 (81h27m21.599036879s) [noise=true , address=185.167.204.205:4030 , piece_id=2WEVN7VFRXBRV277D5W5B42L3WDGYT2V4WSJTKSTMD3WBKFUUVNQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.908515979 (81h27m21.606084295s) [noise=true , address=185.167.204.205:4032 , piece_id=ZRKSY5TYZ47BN5NJD734DAXN544U6TDJJNSYDVU7KPHEF2BTJAMA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:34.121817866 (81h27m21.819386183s) [noise=true , address=81.171.14.70:4048    , piece_id=7W4TKSAVVTAZTOWVSI4PMDF57WOARYODCQOOYDBMTEUBDK26FM5A, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:34.121835138 (81h27m21.819403454s) [seg_pos={0 0}, upload=71490]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:56:34.122000397 (81h27m21.819568713s) [noise=true , address=89.149.201.147:4007  , piece_id=O52IHBKR3GBNALB7E2OCMVZJ6A4CXVNEPUDUQANAF2VATGZ5U46Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF
Dec  9 00:56:34.122006168 (81h27m21.819574484s) [noise=true , address=89.149.201.147:4007  , piece_id=O52IHBKR3GBNALB7E2OCMVZJ6A4CXVNEPUDUQANAF2VATGZ5U46Q, seg_pos={0 0}, upload=71490]: Long tail cancellation due to optimal threshold
Dec  9 00:56:34.122138234 (81h27m21.81970655s) [noise=true , address=81.171.14.70:4046    , piece_id=Q27COUPBROIQC4IVWVO55AJLV7BKYZACQI57NIDFOYNWLV5NITJQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec  9 00:56:34.122166547 (81h27m21.819734864s) [noise=true , address=81.171.14.70:4046    , piece_id=Q27COUPBROIQC4IVWVO55AJLV7BKYZACQI57NIDFOYNWLV5NITJQ, seg_pos={0 0}, upload=71490]: Long tail cancellation due to optimal threshold
Dec  9 00:56:34.122190121 (81h27m21.819758438s) [seg_pos={0 0}, upload=71490]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:56:34.122256786 (81h27m21.819825102s) [upload=71490]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:56:34.122261705 (81h27m21.819830011s) [upload=71490]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:56:34.272548935 (81h27m21.970117241s) [upload=71490]: Done uploading segments...
Dec  9 00:56:34.272567188 (81h27m21.970135495s) [upload=71490]: Upload finished. err: <nil>
Duration: 7.127181604s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
15 out of 60 is failed (threshold=3) [.X..XX...X...X.........X........X...XX.....XX..X...X.....X.X]
duration: 
1m0.003133152s
trace: 
https://jaeger.dev.storj.io/trace/73cbc41c8163da51
FAIL (2025-12-09 00:57:31 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
=89.149.201.147:4019  , piece_id=44XAWC4PX6JDYDNQES7RFJOL44BKSMZL6JXD4VSNSJ63EFCU6IGA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.653731184 (81h27m19.35129949s) [noise=true , address=89.149.201.147:4020  , piece_id=6UT7ISSBNWIIRYDAJ7AFVXYNPNB2AJD36BWEX5UBM5ZUXYNZZBOA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.654018120 (81h27m19.351586436s) [noise=true , address=81.171.14.70:4047    , piece_id=Y3IFJKBSGE47TODR4FTRYSCQFPXYDAQK6PIPO4ARTIC7CLR56S4Q, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.654327128 (81h27m19.351895434s) [noise=true , address=185.167.204.205:4032 , piece_id=ZRKSY5TYZ47BN5NJD734DAXN544U6TDJJNSYDVU7KPHEF2BTJAMA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.654782739 (81h27m19.352351055s) [noise=true , address=185.167.204.205:4015 , piece_id=D5IU7DJK5QUUXDZSJST7LMPOTQ43LMPPRQ3P46VKORYA7QWHRB2Q, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.655140286 (81h27m19.352708602s) [noise=true , address=185.167.204.205:4035 , piece_id=EKHXDUJ6JUKWPGLRZI5QJGUBF4QQKJDBSKF64H7RNVS6Q3UXOSHA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.655534964 (81h27m19.35310328s) [noise=true , address=185.167.204.206:4066 , piece_id=KW6JXLGMA66TJ2X3BSQ53MYERCPKIBT76PPBVE3PFIUMUKIKPBIA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.655963444 (81h27m19.35353175s) [noise=true , address=89.149.201.147:4010  , piece_id=RKCPZSXPW6PL3CJZMOWMWWC6NRU3MRLZMUFX5ZPFHJI55U7ZIP7Q, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.656381366 (81h27m19.353949672s) [noise=true , address=185.167.204.205:4030 , piece_id=2WEVN7VFRXBRV277D5W5B42L3WDGYT2V4WSJTKSTMD3WBKFUUVNQ, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.656743802 (81h27m19.354312108s) [noise=true , address=89.149.201.147:4021  , piece_id=QXEVXQODAXU2YMITYDM7VYD2ZKM5CRLEOKN5VRBTOLRJ6ZIVEYXQ, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:31.657206457 (81h27m19.354774763s) [noise=true , address=89.149.201.147:4006  , piece_id=KGZQZGUW3HO7HT5R3NX4NSKZTSB7ND537INBKOGAKFQGRBNHJ3TA, seg_pos={0 0}, upload=71490]: Uploading piece...
Dec  9 00:56:32.160763915 (81h27m19.858332231s) [upload=71490]: Next returned nil segment
Dec  9 00:56:32.160772261 (81h27m19.858340566s) [upload=71490]: Waiting for error group managing segments...
Dec  9 00:56:32.367091113 (81h27m20.06465945s) [noise=true , address=185.167.204.205:4013 , piece_id=NNBGYPP6DGVX3FC4DZMC43ZAMHFPSZMY7KGRRIIGLFKCM3SQHHPA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.382359607 (81h27m20.079927943s) [noise=true , address=185.167.204.205:4009 , piece_id=QAL7FK7ZORITTNCJT4MNNFNPKNBQ54DXRCH2J6X6E4OEYOMAG5AQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.401869895 (81h27m20.099438232s) [noise=true , address=89.149.201.147:4004  , piece_id=63FVBOL7WODTHOLQFC75CWPSUQCJWS7LODV5FBRH2SICL3K3XWCQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.406066094 (81h27m20.103634431s) [noise=true , address=89.149.201.147:4021  , piece_id=QXEVXQODAXU2YMITYDM7VYD2ZKM5CRLEOKN5VRBTOLRJ6ZIVEYXQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.411331421 (81h27m20.108899797s) [noise=true , address=185.167.204.205:4015 , piece_id=D5IU7DJK5QUUXDZSJST7LMPOTQ43LMPPRQ3P46VKORYA7QWHRB2Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.418812968 (81h27m20.116381303s) [noise=true , address=89.149.201.147:4005  , piece_id=BYT4SLGEUH2AKLMHKBZ6QSQVJKOY2RVWQJC56BRV62QEKTBWKFRA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.420572304 (81h27m20.118140651s) [noise=true , address=81.171.14.70:4047    , piece_id=Y3IFJKBSGE47TODR4FTRYSCQFPXYDAQK6PIPO4ARTIC7CLR56S4Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.527718158 (81h27m20.225286494s) [noise=true , address=81.171.14.70:4044    , piece_id=PKZTY4JWVBCHCUHLL5MXXVWQ5MWWMUWR7I6SVQNI7BTR27IDPRRQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.574245548 (81h27m20.271813885s) [noise=true , address=185.167.204.206:4066 , piece_id=KW6JXLGMA66TJ2X3BSQ53MYERCPKIBT76PPBVE3PFIUMUKIKPBIA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.811440733 (81h27m20.509009049s) [noise=true , address=89.149.201.147:4015  , piece_id=EYC7EULWHAVARKFIMAQEDCMWHPTUSJBDFCYJT4RVSLSLYA4LV2CA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.814580629 (81h27m20.512148934s) [noise=true , address=89.149.201.147:4006  , piece_id=KGZQZGUW3HO7HT5R3NX4NSKZTSB7ND537INBKOGAKFQGRBNHJ3TA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.842364613 (81h27m20.539932918s) [noise=true , address=89.149.201.147:4017  , piece_id=H4BUDJVTVHDT7KYBJCBYXVHSHW6XVUICOHPAWFDWUCAFDRSLGX3Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.873751909 (81h27m20.571320235s) [noise=true , address=89.149.201.147:4019  , piece_id=44XAWC4PX6JDYDNQES7RFJOL44BKSMZL6JXD4VSNSJ63EFCU6IGA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.887103492 (81h27m20.584671828s) [noise=true , address=81.171.14.70:4025    , piece_id=AHLEQXU6UBZR2AANMXY72UGDKKCNW5RTDGD7MMQO4W2MMHUPQLUA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.908520581 (81h27m20.606088898s) [noise=true , address=185.167.204.205:4026 , piece_id=2W4DN6TY7AJJWQXYWSS6YZIGN563IXIQ2RMYWG3XHEL47PC7CJYQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:32.952690147 (81h27m20.650258454s) [noise=true , address=185.167.204.206:4049 , piece_id=WJOGRXIB3TD7JRCE7EZA6Q2JYL3SVHWKCIGBQ7JPBXSUFEOK4I3A, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.008828632 (81h27m20.706396977s) [noise=true , address=81.171.14.70:4038    , piece_id=BACFOGLKUZOOCDGQJIYHQVCDTUOGFGNAEEDZK246ULZSNFIYEOMA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.103114172 (81h27m20.800682508s) [noise=true , address=185.167.204.206:4070 , piece_id=ELEURNR5CXP7624QVG2M2ZK7HHZM2GHQXL5CPYSA2ODQAOXE3NKA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.134718753 (81h27m20.832287079s) [noise=true , address=81.171.14.70:4045    , piece_id=JYLMRVFZJQQMYNJVJ2GFM3QABGZZIPZCGNO4JVKOUISUSF2ZGGZQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.208666869 (81h27m20.906235185s) [noise=true , address=89.149.201.147:4020  , piece_id=6UT7ISSBNWIIRYDAJ7AFVXYNPNB2AJD36BWEX5UBM5ZUXYNZZBOA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.502522334 (81h27m21.20009065s) [noise=true , address=81.171.14.70:4040    , piece_id=LS33AXEKVAVNEVBJZ4XVVNIVW54Y3GCPI3RY4QPA5JNLJ32PBS5Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.520716964 (81h27m21.2182853s) [noise=true , address=89.149.201.147:4010  , piece_id=RKCPZSXPW6PL3CJZMOWMWWC6NRU3MRLZMUFX5ZPFHJI55U7ZIP7Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.541974847 (81h27m21.239543173s) [noise=true , address=185.167.204.205:4035 , piece_id=EKHXDUJ6JUKWPGLRZI5QJGUBF4QQKJDBSKF64H7RNVS6Q3UXOSHA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.901468573 (81h27m21.599036879s) [noise=true , address=185.167.204.205:4030 , piece_id=2WEVN7VFRXBRV277D5W5B42L3WDGYT2V4WSJTKSTMD3WBKFUUVNQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:33.908515979 (81h27m21.606084295s) [noise=true , address=185.167.204.205:4032 , piece_id=ZRKSY5TYZ47BN5NJD734DAXN544U6TDJJNSYDVU7KPHEF2BTJAMA, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:34.121817866 (81h27m21.819386183s) [noise=true , address=81.171.14.70:4048    , piece_id=7W4TKSAVVTAZTOWVSI4PMDF57WOARYODCQOOYDBMTEUBDK26FM5A, seg_pos={0 0}, upload=71490]: Done uploading piece. err: <nil>
Dec  9 00:56:34.121835138 (81h27m21.819403454s) [seg_pos={0 0}, upload=71490]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:56:34.122000397 (81h27m21.819568713s) [noise=true , address=89.149.201.147:4007  , piece_id=O52IHBKR3GBNALB7E2OCMVZJ6A4CXVNEPUDUQANAF2VATGZ5U46Q, seg_pos={0 0}, upload=71490]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew): protocol: expected piece hash; context canceled; EOF
Dec  9 00:56:34.122006168 (81h27m21.819574484s) [noise=true , address=89.149.201.147:4007  , piece_id=O52IHBKR3GBNALB7E2OCMVZJ6A4CXVNEPUDUQANAF2VATGZ5U46Q, seg_pos={0 0}, upload=71490]: Long tail cancellation due to optimal threshold
Dec  9 00:56:34.122138234 (81h27m21.81970655s) [noise=true , address=81.171.14.70:4046    , piece_id=Q27COUPBROIQC4IVWVO55AJLV7BKYZACQI57NIDFOYNWLV5NITJQ, seg_pos={0 0}, upload=71490]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7): protocol: expected piece hash; context canceled; EOF
Dec  9 00:56:34.122166547 (81h27m21.819734864s) [noise=true , address=81.171.14.70:4046    , piece_id=Q27COUPBROIQC4IVWVO55AJLV7BKYZACQI57NIDFOYNWLV5NITJQ, seg_pos={0 0}, upload=71490]: Long tail cancellation due to optimal threshold
Dec  9 00:56:34.122190121 (81h27m21.819758438s) [seg_pos={0 0}, upload=71490]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:56:34.122256786 (81h27m21.819825102s) [upload=71490]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:56:34.122261705 (81h27m21.819830011s) [upload=71490]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:56:34.272548935 (81h27m21.970117241s) [upload=71490]: Done uploading segments...
Dec  9 00:56:34.272567188 (81h27m21.970135495s) [upload=71490]: Upload finished. err: <nil>
Duration: 1m0.003145696s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [........................................X...................]
duration: 
426.11777ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:57:10 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 426.130263ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration: 
403.143752ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:56:12 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 403.160253ms core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
15 out of 60 is failed (threshold=3) [X.X..XX...X...X.........X........X...XX.....XX..X...X.....X.]
duration: 
8.187596273s
trace: 
https://jaeger.dev.storj.io/trace/7d49831679001ffd
FAIL (2025-12-09 00:55:50 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
49.201.147:4005  , piece_id=7R4WTWJK4OI4EXA2TSWDTKM5XTRIU7JJNNQN237QBQTV2ZWUZCUA, seg_pos={0 0}, upload=71472]: Uploading piece...
Dec  9 00:55:05.130205350 (81h25m52.827773656s) [noise=true , address=185.167.204.206:4052 , piece_id=TCTQEEGIACMQYTOHGGFPPSJBXMKHMSZAXYJNT2ZF267NYOG2OBKQ, seg_pos={0 0}, upload=71472]: Uploading piece...
Dec  9 00:55:05.130664196 (81h25m52.828232512s) [noise=true , address=89.149.201.147:4023  , piece_id=GDUIN4DI567WKUNDAJEM5VBSD62TQCPPJD62DBLMAASCK56ZXLMA, seg_pos={0 0}, upload=71472]: Uploading piece...
Dec  9 00:55:05.130998181 (81h25m52.828566487s) [noise=true , address=81.171.14.70:4045    , piece_id=URYVACUWE5WUN5SNK4Y7UNXHMKXLL3IOJXCFBIFG6G3VDSIFKBAQ, seg_pos={0 0}, upload=71472]: Uploading piece...
Dec  9 00:55:05.131376567 (81h25m52.828944883s) [noise=true , address=185.167.204.206:4069 , piece_id=W67L77RKKOKNCBUOWGICARMWJI3MBCKDRW3GGUP4OZAQ2MI42IVQ, seg_pos={0 0}, upload=71472]: Uploading piece...
Dec  9 00:55:05.131699050 (81h25m52.829267356s) [noise=true , address=185.167.204.205:4011 , piece_id=READSOOEJKRGER3HNQXOIXEJPHBHRLZQGHLDYPGVEFIES52OEYAA, seg_pos={0 0}, upload=71472]: Uploading piece...
Dec  9 00:55:05.132044356 (81h25m52.829612661s) [noise=true , address=185.167.204.206:4063 , piece_id=SN43F6KVQ3H3WFMF6IHKUFDM24AJN3QGZVG2DO3KOWRYNGWB56PA, seg_pos={0 0}, upload=71472]: Uploading piece...
Dec  9 00:55:05.132395902 (81h25m52.829964218s) [noise=true , address=81.171.14.70:4029    , piece_id=KT7BDC34Z2N2MY7WJFJJUAVZVEO4PA7BFSFNUFM4SFS4UYSE5NFA, seg_pos={0 0}, upload=71472]: Uploading piece...
Dec  9 00:55:05.132724365 (81h25m52.830292672s) [noise=true , address=89.149.201.147:4022  , piece_id=35WIW7CIKHEILTRBVHKQYBPZZGPQDJVDA7WBRVINS2TVBOXQSSLA, seg_pos={0 0}, upload=71472]: Uploading piece...
Dec  9 00:55:05.133052489 (81h25m52.830620805s) [noise=true , address=89.149.201.147:4021  , piece_id=7PT6CGSGSDKJYQUC2FWOQYFW3LEC6TS4AYCH3XPOSHYXIV6WA2VQ, seg_pos={0 0}, upload=71472]: Uploading piece...
Dec  9 00:55:05.133394527 (81h25m52.830962843s) [noise=true , address=89.149.201.147:4020  , piece_id=K6NTQPIIUVLZWA5RFL4CHF2ZXLMFCEAUNKROR2QUODUGCOHONSTA, seg_pos={0 0}, upload=71472]: Uploading piece...
Dec  9 00:55:05.657653649 (81h25m53.355221975s) [upload=71472]: Next returned nil segment
Dec  9 00:55:05.657666133 (81h25m53.355234469s) [upload=71472]: Waiting for error group managing segments...
Dec  9 00:55:05.867719753 (81h25m53.565288089s) [noise=true , address=81.171.14.70:4038    , piece_id=OTKVUVKYAHCVDLOTQ7XRPFO4CT7VQAJYBCGE3JLCLYFIXYJLGZTA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:05.870548999 (81h25m53.568117305s) [noise=true , address=81.171.14.70:4030    , piece_id=4GITAPAZZHKXTCRCS62FUP6VUNG2QEHFEY7ODUDHTH6L7PMV5ZHA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:05.873084465 (81h25m53.570652781s) [noise=true , address=89.149.201.147:4003  , piece_id=RY7WK2OXZCZQSCKTWZ4T5P2FWDJYS2GLBTIMR5X7DDDX6N7J2P5A, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:05.874942896 (81h25m53.572511212s) [noise=true , address=185.167.204.206:4063 , piece_id=SN43F6KVQ3H3WFMF6IHKUFDM24AJN3QGZVG2DO3KOWRYNGWB56PA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:05.875385313 (81h25m53.572953629s) [noise=true , address=185.167.204.205:4024 , piece_id=F4M75NA3WPAPXTAW5DKWQEYXW6JCF6GCLFZN3AQ2HLUMOQN3HTNA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:05.876287579 (81h25m53.573855895s) [noise=true , address=89.149.201.147:4022  , piece_id=35WIW7CIKHEILTRBVHKQYBPZZGPQDJVDA7WBRVINS2TVBOXQSSLA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:05.907480481 (81h25m53.605048797s) [noise=true , address=89.149.201.147:4020  , piece_id=K6NTQPIIUVLZWA5RFL4CHF2ZXLMFCEAUNKROR2QUODUGCOHONSTA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:05.915013354 (81h25m53.61258167s) [noise=true , address=89.149.201.147:4014  , piece_id=JV52JCSI44UCQXE3ME2P66XQGTOFJ2DUIGAFX5XNKNZ6WNY5DRWA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.160118136 (81h25m53.857686442s) [noise=true , address=81.171.14.70:4032    , piece_id=HDRL67JYG23GFN4SZHMYC2OHO3MM4F642MGIVCSE3D4MWCRPKRUA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.263272783 (81h25m53.960841089s) [noise=true , address=185.167.204.205:4005 , piece_id=FRBLZHDA56GLTMJ6XW6ISH37GJFCGJFR5NFGDHZOF3PNDLL4NTEA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.385335463 (81h25m54.082903899s) [noise=true , address=89.149.201.147:4021  , piece_id=7PT6CGSGSDKJYQUC2FWOQYFW3LEC6TS4AYCH3XPOSHYXIV6WA2VQ, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.480341188 (81h25m54.177909524s) [noise=true , address=185.167.204.206:4055 , piece_id=S2SMVQKUJKAYNVKZBMUULC43T4XWPFV5ITH6Q4WGODAX5ELA6MNA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.498480394 (81h25m54.19604874s) [noise=true , address=81.171.14.70:4029    , piece_id=KT7BDC34Z2N2MY7WJFJJUAVZVEO4PA7BFSFNUFM4SFS4UYSE5NFA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.507865938 (81h25m54.205434244s) [noise=true , address=185.167.204.206:4062 , piece_id=PWOMAKYI7JJGYEKJ3KPK7IZ7K7PR6I34JQY24YA7WVRLFFYV23DQ, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.651448641 (81h25m54.349016957s) [noise=true , address=89.149.201.147:4023  , piece_id=GDUIN4DI567WKUNDAJEM5VBSD62TQCPPJD62DBLMAASCK56ZXLMA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.689132480 (81h25m54.386721666s) [noise=true , address=185.167.204.206:4046 , piece_id=KWLT4UFSTOOPRUSYH2PD7RG2O2ULTL74HYXRAGS7PK2E4H42Q62Q, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.765229471 (81h25m54.462797807s) [noise=true , address=89.149.201.147:4005  , piece_id=7R4WTWJK4OI4EXA2TSWDTKM5XTRIU7JJNNQN237QBQTV2ZWUZCUA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.808582901 (81h25m54.506151227s) [noise=true , address=81.171.14.70:4045    , piece_id=URYVACUWE5WUN5SNK4Y7UNXHMKXLL3IOJXCFBIFG6G3VDSIFKBAQ, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.822077381 (81h25m54.519645707s) [noise=true , address=81.171.14.70:4040    , piece_id=S6PX3BL4N2FFVGBXNTX2KBUHZQKGMZNPRWDPACWGD7IIBIDVBWTQ, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.956435391 (81h25m54.654003707s) [noise=true , address=89.149.201.147:4012  , piece_id=326HMMBXNHCNPTF2KTA6QCR56YHYCHONP3HKNE4HM2WU6KLJ26HA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:07.084473965 (81h25m54.782042281s) [noise=true , address=185.167.204.206:4072 , piece_id=WT3FAS2REC35PNN6PERYYRTTH7DMNXB3INVNBZ5FNP6ECON4WNQQ, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:07.301562638 (81h25m54.999130944s) [noise=true , address=185.167.204.205:4012 , piece_id=IGLCNLQNAFGRFA4FSVDFTYOONAPUXWP7BIIUYZUCRXPM46KAECEA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:07.576818045 (81h25m55.274386361s) [noise=true , address=185.167.204.205:4011 , piece_id=READSOOEJKRGER3HNQXOIXEJPHBHRLZQGHLDYPGVEFIES52OEYAA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:07.722488128 (81h25m55.420056464s) [noise=true , address=185.167.204.206:4052 , piece_id=TCTQEEGIACMQYTOHGGFPPSJBXMKHMSZAXYJNT2ZF267NYOG2OBKQ, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:08.238398482 (81h25m55.935966818s) [noise=true , address=185.167.204.205:4030 , piece_id=XJM22ZEZVULHR3LB2EW4ZYY6SHRPA52BB3O75SICC6CDW3D2NLVA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:08.326313411 (81h25m56.023881747s) [noise=true , address=81.171.14.70:4042    , piece_id=WGTQIQ7UKBVMMSVYB635N2MPO72TL3LBYTT7GGFKPQXH6JF7VIWQ, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:08.326346583 (81h25m56.02391493s) [seg_pos={0 0}, upload=71472]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:55:08.326631275 (81h25m56.024199611s) [noise=true , address=185.167.204.206:4069 , piece_id=W67L77RKKOKNCBUOWGICARMWJI3MBCKDRW3GGUP4OZAQ2MI42IVQ, seg_pos={0 0}, upload=71472]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF
Dec  9 00:55:08.326647414 (81h25m56.02421575s) [noise=true , address=185.167.204.206:4069 , piece_id=W67L77RKKOKNCBUOWGICARMWJI3MBCKDRW3GGUP4OZAQ2MI42IVQ, seg_pos={0 0}, upload=71472]: Long tail cancellation due to optimal threshold
Dec  9 00:55:08.326907832 (81h25m56.024476167s) [noise=true , address=81.171.14.70:4041    , piece_id=QAFLXBPJFN7NIVCJLO7WP4FAAXZEXMKI4Z4IEYRQNHGSFV7YBQTA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF
Dec  9 00:55:08.326919684 (81h25m56.02448803s) [noise=true , address=81.171.14.70:4041    , piece_id=QAFLXBPJFN7NIVCJLO7WP4FAAXZEXMKI4Z4IEYRQNHGSFV7YBQTA, seg_pos={0 0}, upload=71472]: Long tail cancellation due to optimal threshold
Dec  9 00:55:08.326947856 (81h25m56.024516192s) [seg_pos={0 0}, upload=71472]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:55:08.327059885 (81h25m56.024628222s) [upload=71472]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:55:08.327069533 (81h25m56.024637868s) [upload=71472]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:55:08.481830188 (81h25m56.179398525s) [upload=71472]: Done uploading segments...
Dec  9 00:55:08.481849734 (81h25m56.179418071s) [upload=71472]: Upload finished. err: <nil>
Duration: 8.18761132s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
15 out of 60 is failed (threshold=3) [.X.X..XX...X...X.........X........X...XX.....XX..X...X.....X]
duration: 
37.187057464s
trace: 
https://jaeger.dev.storj.io/trace/7d49831679001ffd
FAIL (2025-12-09 00:55:41 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
49.201.147:4005  , piece_id=7R4WTWJK4OI4EXA2TSWDTKM5XTRIU7JJNNQN237QBQTV2ZWUZCUA, seg_pos={0 0}, upload=71472]: Uploading piece...
Dec  9 00:55:05.130205350 (81h25m52.827773656s) [noise=true , address=185.167.204.206:4052 , piece_id=TCTQEEGIACMQYTOHGGFPPSJBXMKHMSZAXYJNT2ZF267NYOG2OBKQ, seg_pos={0 0}, upload=71472]: Uploading piece...
Dec  9 00:55:05.130664196 (81h25m52.828232512s) [noise=true , address=89.149.201.147:4023  , piece_id=GDUIN4DI567WKUNDAJEM5VBSD62TQCPPJD62DBLMAASCK56ZXLMA, seg_pos={0 0}, upload=71472]: Uploading piece...
Dec  9 00:55:05.130998181 (81h25m52.828566487s) [noise=true , address=81.171.14.70:4045    , piece_id=URYVACUWE5WUN5SNK4Y7UNXHMKXLL3IOJXCFBIFG6G3VDSIFKBAQ, seg_pos={0 0}, upload=71472]: Uploading piece...
Dec  9 00:55:05.131376567 (81h25m52.828944883s) [noise=true , address=185.167.204.206:4069 , piece_id=W67L77RKKOKNCBUOWGICARMWJI3MBCKDRW3GGUP4OZAQ2MI42IVQ, seg_pos={0 0}, upload=71472]: Uploading piece...
Dec  9 00:55:05.131699050 (81h25m52.829267356s) [noise=true , address=185.167.204.205:4011 , piece_id=READSOOEJKRGER3HNQXOIXEJPHBHRLZQGHLDYPGVEFIES52OEYAA, seg_pos={0 0}, upload=71472]: Uploading piece...
Dec  9 00:55:05.132044356 (81h25m52.829612661s) [noise=true , address=185.167.204.206:4063 , piece_id=SN43F6KVQ3H3WFMF6IHKUFDM24AJN3QGZVG2DO3KOWRYNGWB56PA, seg_pos={0 0}, upload=71472]: Uploading piece...
Dec  9 00:55:05.132395902 (81h25m52.829964218s) [noise=true , address=81.171.14.70:4029    , piece_id=KT7BDC34Z2N2MY7WJFJJUAVZVEO4PA7BFSFNUFM4SFS4UYSE5NFA, seg_pos={0 0}, upload=71472]: Uploading piece...
Dec  9 00:55:05.132724365 (81h25m52.830292672s) [noise=true , address=89.149.201.147:4022  , piece_id=35WIW7CIKHEILTRBVHKQYBPZZGPQDJVDA7WBRVINS2TVBOXQSSLA, seg_pos={0 0}, upload=71472]: Uploading piece...
Dec  9 00:55:05.133052489 (81h25m52.830620805s) [noise=true , address=89.149.201.147:4021  , piece_id=7PT6CGSGSDKJYQUC2FWOQYFW3LEC6TS4AYCH3XPOSHYXIV6WA2VQ, seg_pos={0 0}, upload=71472]: Uploading piece...
Dec  9 00:55:05.133394527 (81h25m52.830962843s) [noise=true , address=89.149.201.147:4020  , piece_id=K6NTQPIIUVLZWA5RFL4CHF2ZXLMFCEAUNKROR2QUODUGCOHONSTA, seg_pos={0 0}, upload=71472]: Uploading piece...
Dec  9 00:55:05.657653649 (81h25m53.355221975s) [upload=71472]: Next returned nil segment
Dec  9 00:55:05.657666133 (81h25m53.355234469s) [upload=71472]: Waiting for error group managing segments...
Dec  9 00:55:05.867719753 (81h25m53.565288089s) [noise=true , address=81.171.14.70:4038    , piece_id=OTKVUVKYAHCVDLOTQ7XRPFO4CT7VQAJYBCGE3JLCLYFIXYJLGZTA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:05.870548999 (81h25m53.568117305s) [noise=true , address=81.171.14.70:4030    , piece_id=4GITAPAZZHKXTCRCS62FUP6VUNG2QEHFEY7ODUDHTH6L7PMV5ZHA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:05.873084465 (81h25m53.570652781s) [noise=true , address=89.149.201.147:4003  , piece_id=RY7WK2OXZCZQSCKTWZ4T5P2FWDJYS2GLBTIMR5X7DDDX6N7J2P5A, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:05.874942896 (81h25m53.572511212s) [noise=true , address=185.167.204.206:4063 , piece_id=SN43F6KVQ3H3WFMF6IHKUFDM24AJN3QGZVG2DO3KOWRYNGWB56PA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:05.875385313 (81h25m53.572953629s) [noise=true , address=185.167.204.205:4024 , piece_id=F4M75NA3WPAPXTAW5DKWQEYXW6JCF6GCLFZN3AQ2HLUMOQN3HTNA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:05.876287579 (81h25m53.573855895s) [noise=true , address=89.149.201.147:4022  , piece_id=35WIW7CIKHEILTRBVHKQYBPZZGPQDJVDA7WBRVINS2TVBOXQSSLA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:05.907480481 (81h25m53.605048797s) [noise=true , address=89.149.201.147:4020  , piece_id=K6NTQPIIUVLZWA5RFL4CHF2ZXLMFCEAUNKROR2QUODUGCOHONSTA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:05.915013354 (81h25m53.61258167s) [noise=true , address=89.149.201.147:4014  , piece_id=JV52JCSI44UCQXE3ME2P66XQGTOFJ2DUIGAFX5XNKNZ6WNY5DRWA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.160118136 (81h25m53.857686442s) [noise=true , address=81.171.14.70:4032    , piece_id=HDRL67JYG23GFN4SZHMYC2OHO3MM4F642MGIVCSE3D4MWCRPKRUA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.263272783 (81h25m53.960841089s) [noise=true , address=185.167.204.205:4005 , piece_id=FRBLZHDA56GLTMJ6XW6ISH37GJFCGJFR5NFGDHZOF3PNDLL4NTEA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.385335463 (81h25m54.082903899s) [noise=true , address=89.149.201.147:4021  , piece_id=7PT6CGSGSDKJYQUC2FWOQYFW3LEC6TS4AYCH3XPOSHYXIV6WA2VQ, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.480341188 (81h25m54.177909524s) [noise=true , address=185.167.204.206:4055 , piece_id=S2SMVQKUJKAYNVKZBMUULC43T4XWPFV5ITH6Q4WGODAX5ELA6MNA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.498480394 (81h25m54.19604874s) [noise=true , address=81.171.14.70:4029    , piece_id=KT7BDC34Z2N2MY7WJFJJUAVZVEO4PA7BFSFNUFM4SFS4UYSE5NFA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.507865938 (81h25m54.205434244s) [noise=true , address=185.167.204.206:4062 , piece_id=PWOMAKYI7JJGYEKJ3KPK7IZ7K7PR6I34JQY24YA7WVRLFFYV23DQ, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.651448641 (81h25m54.349016957s) [noise=true , address=89.149.201.147:4023  , piece_id=GDUIN4DI567WKUNDAJEM5VBSD62TQCPPJD62DBLMAASCK56ZXLMA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.689132480 (81h25m54.386721666s) [noise=true , address=185.167.204.206:4046 , piece_id=KWLT4UFSTOOPRUSYH2PD7RG2O2ULTL74HYXRAGS7PK2E4H42Q62Q, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.765229471 (81h25m54.462797807s) [noise=true , address=89.149.201.147:4005  , piece_id=7R4WTWJK4OI4EXA2TSWDTKM5XTRIU7JJNNQN237QBQTV2ZWUZCUA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.808582901 (81h25m54.506151227s) [noise=true , address=81.171.14.70:4045    , piece_id=URYVACUWE5WUN5SNK4Y7UNXHMKXLL3IOJXCFBIFG6G3VDSIFKBAQ, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.822077381 (81h25m54.519645707s) [noise=true , address=81.171.14.70:4040    , piece_id=S6PX3BL4N2FFVGBXNTX2KBUHZQKGMZNPRWDPACWGD7IIBIDVBWTQ, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:06.956435391 (81h25m54.654003707s) [noise=true , address=89.149.201.147:4012  , piece_id=326HMMBXNHCNPTF2KTA6QCR56YHYCHONP3HKNE4HM2WU6KLJ26HA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:07.084473965 (81h25m54.782042281s) [noise=true , address=185.167.204.206:4072 , piece_id=WT3FAS2REC35PNN6PERYYRTTH7DMNXB3INVNBZ5FNP6ECON4WNQQ, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:07.301562638 (81h25m54.999130944s) [noise=true , address=185.167.204.205:4012 , piece_id=IGLCNLQNAFGRFA4FSVDFTYOONAPUXWP7BIIUYZUCRXPM46KAECEA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:07.576818045 (81h25m55.274386361s) [noise=true , address=185.167.204.205:4011 , piece_id=READSOOEJKRGER3HNQXOIXEJPHBHRLZQGHLDYPGVEFIES52OEYAA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:07.722488128 (81h25m55.420056464s) [noise=true , address=185.167.204.206:4052 , piece_id=TCTQEEGIACMQYTOHGGFPPSJBXMKHMSZAXYJNT2ZF267NYOG2OBKQ, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:08.238398482 (81h25m55.935966818s) [noise=true , address=185.167.204.205:4030 , piece_id=XJM22ZEZVULHR3LB2EW4ZYY6SHRPA52BB3O75SICC6CDW3D2NLVA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:08.326313411 (81h25m56.023881747s) [noise=true , address=81.171.14.70:4042    , piece_id=WGTQIQ7UKBVMMSVYB635N2MPO72TL3LBYTT7GGFKPQXH6JF7VIWQ, seg_pos={0 0}, upload=71472]: Done uploading piece. err: <nil>
Dec  9 00:55:08.326346583 (81h25m56.02391493s) [seg_pos={0 0}, upload=71472]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:55:08.326631275 (81h25m56.024199611s) [noise=true , address=185.167.204.206:4069 , piece_id=W67L77RKKOKNCBUOWGICARMWJI3MBCKDRW3GGUP4OZAQ2MI42IVQ, seg_pos={0 0}, upload=71472]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF
Dec  9 00:55:08.326647414 (81h25m56.02421575s) [noise=true , address=185.167.204.206:4069 , piece_id=W67L77RKKOKNCBUOWGICARMWJI3MBCKDRW3GGUP4OZAQ2MI42IVQ, seg_pos={0 0}, upload=71472]: Long tail cancellation due to optimal threshold
Dec  9 00:55:08.326907832 (81h25m56.024476167s) [noise=true , address=81.171.14.70:4041    , piece_id=QAFLXBPJFN7NIVCJLO7WP4FAAXZEXMKI4Z4IEYRQNHGSFV7YBQTA, seg_pos={0 0}, upload=71472]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF
Dec  9 00:55:08.326919684 (81h25m56.02448803s) [noise=true , address=81.171.14.70:4041    , piece_id=QAFLXBPJFN7NIVCJLO7WP4FAAXZEXMKI4Z4IEYRQNHGSFV7YBQTA, seg_pos={0 0}, upload=71472]: Long tail cancellation due to optimal threshold
Dec  9 00:55:08.326947856 (81h25m56.024516192s) [seg_pos={0 0}, upload=71472]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:55:08.327059885 (81h25m56.024628222s) [upload=71472]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:55:08.327069533 (81h25m56.024637868s) [upload=71472]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:55:08.481830188 (81h25m56.179398525s) [upload=71472]: Done uploading segments...
Dec  9 00:55:08.481849734 (81h25m56.179418071s) [upload=71472]: Upload finished. err: <nil>
Duration: 37.187087401s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
15 out of 60 is failed (threshold=3) [X.X.X..XX...X...X.........X........X...XX.....XX..X...X.....]
duration: 
40.119938584s
trace: 
https://jaeger.dev.storj.io/trace/4fb278eb70435bac
FAIL (2025-12-09 00:55:04 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
1386]: Uploading piece...
Dec  9 00:49:40.279070242 (81h20m27.976638578s) [noise=true , address=89.149.201.147:4013  , piece_id=X6OECVN3JAUJZNLH4NRINSKMFQVS362OTESJ2IK4UCCR6FJOH6VQ, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.279256881 (81h20m27.976825217s) [noise=true , address=81.171.14.70:4042    , piece_id=52FDIU53UPFPDDXZ5X7SGTYNOVZNVYHIFOQ5FIGCVDROVDNOXG4Q, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.280157753 (81h20m27.977726089s) [noise=true , address=81.171.14.70:4025    , piece_id=B3WYBPJ33TH3TXHUNVKIA6ENOZHX5XVJREYH4A4FFQWYMVYH44NQ, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.281061351 (81h20m27.978629688s) [noise=true , address=81.171.14.70:4041    , piece_id=H5RVFNAAKV62Q3MBPMIH7B4Z7NCE6MLLFCPJKYCK7GXTSNQ4VWCA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.282015464 (81h20m27.979583799s) [noise=true , address=89.149.201.147:4004  , piece_id=W4ICLXA6IO56RV2D3IWNAVAEAXLJSZHJRS7MM25BXSHR4XPE2NZQ, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.283036091 (81h20m27.980604436s) [noise=true , address=81.171.14.70:4027    , piece_id=UKJJU3M43RKTU46XJGIWPLDYP2DIYXJHZFQAWX5MBD4VM5KXAJUA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.284040155 (81h20m27.981608521s) [noise=true , address=81.171.14.70:4040    , piece_id=7IBI4W4MSSA6CAO57AM77LWTU3OM64HFYC34KUX4LF4IRY4MLG3Q, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.285010618 (81h20m27.982578954s) [noise=true , address=89.149.201.147:4008  , piece_id=D4VV7A5QQU3JAVVMOZCRV3U6D522G3SG5OWLNT5QRB23OCV3SKOA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.285743998 (81h20m27.983312334s) [noise=true , address=81.171.14.70:4044    , piece_id=AHXT2S4D3NHABJT2DXKYWRJB62DKEELHRBOAGWC4AEM7MKNS7IGA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.286395977 (81h20m27.983964312s) [noise=true , address=89.149.201.147:4014  , piece_id=VD3TZ5BIXBGAXD3ZV5MWAYRIZMEDO4DCUCJCU4R3R53COXPMYLJA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.779672892 (81h20m28.477241237s) [upload=71386]: Next returned nil segment
Dec  9 00:49:40.779686758 (81h20m28.477255093s) [upload=71386]: Waiting for error group managing segments...
Dec  9 00:49:40.981907347 (81h20m28.679475682s) [noise=true , address=185.167.204.205:4011 , piece_id=CU3PXMSY3G7OCII3F4A6GGFL4O3VSTCCCBTCXNM7NH5N4KDIUGGA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:40.984516341 (81h20m28.682084676s) [noise=true , address=89.149.201.147:4005  , piece_id=Q7MV65E2UQNBW4XQTT2P625LA4F3I5IEDY2DXSP6Q4RKDZGQR6DA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.003457703 (81h20m28.701026059s) [noise=true , address=89.149.201.147:4012  , piece_id=GOTKYVUT5AC3SEBU67375YCOBR5YWBWTD26AIB3PPBJI4C7Z63EQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.022780378 (81h20m28.720348714s) [noise=true , address=185.167.204.205:4032 , piece_id=2NX73TYG7G7RGN77MOPIJLY4TSXLBLZEE77OUJIWMQ2DUA4NFTBA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.066782243 (81h20m28.76435058s) [noise=true , address=89.149.201.147:4014  , piece_id=VD3TZ5BIXBGAXD3ZV5MWAYRIZMEDO4DCUCJCU4R3R53COXPMYLJA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.311820005 (81h20m29.009388342s) [noise=true , address=89.149.201.147:4024  , piece_id=WUTQW6KVB66UJL2RFANVIIEFCTIH2QZVUXTMR5ETDPRRS7MQLCEA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.315447812 (81h20m29.013016148s) [noise=true , address=89.149.201.147:4009  , piece_id=63IERT7FJBLKMPVENWK6ROLWUQCZAIBIEXSRNJ7AFRRBHAY3YKKA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.340938248 (81h20m29.038506585s) [noise=true , address=89.149.201.147:4023  , piece_id=PXZZMT5ZPKEG56NFWYCLNCAD3ZATNYIOZZADBD52RQJ7GMIQ5GPA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.356422684 (81h20m29.053991s) [noise=true , address=185.167.204.205:4023 , piece_id=ROMHL3T47W43S4ANERJUEINXYOTB7W3YIUAB2YMRG6TTQ6LFGCYQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.379906271 (81h20m29.077474597s) [noise=true , address=89.149.201.147:4008  , piece_id=D4VV7A5QQU3JAVVMOZCRV3U6D522G3SG5OWLNT5QRB23OCV3SKOA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.386907360 (81h20m29.084475666s) [noise=true , address=89.149.201.147:4004  , piece_id=W4ICLXA6IO56RV2D3IWNAVAEAXLJSZHJRS7MM25BXSHR4XPE2NZQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.401040851 (81h20m29.098609157s) [noise=true , address=185.167.204.205:4033 , piece_id=6YTJV2ZNAZOZ3NJ3SKQND4JYWBOMGOJOCWVUXEOE2AJS6WZRDAQQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.411632767 (81h20m29.109201073s) [noise=true , address=89.149.201.147:4002  , piece_id=4HULUQFHIMM2FFXC4GCKZZHWBI45SVGRC2LQEYNRT7ZG243QGDBA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.424517796 (81h20m29.122086102s) [noise=true , address=185.167.204.205:4013 , piece_id=HBUNHYDLKZ4VX3WZ25JZFQEFVT2WXGLAFEPDGMAH5F62GNOLLVYQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.519211023 (81h20m29.216779339s) [noise=true , address=185.167.204.205:4030 , piece_id=EGUVNY7YRDHKYLG72ZEIOQTJGQWMRD6PGHA6WBNZKBN4Y55DWRUA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.528641941 (81h20m29.226210257s) [noise=true , address=81.171.14.70:4040    , piece_id=7IBI4W4MSSA6CAO57AM77LWTU3OM64HFYC34KUX4LF4IRY4MLG3Q, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.566414190 (81h20m29.263982516s) [noise=true , address=89.149.201.147:4011  , piece_id=KT3PJGSOOH63TVSYQ7GC6RDRV3TFK3AZZMAX5TPNWPNFSHVHNZPA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.632970187 (81h20m29.330538523s) [noise=true , address=89.149.201.147:4013  , piece_id=X6OECVN3JAUJZNLH4NRINSKMFQVS362OTESJ2IK4UCCR6FJOH6VQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.705968087 (81h20m29.403536403s) [noise=true , address=81.171.14.70:4044    , piece_id=AHXT2S4D3NHABJT2DXKYWRJB62DKEELHRBOAGWC4AEM7MKNS7IGA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.836703563 (81h20m29.534271879s) [noise=true , address=81.171.14.70:4027    , piece_id=UKJJU3M43RKTU46XJGIWPLDYP2DIYXJHZFQAWX5MBD4VM5KXAJUA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.890198652 (81h20m29.587766988s) [noise=true , address=81.171.14.70:4026    , piece_id=WCHCPU4ZK23RZGJKMEM7AONE3XFJJVBEHDVLFE5GGW3V5YHGBYJA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.974317566 (81h20m29.671885883s) [noise=true , address=89.149.201.147:4010  , piece_id=DSPUC2MGX5DCNQHASDHNNW2F3TACJXNVSDJEFMIA4G6K47WW36FA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.184500881 (81h20m29.882069197s) [noise=true , address=81.171.14.70:4042    , piece_id=52FDIU53UPFPDDXZ5X7SGTYNOVZNVYHIFOQ5FIGCVDROVDNOXG4Q, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.504124550 (81h20m30.201692856s) [noise=true , address=185.167.204.205:4015 , piece_id=MIFYE4R65BH45GNVC2ZLVKVV3NQOCL52CBIVXBGSP6EUQZHI54FA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.535945882 (81h20m30.233514189s) [noise=true , address=81.171.14.70:4025    , piece_id=B3WYBPJ33TH3TXHUNVKIA6ENOZHX5XVJREYH4A4FFQWYMVYH44NQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.607658633 (81h20m30.30522694s) [noise=true , address=89.149.201.147:4020  , piece_id=PPRI2ITIZY7Z6UW4S5CDATQCZDFJYOQKRI7HBTHPF5LLHEZ6ZZHQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.607672208 (81h20m30.305240524s) [seg_pos={0 0}, upload=71386]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:49:42.607978861 (81h20m30.305547166s) [noise=true , address=185.167.204.206:4047 , piece_id=EZMV2FA4LHPHFPC7LKHUI6XHUMXIEQXJKZTDGX3AC2JDJDIVQ7OA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF): protocol: read tcp 5.161.89.252:45946->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec  9 00:49:42.607986555 (81h20m30.305554861s) [noise=true , address=185.167.204.206:4047 , piece_id=EZMV2FA4LHPHFPC7LKHUI6XHUMXIEQXJKZTDGX3AC2JDJDIVQ7OA, seg_pos={0 0}, upload=71386]: Long tail cancellation due to optimal threshold
Dec  9 00:49:42.608031139 (81h20m30.305599455s) [noise=true , address=81.171.14.70:4041    , piece_id=H5RVFNAAKV62Q3MBPMIH7B4Z7NCE6MLLFCPJKYCK7GXTSNQ4VWCA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF
Dec  9 00:49:42.608041749 (81h20m30.305610065s) [noise=true , address=81.171.14.70:4041    , piece_id=H5RVFNAAKV62Q3MBPMIH7B4Z7NCE6MLLFCPJKYCK7GXTSNQ4VWCA, seg_pos={0 0}, upload=71386]: Long tail cancellation due to optimal threshold
Dec  9 00:49:42.608057588 (81h20m30.305625904s) [seg_pos={0 0}, upload=71386]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:49:42.608144800 (81h20m30.305713107s) [upload=71386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:49:42.608149019 (81h20m30.305717335s) [upload=71386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:49:42.759877479 (81h20m30.457445815s) [upload=71386]: Done uploading segments...
Dec  9 00:49:42.759900101 (81h20m30.457468436s) [upload=71386]: Upload finished. err: <nil>
Duration: 40.119955786s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration: 
415.161552ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:55:03 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 415.184034ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...........................................X................]
duration: 
394.08784ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:54:33 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 394.107859ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [............................................X...............]
duration: 
431.680231ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:53:53 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 431.699006ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration: 
415.431647ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:53:38 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 415.455531ms core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
15 out of 60 is failed (threshold=3) [.X.X.X..XX...X...X.........X........X...XX.....XX..X...X....]
duration: 
4.335882206s
trace: 
https://jaeger.dev.storj.io/trace/4fb278eb70435bac
FAIL (2025-12-09 00:53:21 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
1386]: Uploading piece...
Dec  9 00:49:40.279070242 (81h20m27.976638578s) [noise=true , address=89.149.201.147:4013  , piece_id=X6OECVN3JAUJZNLH4NRINSKMFQVS362OTESJ2IK4UCCR6FJOH6VQ, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.279256881 (81h20m27.976825217s) [noise=true , address=81.171.14.70:4042    , piece_id=52FDIU53UPFPDDXZ5X7SGTYNOVZNVYHIFOQ5FIGCVDROVDNOXG4Q, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.280157753 (81h20m27.977726089s) [noise=true , address=81.171.14.70:4025    , piece_id=B3WYBPJ33TH3TXHUNVKIA6ENOZHX5XVJREYH4A4FFQWYMVYH44NQ, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.281061351 (81h20m27.978629688s) [noise=true , address=81.171.14.70:4041    , piece_id=H5RVFNAAKV62Q3MBPMIH7B4Z7NCE6MLLFCPJKYCK7GXTSNQ4VWCA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.282015464 (81h20m27.979583799s) [noise=true , address=89.149.201.147:4004  , piece_id=W4ICLXA6IO56RV2D3IWNAVAEAXLJSZHJRS7MM25BXSHR4XPE2NZQ, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.283036091 (81h20m27.980604436s) [noise=true , address=81.171.14.70:4027    , piece_id=UKJJU3M43RKTU46XJGIWPLDYP2DIYXJHZFQAWX5MBD4VM5KXAJUA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.284040155 (81h20m27.981608521s) [noise=true , address=81.171.14.70:4040    , piece_id=7IBI4W4MSSA6CAO57AM77LWTU3OM64HFYC34KUX4LF4IRY4MLG3Q, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.285010618 (81h20m27.982578954s) [noise=true , address=89.149.201.147:4008  , piece_id=D4VV7A5QQU3JAVVMOZCRV3U6D522G3SG5OWLNT5QRB23OCV3SKOA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.285743998 (81h20m27.983312334s) [noise=true , address=81.171.14.70:4044    , piece_id=AHXT2S4D3NHABJT2DXKYWRJB62DKEELHRBOAGWC4AEM7MKNS7IGA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.286395977 (81h20m27.983964312s) [noise=true , address=89.149.201.147:4014  , piece_id=VD3TZ5BIXBGAXD3ZV5MWAYRIZMEDO4DCUCJCU4R3R53COXPMYLJA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.779672892 (81h20m28.477241237s) [upload=71386]: Next returned nil segment
Dec  9 00:49:40.779686758 (81h20m28.477255093s) [upload=71386]: Waiting for error group managing segments...
Dec  9 00:49:40.981907347 (81h20m28.679475682s) [noise=true , address=185.167.204.205:4011 , piece_id=CU3PXMSY3G7OCII3F4A6GGFL4O3VSTCCCBTCXNM7NH5N4KDIUGGA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:40.984516341 (81h20m28.682084676s) [noise=true , address=89.149.201.147:4005  , piece_id=Q7MV65E2UQNBW4XQTT2P625LA4F3I5IEDY2DXSP6Q4RKDZGQR6DA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.003457703 (81h20m28.701026059s) [noise=true , address=89.149.201.147:4012  , piece_id=GOTKYVUT5AC3SEBU67375YCOBR5YWBWTD26AIB3PPBJI4C7Z63EQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.022780378 (81h20m28.720348714s) [noise=true , address=185.167.204.205:4032 , piece_id=2NX73TYG7G7RGN77MOPIJLY4TSXLBLZEE77OUJIWMQ2DUA4NFTBA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.066782243 (81h20m28.76435058s) [noise=true , address=89.149.201.147:4014  , piece_id=VD3TZ5BIXBGAXD3ZV5MWAYRIZMEDO4DCUCJCU4R3R53COXPMYLJA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.311820005 (81h20m29.009388342s) [noise=true , address=89.149.201.147:4024  , piece_id=WUTQW6KVB66UJL2RFANVIIEFCTIH2QZVUXTMR5ETDPRRS7MQLCEA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.315447812 (81h20m29.013016148s) [noise=true , address=89.149.201.147:4009  , piece_id=63IERT7FJBLKMPVENWK6ROLWUQCZAIBIEXSRNJ7AFRRBHAY3YKKA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.340938248 (81h20m29.038506585s) [noise=true , address=89.149.201.147:4023  , piece_id=PXZZMT5ZPKEG56NFWYCLNCAD3ZATNYIOZZADBD52RQJ7GMIQ5GPA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.356422684 (81h20m29.053991s) [noise=true , address=185.167.204.205:4023 , piece_id=ROMHL3T47W43S4ANERJUEINXYOTB7W3YIUAB2YMRG6TTQ6LFGCYQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.379906271 (81h20m29.077474597s) [noise=true , address=89.149.201.147:4008  , piece_id=D4VV7A5QQU3JAVVMOZCRV3U6D522G3SG5OWLNT5QRB23OCV3SKOA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.386907360 (81h20m29.084475666s) [noise=true , address=89.149.201.147:4004  , piece_id=W4ICLXA6IO56RV2D3IWNAVAEAXLJSZHJRS7MM25BXSHR4XPE2NZQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.401040851 (81h20m29.098609157s) [noise=true , address=185.167.204.205:4033 , piece_id=6YTJV2ZNAZOZ3NJ3SKQND4JYWBOMGOJOCWVUXEOE2AJS6WZRDAQQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.411632767 (81h20m29.109201073s) [noise=true , address=89.149.201.147:4002  , piece_id=4HULUQFHIMM2FFXC4GCKZZHWBI45SVGRC2LQEYNRT7ZG243QGDBA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.424517796 (81h20m29.122086102s) [noise=true , address=185.167.204.205:4013 , piece_id=HBUNHYDLKZ4VX3WZ25JZFQEFVT2WXGLAFEPDGMAH5F62GNOLLVYQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.519211023 (81h20m29.216779339s) [noise=true , address=185.167.204.205:4030 , piece_id=EGUVNY7YRDHKYLG72ZEIOQTJGQWMRD6PGHA6WBNZKBN4Y55DWRUA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.528641941 (81h20m29.226210257s) [noise=true , address=81.171.14.70:4040    , piece_id=7IBI4W4MSSA6CAO57AM77LWTU3OM64HFYC34KUX4LF4IRY4MLG3Q, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.566414190 (81h20m29.263982516s) [noise=true , address=89.149.201.147:4011  , piece_id=KT3PJGSOOH63TVSYQ7GC6RDRV3TFK3AZZMAX5TPNWPNFSHVHNZPA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.632970187 (81h20m29.330538523s) [noise=true , address=89.149.201.147:4013  , piece_id=X6OECVN3JAUJZNLH4NRINSKMFQVS362OTESJ2IK4UCCR6FJOH6VQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.705968087 (81h20m29.403536403s) [noise=true , address=81.171.14.70:4044    , piece_id=AHXT2S4D3NHABJT2DXKYWRJB62DKEELHRBOAGWC4AEM7MKNS7IGA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.836703563 (81h20m29.534271879s) [noise=true , address=81.171.14.70:4027    , piece_id=UKJJU3M43RKTU46XJGIWPLDYP2DIYXJHZFQAWX5MBD4VM5KXAJUA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.890198652 (81h20m29.587766988s) [noise=true , address=81.171.14.70:4026    , piece_id=WCHCPU4ZK23RZGJKMEM7AONE3XFJJVBEHDVLFE5GGW3V5YHGBYJA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.974317566 (81h20m29.671885883s) [noise=true , address=89.149.201.147:4010  , piece_id=DSPUC2MGX5DCNQHASDHNNW2F3TACJXNVSDJEFMIA4G6K47WW36FA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.184500881 (81h20m29.882069197s) [noise=true , address=81.171.14.70:4042    , piece_id=52FDIU53UPFPDDXZ5X7SGTYNOVZNVYHIFOQ5FIGCVDROVDNOXG4Q, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.504124550 (81h20m30.201692856s) [noise=true , address=185.167.204.205:4015 , piece_id=MIFYE4R65BH45GNVC2ZLVKVV3NQOCL52CBIVXBGSP6EUQZHI54FA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.535945882 (81h20m30.233514189s) [noise=true , address=81.171.14.70:4025    , piece_id=B3WYBPJ33TH3TXHUNVKIA6ENOZHX5XVJREYH4A4FFQWYMVYH44NQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.607658633 (81h20m30.30522694s) [noise=true , address=89.149.201.147:4020  , piece_id=PPRI2ITIZY7Z6UW4S5CDATQCZDFJYOQKRI7HBTHPF5LLHEZ6ZZHQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.607672208 (81h20m30.305240524s) [seg_pos={0 0}, upload=71386]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:49:42.607978861 (81h20m30.305547166s) [noise=true , address=185.167.204.206:4047 , piece_id=EZMV2FA4LHPHFPC7LKHUI6XHUMXIEQXJKZTDGX3AC2JDJDIVQ7OA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF): protocol: read tcp 5.161.89.252:45946->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec  9 00:49:42.607986555 (81h20m30.305554861s) [noise=true , address=185.167.204.206:4047 , piece_id=EZMV2FA4LHPHFPC7LKHUI6XHUMXIEQXJKZTDGX3AC2JDJDIVQ7OA, seg_pos={0 0}, upload=71386]: Long tail cancellation due to optimal threshold
Dec  9 00:49:42.608031139 (81h20m30.305599455s) [noise=true , address=81.171.14.70:4041    , piece_id=H5RVFNAAKV62Q3MBPMIH7B4Z7NCE6MLLFCPJKYCK7GXTSNQ4VWCA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF
Dec  9 00:49:42.608041749 (81h20m30.305610065s) [noise=true , address=81.171.14.70:4041    , piece_id=H5RVFNAAKV62Q3MBPMIH7B4Z7NCE6MLLFCPJKYCK7GXTSNQ4VWCA, seg_pos={0 0}, upload=71386]: Long tail cancellation due to optimal threshold
Dec  9 00:49:42.608057588 (81h20m30.305625904s) [seg_pos={0 0}, upload=71386]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:49:42.608144800 (81h20m30.305713107s) [upload=71386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:49:42.608149019 (81h20m30.305717335s) [upload=71386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:49:42.759877479 (81h20m30.457445815s) [upload=71386]: Done uploading segments...
Dec  9 00:49:42.759900101 (81h20m30.457468436s) [upload=71386]: Upload finished. err: <nil>
Duration: 4.335903536s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
15 out of 60 is failed (threshold=3) [..X.X.X..XX...X...X.........X........X...XX.....XX..X...X...]
duration: 
7.178171293s
trace: 
https://jaeger.dev.storj.io/trace/4fb278eb70435bac
FAIL (2025-12-09 00:52:41 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
1386]: Uploading piece...
Dec  9 00:49:40.279070242 (81h20m27.976638578s) [noise=true , address=89.149.201.147:4013  , piece_id=X6OECVN3JAUJZNLH4NRINSKMFQVS362OTESJ2IK4UCCR6FJOH6VQ, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.279256881 (81h20m27.976825217s) [noise=true , address=81.171.14.70:4042    , piece_id=52FDIU53UPFPDDXZ5X7SGTYNOVZNVYHIFOQ5FIGCVDROVDNOXG4Q, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.280157753 (81h20m27.977726089s) [noise=true , address=81.171.14.70:4025    , piece_id=B3WYBPJ33TH3TXHUNVKIA6ENOZHX5XVJREYH4A4FFQWYMVYH44NQ, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.281061351 (81h20m27.978629688s) [noise=true , address=81.171.14.70:4041    , piece_id=H5RVFNAAKV62Q3MBPMIH7B4Z7NCE6MLLFCPJKYCK7GXTSNQ4VWCA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.282015464 (81h20m27.979583799s) [noise=true , address=89.149.201.147:4004  , piece_id=W4ICLXA6IO56RV2D3IWNAVAEAXLJSZHJRS7MM25BXSHR4XPE2NZQ, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.283036091 (81h20m27.980604436s) [noise=true , address=81.171.14.70:4027    , piece_id=UKJJU3M43RKTU46XJGIWPLDYP2DIYXJHZFQAWX5MBD4VM5KXAJUA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.284040155 (81h20m27.981608521s) [noise=true , address=81.171.14.70:4040    , piece_id=7IBI4W4MSSA6CAO57AM77LWTU3OM64HFYC34KUX4LF4IRY4MLG3Q, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.285010618 (81h20m27.982578954s) [noise=true , address=89.149.201.147:4008  , piece_id=D4VV7A5QQU3JAVVMOZCRV3U6D522G3SG5OWLNT5QRB23OCV3SKOA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.285743998 (81h20m27.983312334s) [noise=true , address=81.171.14.70:4044    , piece_id=AHXT2S4D3NHABJT2DXKYWRJB62DKEELHRBOAGWC4AEM7MKNS7IGA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.286395977 (81h20m27.983964312s) [noise=true , address=89.149.201.147:4014  , piece_id=VD3TZ5BIXBGAXD3ZV5MWAYRIZMEDO4DCUCJCU4R3R53COXPMYLJA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.779672892 (81h20m28.477241237s) [upload=71386]: Next returned nil segment
Dec  9 00:49:40.779686758 (81h20m28.477255093s) [upload=71386]: Waiting for error group managing segments...
Dec  9 00:49:40.981907347 (81h20m28.679475682s) [noise=true , address=185.167.204.205:4011 , piece_id=CU3PXMSY3G7OCII3F4A6GGFL4O3VSTCCCBTCXNM7NH5N4KDIUGGA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:40.984516341 (81h20m28.682084676s) [noise=true , address=89.149.201.147:4005  , piece_id=Q7MV65E2UQNBW4XQTT2P625LA4F3I5IEDY2DXSP6Q4RKDZGQR6DA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.003457703 (81h20m28.701026059s) [noise=true , address=89.149.201.147:4012  , piece_id=GOTKYVUT5AC3SEBU67375YCOBR5YWBWTD26AIB3PPBJI4C7Z63EQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.022780378 (81h20m28.720348714s) [noise=true , address=185.167.204.205:4032 , piece_id=2NX73TYG7G7RGN77MOPIJLY4TSXLBLZEE77OUJIWMQ2DUA4NFTBA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.066782243 (81h20m28.76435058s) [noise=true , address=89.149.201.147:4014  , piece_id=VD3TZ5BIXBGAXD3ZV5MWAYRIZMEDO4DCUCJCU4R3R53COXPMYLJA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.311820005 (81h20m29.009388342s) [noise=true , address=89.149.201.147:4024  , piece_id=WUTQW6KVB66UJL2RFANVIIEFCTIH2QZVUXTMR5ETDPRRS7MQLCEA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.315447812 (81h20m29.013016148s) [noise=true , address=89.149.201.147:4009  , piece_id=63IERT7FJBLKMPVENWK6ROLWUQCZAIBIEXSRNJ7AFRRBHAY3YKKA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.340938248 (81h20m29.038506585s) [noise=true , address=89.149.201.147:4023  , piece_id=PXZZMT5ZPKEG56NFWYCLNCAD3ZATNYIOZZADBD52RQJ7GMIQ5GPA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.356422684 (81h20m29.053991s) [noise=true , address=185.167.204.205:4023 , piece_id=ROMHL3T47W43S4ANERJUEINXYOTB7W3YIUAB2YMRG6TTQ6LFGCYQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.379906271 (81h20m29.077474597s) [noise=true , address=89.149.201.147:4008  , piece_id=D4VV7A5QQU3JAVVMOZCRV3U6D522G3SG5OWLNT5QRB23OCV3SKOA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.386907360 (81h20m29.084475666s) [noise=true , address=89.149.201.147:4004  , piece_id=W4ICLXA6IO56RV2D3IWNAVAEAXLJSZHJRS7MM25BXSHR4XPE2NZQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.401040851 (81h20m29.098609157s) [noise=true , address=185.167.204.205:4033 , piece_id=6YTJV2ZNAZOZ3NJ3SKQND4JYWBOMGOJOCWVUXEOE2AJS6WZRDAQQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.411632767 (81h20m29.109201073s) [noise=true , address=89.149.201.147:4002  , piece_id=4HULUQFHIMM2FFXC4GCKZZHWBI45SVGRC2LQEYNRT7ZG243QGDBA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.424517796 (81h20m29.122086102s) [noise=true , address=185.167.204.205:4013 , piece_id=HBUNHYDLKZ4VX3WZ25JZFQEFVT2WXGLAFEPDGMAH5F62GNOLLVYQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.519211023 (81h20m29.216779339s) [noise=true , address=185.167.204.205:4030 , piece_id=EGUVNY7YRDHKYLG72ZEIOQTJGQWMRD6PGHA6WBNZKBN4Y55DWRUA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.528641941 (81h20m29.226210257s) [noise=true , address=81.171.14.70:4040    , piece_id=7IBI4W4MSSA6CAO57AM77LWTU3OM64HFYC34KUX4LF4IRY4MLG3Q, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.566414190 (81h20m29.263982516s) [noise=true , address=89.149.201.147:4011  , piece_id=KT3PJGSOOH63TVSYQ7GC6RDRV3TFK3AZZMAX5TPNWPNFSHVHNZPA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.632970187 (81h20m29.330538523s) [noise=true , address=89.149.201.147:4013  , piece_id=X6OECVN3JAUJZNLH4NRINSKMFQVS362OTESJ2IK4UCCR6FJOH6VQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.705968087 (81h20m29.403536403s) [noise=true , address=81.171.14.70:4044    , piece_id=AHXT2S4D3NHABJT2DXKYWRJB62DKEELHRBOAGWC4AEM7MKNS7IGA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.836703563 (81h20m29.534271879s) [noise=true , address=81.171.14.70:4027    , piece_id=UKJJU3M43RKTU46XJGIWPLDYP2DIYXJHZFQAWX5MBD4VM5KXAJUA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.890198652 (81h20m29.587766988s) [noise=true , address=81.171.14.70:4026    , piece_id=WCHCPU4ZK23RZGJKMEM7AONE3XFJJVBEHDVLFE5GGW3V5YHGBYJA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.974317566 (81h20m29.671885883s) [noise=true , address=89.149.201.147:4010  , piece_id=DSPUC2MGX5DCNQHASDHNNW2F3TACJXNVSDJEFMIA4G6K47WW36FA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.184500881 (81h20m29.882069197s) [noise=true , address=81.171.14.70:4042    , piece_id=52FDIU53UPFPDDXZ5X7SGTYNOVZNVYHIFOQ5FIGCVDROVDNOXG4Q, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.504124550 (81h20m30.201692856s) [noise=true , address=185.167.204.205:4015 , piece_id=MIFYE4R65BH45GNVC2ZLVKVV3NQOCL52CBIVXBGSP6EUQZHI54FA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.535945882 (81h20m30.233514189s) [noise=true , address=81.171.14.70:4025    , piece_id=B3WYBPJ33TH3TXHUNVKIA6ENOZHX5XVJREYH4A4FFQWYMVYH44NQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.607658633 (81h20m30.30522694s) [noise=true , address=89.149.201.147:4020  , piece_id=PPRI2ITIZY7Z6UW4S5CDATQCZDFJYOQKRI7HBTHPF5LLHEZ6ZZHQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.607672208 (81h20m30.305240524s) [seg_pos={0 0}, upload=71386]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:49:42.607978861 (81h20m30.305547166s) [noise=true , address=185.167.204.206:4047 , piece_id=EZMV2FA4LHPHFPC7LKHUI6XHUMXIEQXJKZTDGX3AC2JDJDIVQ7OA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF): protocol: read tcp 5.161.89.252:45946->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec  9 00:49:42.607986555 (81h20m30.305554861s) [noise=true , address=185.167.204.206:4047 , piece_id=EZMV2FA4LHPHFPC7LKHUI6XHUMXIEQXJKZTDGX3AC2JDJDIVQ7OA, seg_pos={0 0}, upload=71386]: Long tail cancellation due to optimal threshold
Dec  9 00:49:42.608031139 (81h20m30.305599455s) [noise=true , address=81.171.14.70:4041    , piece_id=H5RVFNAAKV62Q3MBPMIH7B4Z7NCE6MLLFCPJKYCK7GXTSNQ4VWCA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF
Dec  9 00:49:42.608041749 (81h20m30.305610065s) [noise=true , address=81.171.14.70:4041    , piece_id=H5RVFNAAKV62Q3MBPMIH7B4Z7NCE6MLLFCPJKYCK7GXTSNQ4VWCA, seg_pos={0 0}, upload=71386]: Long tail cancellation due to optimal threshold
Dec  9 00:49:42.608057588 (81h20m30.305625904s) [seg_pos={0 0}, upload=71386]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:49:42.608144800 (81h20m30.305713107s) [upload=71386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:49:42.608149019 (81h20m30.305717335s) [upload=71386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:49:42.759877479 (81h20m30.457445815s) [upload=71386]: Done uploading segments...
Dec  9 00:49:42.759900101 (81h20m30.457468436s) [upload=71386]: Upload finished. err: <nil>
Duration: 7.178189037s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration: 
467.674803ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:52:26 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 467.692867ms core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
15 out of 60 is failed (threshold=3) [...X.X.X..XX...X...X.........X........X...XX.....XX..X...X..]
duration: 
7.200336124s
trace: 
https://jaeger.dev.storj.io/trace/4fb278eb70435bac
FAIL (2025-12-09 00:51:31 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
1386]: Uploading piece...
Dec  9 00:49:40.279070242 (81h20m27.976638578s) [noise=true , address=89.149.201.147:4013  , piece_id=X6OECVN3JAUJZNLH4NRINSKMFQVS362OTESJ2IK4UCCR6FJOH6VQ, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.279256881 (81h20m27.976825217s) [noise=true , address=81.171.14.70:4042    , piece_id=52FDIU53UPFPDDXZ5X7SGTYNOVZNVYHIFOQ5FIGCVDROVDNOXG4Q, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.280157753 (81h20m27.977726089s) [noise=true , address=81.171.14.70:4025    , piece_id=B3WYBPJ33TH3TXHUNVKIA6ENOZHX5XVJREYH4A4FFQWYMVYH44NQ, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.281061351 (81h20m27.978629688s) [noise=true , address=81.171.14.70:4041    , piece_id=H5RVFNAAKV62Q3MBPMIH7B4Z7NCE6MLLFCPJKYCK7GXTSNQ4VWCA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.282015464 (81h20m27.979583799s) [noise=true , address=89.149.201.147:4004  , piece_id=W4ICLXA6IO56RV2D3IWNAVAEAXLJSZHJRS7MM25BXSHR4XPE2NZQ, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.283036091 (81h20m27.980604436s) [noise=true , address=81.171.14.70:4027    , piece_id=UKJJU3M43RKTU46XJGIWPLDYP2DIYXJHZFQAWX5MBD4VM5KXAJUA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.284040155 (81h20m27.981608521s) [noise=true , address=81.171.14.70:4040    , piece_id=7IBI4W4MSSA6CAO57AM77LWTU3OM64HFYC34KUX4LF4IRY4MLG3Q, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.285010618 (81h20m27.982578954s) [noise=true , address=89.149.201.147:4008  , piece_id=D4VV7A5QQU3JAVVMOZCRV3U6D522G3SG5OWLNT5QRB23OCV3SKOA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.285743998 (81h20m27.983312334s) [noise=true , address=81.171.14.70:4044    , piece_id=AHXT2S4D3NHABJT2DXKYWRJB62DKEELHRBOAGWC4AEM7MKNS7IGA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.286395977 (81h20m27.983964312s) [noise=true , address=89.149.201.147:4014  , piece_id=VD3TZ5BIXBGAXD3ZV5MWAYRIZMEDO4DCUCJCU4R3R53COXPMYLJA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.779672892 (81h20m28.477241237s) [upload=71386]: Next returned nil segment
Dec  9 00:49:40.779686758 (81h20m28.477255093s) [upload=71386]: Waiting for error group managing segments...
Dec  9 00:49:40.981907347 (81h20m28.679475682s) [noise=true , address=185.167.204.205:4011 , piece_id=CU3PXMSY3G7OCII3F4A6GGFL4O3VSTCCCBTCXNM7NH5N4KDIUGGA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:40.984516341 (81h20m28.682084676s) [noise=true , address=89.149.201.147:4005  , piece_id=Q7MV65E2UQNBW4XQTT2P625LA4F3I5IEDY2DXSP6Q4RKDZGQR6DA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.003457703 (81h20m28.701026059s) [noise=true , address=89.149.201.147:4012  , piece_id=GOTKYVUT5AC3SEBU67375YCOBR5YWBWTD26AIB3PPBJI4C7Z63EQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.022780378 (81h20m28.720348714s) [noise=true , address=185.167.204.205:4032 , piece_id=2NX73TYG7G7RGN77MOPIJLY4TSXLBLZEE77OUJIWMQ2DUA4NFTBA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.066782243 (81h20m28.76435058s) [noise=true , address=89.149.201.147:4014  , piece_id=VD3TZ5BIXBGAXD3ZV5MWAYRIZMEDO4DCUCJCU4R3R53COXPMYLJA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.311820005 (81h20m29.009388342s) [noise=true , address=89.149.201.147:4024  , piece_id=WUTQW6KVB66UJL2RFANVIIEFCTIH2QZVUXTMR5ETDPRRS7MQLCEA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.315447812 (81h20m29.013016148s) [noise=true , address=89.149.201.147:4009  , piece_id=63IERT7FJBLKMPVENWK6ROLWUQCZAIBIEXSRNJ7AFRRBHAY3YKKA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.340938248 (81h20m29.038506585s) [noise=true , address=89.149.201.147:4023  , piece_id=PXZZMT5ZPKEG56NFWYCLNCAD3ZATNYIOZZADBD52RQJ7GMIQ5GPA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.356422684 (81h20m29.053991s) [noise=true , address=185.167.204.205:4023 , piece_id=ROMHL3T47W43S4ANERJUEINXYOTB7W3YIUAB2YMRG6TTQ6LFGCYQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.379906271 (81h20m29.077474597s) [noise=true , address=89.149.201.147:4008  , piece_id=D4VV7A5QQU3JAVVMOZCRV3U6D522G3SG5OWLNT5QRB23OCV3SKOA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.386907360 (81h20m29.084475666s) [noise=true , address=89.149.201.147:4004  , piece_id=W4ICLXA6IO56RV2D3IWNAVAEAXLJSZHJRS7MM25BXSHR4XPE2NZQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.401040851 (81h20m29.098609157s) [noise=true , address=185.167.204.205:4033 , piece_id=6YTJV2ZNAZOZ3NJ3SKQND4JYWBOMGOJOCWVUXEOE2AJS6WZRDAQQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.411632767 (81h20m29.109201073s) [noise=true , address=89.149.201.147:4002  , piece_id=4HULUQFHIMM2FFXC4GCKZZHWBI45SVGRC2LQEYNRT7ZG243QGDBA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.424517796 (81h20m29.122086102s) [noise=true , address=185.167.204.205:4013 , piece_id=HBUNHYDLKZ4VX3WZ25JZFQEFVT2WXGLAFEPDGMAH5F62GNOLLVYQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.519211023 (81h20m29.216779339s) [noise=true , address=185.167.204.205:4030 , piece_id=EGUVNY7YRDHKYLG72ZEIOQTJGQWMRD6PGHA6WBNZKBN4Y55DWRUA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.528641941 (81h20m29.226210257s) [noise=true , address=81.171.14.70:4040    , piece_id=7IBI4W4MSSA6CAO57AM77LWTU3OM64HFYC34KUX4LF4IRY4MLG3Q, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.566414190 (81h20m29.263982516s) [noise=true , address=89.149.201.147:4011  , piece_id=KT3PJGSOOH63TVSYQ7GC6RDRV3TFK3AZZMAX5TPNWPNFSHVHNZPA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.632970187 (81h20m29.330538523s) [noise=true , address=89.149.201.147:4013  , piece_id=X6OECVN3JAUJZNLH4NRINSKMFQVS362OTESJ2IK4UCCR6FJOH6VQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.705968087 (81h20m29.403536403s) [noise=true , address=81.171.14.70:4044    , piece_id=AHXT2S4D3NHABJT2DXKYWRJB62DKEELHRBOAGWC4AEM7MKNS7IGA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.836703563 (81h20m29.534271879s) [noise=true , address=81.171.14.70:4027    , piece_id=UKJJU3M43RKTU46XJGIWPLDYP2DIYXJHZFQAWX5MBD4VM5KXAJUA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.890198652 (81h20m29.587766988s) [noise=true , address=81.171.14.70:4026    , piece_id=WCHCPU4ZK23RZGJKMEM7AONE3XFJJVBEHDVLFE5GGW3V5YHGBYJA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.974317566 (81h20m29.671885883s) [noise=true , address=89.149.201.147:4010  , piece_id=DSPUC2MGX5DCNQHASDHNNW2F3TACJXNVSDJEFMIA4G6K47WW36FA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.184500881 (81h20m29.882069197s) [noise=true , address=81.171.14.70:4042    , piece_id=52FDIU53UPFPDDXZ5X7SGTYNOVZNVYHIFOQ5FIGCVDROVDNOXG4Q, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.504124550 (81h20m30.201692856s) [noise=true , address=185.167.204.205:4015 , piece_id=MIFYE4R65BH45GNVC2ZLVKVV3NQOCL52CBIVXBGSP6EUQZHI54FA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.535945882 (81h20m30.233514189s) [noise=true , address=81.171.14.70:4025    , piece_id=B3WYBPJ33TH3TXHUNVKIA6ENOZHX5XVJREYH4A4FFQWYMVYH44NQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.607658633 (81h20m30.30522694s) [noise=true , address=89.149.201.147:4020  , piece_id=PPRI2ITIZY7Z6UW4S5CDATQCZDFJYOQKRI7HBTHPF5LLHEZ6ZZHQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.607672208 (81h20m30.305240524s) [seg_pos={0 0}, upload=71386]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:49:42.607978861 (81h20m30.305547166s) [noise=true , address=185.167.204.206:4047 , piece_id=EZMV2FA4LHPHFPC7LKHUI6XHUMXIEQXJKZTDGX3AC2JDJDIVQ7OA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF): protocol: read tcp 5.161.89.252:45946->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec  9 00:49:42.607986555 (81h20m30.305554861s) [noise=true , address=185.167.204.206:4047 , piece_id=EZMV2FA4LHPHFPC7LKHUI6XHUMXIEQXJKZTDGX3AC2JDJDIVQ7OA, seg_pos={0 0}, upload=71386]: Long tail cancellation due to optimal threshold
Dec  9 00:49:42.608031139 (81h20m30.305599455s) [noise=true , address=81.171.14.70:4041    , piece_id=H5RVFNAAKV62Q3MBPMIH7B4Z7NCE6MLLFCPJKYCK7GXTSNQ4VWCA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF
Dec  9 00:49:42.608041749 (81h20m30.305610065s) [noise=true , address=81.171.14.70:4041    , piece_id=H5RVFNAAKV62Q3MBPMIH7B4Z7NCE6MLLFCPJKYCK7GXTSNQ4VWCA, seg_pos={0 0}, upload=71386]: Long tail cancellation due to optimal threshold
Dec  9 00:49:42.608057588 (81h20m30.305625904s) [seg_pos={0 0}, upload=71386]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:49:42.608144800 (81h20m30.305713107s) [upload=71386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:49:42.608149019 (81h20m30.305717335s) [upload=71386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:49:42.759877479 (81h20m30.457445815s) [upload=71386]: Done uploading segments...
Dec  9 00:49:42.759900101 (81h20m30.457468436s) [upload=71386]: Upload finished. err: <nil>
Duration: 7.200357523s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...............................................X............]
duration: 
518.090897ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:51:15 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 518.107859ms core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
15 out of 60 is failed (threshold=3) [....X.X.X..XX...X...X.........X........X...XX.....XX..X...X.]
duration: 
4.001949542s
trace: 
https://jaeger.dev.storj.io/trace/4fb278eb70435bac
FAIL (2025-12-09 00:50:56 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
1386]: Uploading piece...
Dec  9 00:49:40.279070242 (81h20m27.976638578s) [noise=true , address=89.149.201.147:4013  , piece_id=X6OECVN3JAUJZNLH4NRINSKMFQVS362OTESJ2IK4UCCR6FJOH6VQ, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.279256881 (81h20m27.976825217s) [noise=true , address=81.171.14.70:4042    , piece_id=52FDIU53UPFPDDXZ5X7SGTYNOVZNVYHIFOQ5FIGCVDROVDNOXG4Q, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.280157753 (81h20m27.977726089s) [noise=true , address=81.171.14.70:4025    , piece_id=B3WYBPJ33TH3TXHUNVKIA6ENOZHX5XVJREYH4A4FFQWYMVYH44NQ, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.281061351 (81h20m27.978629688s) [noise=true , address=81.171.14.70:4041    , piece_id=H5RVFNAAKV62Q3MBPMIH7B4Z7NCE6MLLFCPJKYCK7GXTSNQ4VWCA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.282015464 (81h20m27.979583799s) [noise=true , address=89.149.201.147:4004  , piece_id=W4ICLXA6IO56RV2D3IWNAVAEAXLJSZHJRS7MM25BXSHR4XPE2NZQ, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.283036091 (81h20m27.980604436s) [noise=true , address=81.171.14.70:4027    , piece_id=UKJJU3M43RKTU46XJGIWPLDYP2DIYXJHZFQAWX5MBD4VM5KXAJUA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.284040155 (81h20m27.981608521s) [noise=true , address=81.171.14.70:4040    , piece_id=7IBI4W4MSSA6CAO57AM77LWTU3OM64HFYC34KUX4LF4IRY4MLG3Q, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.285010618 (81h20m27.982578954s) [noise=true , address=89.149.201.147:4008  , piece_id=D4VV7A5QQU3JAVVMOZCRV3U6D522G3SG5OWLNT5QRB23OCV3SKOA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.285743998 (81h20m27.983312334s) [noise=true , address=81.171.14.70:4044    , piece_id=AHXT2S4D3NHABJT2DXKYWRJB62DKEELHRBOAGWC4AEM7MKNS7IGA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.286395977 (81h20m27.983964312s) [noise=true , address=89.149.201.147:4014  , piece_id=VD3TZ5BIXBGAXD3ZV5MWAYRIZMEDO4DCUCJCU4R3R53COXPMYLJA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.779672892 (81h20m28.477241237s) [upload=71386]: Next returned nil segment
Dec  9 00:49:40.779686758 (81h20m28.477255093s) [upload=71386]: Waiting for error group managing segments...
Dec  9 00:49:40.981907347 (81h20m28.679475682s) [noise=true , address=185.167.204.205:4011 , piece_id=CU3PXMSY3G7OCII3F4A6GGFL4O3VSTCCCBTCXNM7NH5N4KDIUGGA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:40.984516341 (81h20m28.682084676s) [noise=true , address=89.149.201.147:4005  , piece_id=Q7MV65E2UQNBW4XQTT2P625LA4F3I5IEDY2DXSP6Q4RKDZGQR6DA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.003457703 (81h20m28.701026059s) [noise=true , address=89.149.201.147:4012  , piece_id=GOTKYVUT5AC3SEBU67375YCOBR5YWBWTD26AIB3PPBJI4C7Z63EQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.022780378 (81h20m28.720348714s) [noise=true , address=185.167.204.205:4032 , piece_id=2NX73TYG7G7RGN77MOPIJLY4TSXLBLZEE77OUJIWMQ2DUA4NFTBA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.066782243 (81h20m28.76435058s) [noise=true , address=89.149.201.147:4014  , piece_id=VD3TZ5BIXBGAXD3ZV5MWAYRIZMEDO4DCUCJCU4R3R53COXPMYLJA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.311820005 (81h20m29.009388342s) [noise=true , address=89.149.201.147:4024  , piece_id=WUTQW6KVB66UJL2RFANVIIEFCTIH2QZVUXTMR5ETDPRRS7MQLCEA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.315447812 (81h20m29.013016148s) [noise=true , address=89.149.201.147:4009  , piece_id=63IERT7FJBLKMPVENWK6ROLWUQCZAIBIEXSRNJ7AFRRBHAY3YKKA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.340938248 (81h20m29.038506585s) [noise=true , address=89.149.201.147:4023  , piece_id=PXZZMT5ZPKEG56NFWYCLNCAD3ZATNYIOZZADBD52RQJ7GMIQ5GPA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.356422684 (81h20m29.053991s) [noise=true , address=185.167.204.205:4023 , piece_id=ROMHL3T47W43S4ANERJUEINXYOTB7W3YIUAB2YMRG6TTQ6LFGCYQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.379906271 (81h20m29.077474597s) [noise=true , address=89.149.201.147:4008  , piece_id=D4VV7A5QQU3JAVVMOZCRV3U6D522G3SG5OWLNT5QRB23OCV3SKOA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.386907360 (81h20m29.084475666s) [noise=true , address=89.149.201.147:4004  , piece_id=W4ICLXA6IO56RV2D3IWNAVAEAXLJSZHJRS7MM25BXSHR4XPE2NZQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.401040851 (81h20m29.098609157s) [noise=true , address=185.167.204.205:4033 , piece_id=6YTJV2ZNAZOZ3NJ3SKQND4JYWBOMGOJOCWVUXEOE2AJS6WZRDAQQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.411632767 (81h20m29.109201073s) [noise=true , address=89.149.201.147:4002  , piece_id=4HULUQFHIMM2FFXC4GCKZZHWBI45SVGRC2LQEYNRT7ZG243QGDBA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.424517796 (81h20m29.122086102s) [noise=true , address=185.167.204.205:4013 , piece_id=HBUNHYDLKZ4VX3WZ25JZFQEFVT2WXGLAFEPDGMAH5F62GNOLLVYQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.519211023 (81h20m29.216779339s) [noise=true , address=185.167.204.205:4030 , piece_id=EGUVNY7YRDHKYLG72ZEIOQTJGQWMRD6PGHA6WBNZKBN4Y55DWRUA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.528641941 (81h20m29.226210257s) [noise=true , address=81.171.14.70:4040    , piece_id=7IBI4W4MSSA6CAO57AM77LWTU3OM64HFYC34KUX4LF4IRY4MLG3Q, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.566414190 (81h20m29.263982516s) [noise=true , address=89.149.201.147:4011  , piece_id=KT3PJGSOOH63TVSYQ7GC6RDRV3TFK3AZZMAX5TPNWPNFSHVHNZPA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.632970187 (81h20m29.330538523s) [noise=true , address=89.149.201.147:4013  , piece_id=X6OECVN3JAUJZNLH4NRINSKMFQVS362OTESJ2IK4UCCR6FJOH6VQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.705968087 (81h20m29.403536403s) [noise=true , address=81.171.14.70:4044    , piece_id=AHXT2S4D3NHABJT2DXKYWRJB62DKEELHRBOAGWC4AEM7MKNS7IGA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.836703563 (81h20m29.534271879s) [noise=true , address=81.171.14.70:4027    , piece_id=UKJJU3M43RKTU46XJGIWPLDYP2DIYXJHZFQAWX5MBD4VM5KXAJUA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.890198652 (81h20m29.587766988s) [noise=true , address=81.171.14.70:4026    , piece_id=WCHCPU4ZK23RZGJKMEM7AONE3XFJJVBEHDVLFE5GGW3V5YHGBYJA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.974317566 (81h20m29.671885883s) [noise=true , address=89.149.201.147:4010  , piece_id=DSPUC2MGX5DCNQHASDHNNW2F3TACJXNVSDJEFMIA4G6K47WW36FA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.184500881 (81h20m29.882069197s) [noise=true , address=81.171.14.70:4042    , piece_id=52FDIU53UPFPDDXZ5X7SGTYNOVZNVYHIFOQ5FIGCVDROVDNOXG4Q, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.504124550 (81h20m30.201692856s) [noise=true , address=185.167.204.205:4015 , piece_id=MIFYE4R65BH45GNVC2ZLVKVV3NQOCL52CBIVXBGSP6EUQZHI54FA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.535945882 (81h20m30.233514189s) [noise=true , address=81.171.14.70:4025    , piece_id=B3WYBPJ33TH3TXHUNVKIA6ENOZHX5XVJREYH4A4FFQWYMVYH44NQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.607658633 (81h20m30.30522694s) [noise=true , address=89.149.201.147:4020  , piece_id=PPRI2ITIZY7Z6UW4S5CDATQCZDFJYOQKRI7HBTHPF5LLHEZ6ZZHQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.607672208 (81h20m30.305240524s) [seg_pos={0 0}, upload=71386]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:49:42.607978861 (81h20m30.305547166s) [noise=true , address=185.167.204.206:4047 , piece_id=EZMV2FA4LHPHFPC7LKHUI6XHUMXIEQXJKZTDGX3AC2JDJDIVQ7OA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF): protocol: read tcp 5.161.89.252:45946->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec  9 00:49:42.607986555 (81h20m30.305554861s) [noise=true , address=185.167.204.206:4047 , piece_id=EZMV2FA4LHPHFPC7LKHUI6XHUMXIEQXJKZTDGX3AC2JDJDIVQ7OA, seg_pos={0 0}, upload=71386]: Long tail cancellation due to optimal threshold
Dec  9 00:49:42.608031139 (81h20m30.305599455s) [noise=true , address=81.171.14.70:4041    , piece_id=H5RVFNAAKV62Q3MBPMIH7B4Z7NCE6MLLFCPJKYCK7GXTSNQ4VWCA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF
Dec  9 00:49:42.608041749 (81h20m30.305610065s) [noise=true , address=81.171.14.70:4041    , piece_id=H5RVFNAAKV62Q3MBPMIH7B4Z7NCE6MLLFCPJKYCK7GXTSNQ4VWCA, seg_pos={0 0}, upload=71386]: Long tail cancellation due to optimal threshold
Dec  9 00:49:42.608057588 (81h20m30.305625904s) [seg_pos={0 0}, upload=71386]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:49:42.608144800 (81h20m30.305713107s) [upload=71386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:49:42.608149019 (81h20m30.305717335s) [upload=71386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:49:42.759877479 (81h20m30.457445815s) [upload=71386]: Done uploading segments...
Dec  9 00:49:42.759900101 (81h20m30.457468436s) [upload=71386]: Upload finished. err: <nil>
Duration: 4.001992613s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
15 out of 60 is failed (threshold=3) [.....X.X.X..XX...X...X.........X........X...XX.....XX..X...X]
duration: 
57.376872577s
trace: 
https://jaeger.dev.storj.io/trace/4fb278eb70435bac
FAIL (2025-12-09 00:50:37 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
1386]: Uploading piece...
Dec  9 00:49:40.279070242 (81h20m27.976638578s) [noise=true , address=89.149.201.147:4013  , piece_id=X6OECVN3JAUJZNLH4NRINSKMFQVS362OTESJ2IK4UCCR6FJOH6VQ, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.279256881 (81h20m27.976825217s) [noise=true , address=81.171.14.70:4042    , piece_id=52FDIU53UPFPDDXZ5X7SGTYNOVZNVYHIFOQ5FIGCVDROVDNOXG4Q, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.280157753 (81h20m27.977726089s) [noise=true , address=81.171.14.70:4025    , piece_id=B3WYBPJ33TH3TXHUNVKIA6ENOZHX5XVJREYH4A4FFQWYMVYH44NQ, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.281061351 (81h20m27.978629688s) [noise=true , address=81.171.14.70:4041    , piece_id=H5RVFNAAKV62Q3MBPMIH7B4Z7NCE6MLLFCPJKYCK7GXTSNQ4VWCA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.282015464 (81h20m27.979583799s) [noise=true , address=89.149.201.147:4004  , piece_id=W4ICLXA6IO56RV2D3IWNAVAEAXLJSZHJRS7MM25BXSHR4XPE2NZQ, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.283036091 (81h20m27.980604436s) [noise=true , address=81.171.14.70:4027    , piece_id=UKJJU3M43RKTU46XJGIWPLDYP2DIYXJHZFQAWX5MBD4VM5KXAJUA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.284040155 (81h20m27.981608521s) [noise=true , address=81.171.14.70:4040    , piece_id=7IBI4W4MSSA6CAO57AM77LWTU3OM64HFYC34KUX4LF4IRY4MLG3Q, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.285010618 (81h20m27.982578954s) [noise=true , address=89.149.201.147:4008  , piece_id=D4VV7A5QQU3JAVVMOZCRV3U6D522G3SG5OWLNT5QRB23OCV3SKOA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.285743998 (81h20m27.983312334s) [noise=true , address=81.171.14.70:4044    , piece_id=AHXT2S4D3NHABJT2DXKYWRJB62DKEELHRBOAGWC4AEM7MKNS7IGA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.286395977 (81h20m27.983964312s) [noise=true , address=89.149.201.147:4014  , piece_id=VD3TZ5BIXBGAXD3ZV5MWAYRIZMEDO4DCUCJCU4R3R53COXPMYLJA, seg_pos={0 0}, upload=71386]: Uploading piece...
Dec  9 00:49:40.779672892 (81h20m28.477241237s) [upload=71386]: Next returned nil segment
Dec  9 00:49:40.779686758 (81h20m28.477255093s) [upload=71386]: Waiting for error group managing segments...
Dec  9 00:49:40.981907347 (81h20m28.679475682s) [noise=true , address=185.167.204.205:4011 , piece_id=CU3PXMSY3G7OCII3F4A6GGFL4O3VSTCCCBTCXNM7NH5N4KDIUGGA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:40.984516341 (81h20m28.682084676s) [noise=true , address=89.149.201.147:4005  , piece_id=Q7MV65E2UQNBW4XQTT2P625LA4F3I5IEDY2DXSP6Q4RKDZGQR6DA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.003457703 (81h20m28.701026059s) [noise=true , address=89.149.201.147:4012  , piece_id=GOTKYVUT5AC3SEBU67375YCOBR5YWBWTD26AIB3PPBJI4C7Z63EQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.022780378 (81h20m28.720348714s) [noise=true , address=185.167.204.205:4032 , piece_id=2NX73TYG7G7RGN77MOPIJLY4TSXLBLZEE77OUJIWMQ2DUA4NFTBA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.066782243 (81h20m28.76435058s) [noise=true , address=89.149.201.147:4014  , piece_id=VD3TZ5BIXBGAXD3ZV5MWAYRIZMEDO4DCUCJCU4R3R53COXPMYLJA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.311820005 (81h20m29.009388342s) [noise=true , address=89.149.201.147:4024  , piece_id=WUTQW6KVB66UJL2RFANVIIEFCTIH2QZVUXTMR5ETDPRRS7MQLCEA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.315447812 (81h20m29.013016148s) [noise=true , address=89.149.201.147:4009  , piece_id=63IERT7FJBLKMPVENWK6ROLWUQCZAIBIEXSRNJ7AFRRBHAY3YKKA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.340938248 (81h20m29.038506585s) [noise=true , address=89.149.201.147:4023  , piece_id=PXZZMT5ZPKEG56NFWYCLNCAD3ZATNYIOZZADBD52RQJ7GMIQ5GPA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.356422684 (81h20m29.053991s) [noise=true , address=185.167.204.205:4023 , piece_id=ROMHL3T47W43S4ANERJUEINXYOTB7W3YIUAB2YMRG6TTQ6LFGCYQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.379906271 (81h20m29.077474597s) [noise=true , address=89.149.201.147:4008  , piece_id=D4VV7A5QQU3JAVVMOZCRV3U6D522G3SG5OWLNT5QRB23OCV3SKOA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.386907360 (81h20m29.084475666s) [noise=true , address=89.149.201.147:4004  , piece_id=W4ICLXA6IO56RV2D3IWNAVAEAXLJSZHJRS7MM25BXSHR4XPE2NZQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.401040851 (81h20m29.098609157s) [noise=true , address=185.167.204.205:4033 , piece_id=6YTJV2ZNAZOZ3NJ3SKQND4JYWBOMGOJOCWVUXEOE2AJS6WZRDAQQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.411632767 (81h20m29.109201073s) [noise=true , address=89.149.201.147:4002  , piece_id=4HULUQFHIMM2FFXC4GCKZZHWBI45SVGRC2LQEYNRT7ZG243QGDBA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.424517796 (81h20m29.122086102s) [noise=true , address=185.167.204.205:4013 , piece_id=HBUNHYDLKZ4VX3WZ25JZFQEFVT2WXGLAFEPDGMAH5F62GNOLLVYQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.519211023 (81h20m29.216779339s) [noise=true , address=185.167.204.205:4030 , piece_id=EGUVNY7YRDHKYLG72ZEIOQTJGQWMRD6PGHA6WBNZKBN4Y55DWRUA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.528641941 (81h20m29.226210257s) [noise=true , address=81.171.14.70:4040    , piece_id=7IBI4W4MSSA6CAO57AM77LWTU3OM64HFYC34KUX4LF4IRY4MLG3Q, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.566414190 (81h20m29.263982516s) [noise=true , address=89.149.201.147:4011  , piece_id=KT3PJGSOOH63TVSYQ7GC6RDRV3TFK3AZZMAX5TPNWPNFSHVHNZPA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.632970187 (81h20m29.330538523s) [noise=true , address=89.149.201.147:4013  , piece_id=X6OECVN3JAUJZNLH4NRINSKMFQVS362OTESJ2IK4UCCR6FJOH6VQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.705968087 (81h20m29.403536403s) [noise=true , address=81.171.14.70:4044    , piece_id=AHXT2S4D3NHABJT2DXKYWRJB62DKEELHRBOAGWC4AEM7MKNS7IGA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.836703563 (81h20m29.534271879s) [noise=true , address=81.171.14.70:4027    , piece_id=UKJJU3M43RKTU46XJGIWPLDYP2DIYXJHZFQAWX5MBD4VM5KXAJUA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.890198652 (81h20m29.587766988s) [noise=true , address=81.171.14.70:4026    , piece_id=WCHCPU4ZK23RZGJKMEM7AONE3XFJJVBEHDVLFE5GGW3V5YHGBYJA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:41.974317566 (81h20m29.671885883s) [noise=true , address=89.149.201.147:4010  , piece_id=DSPUC2MGX5DCNQHASDHNNW2F3TACJXNVSDJEFMIA4G6K47WW36FA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.184500881 (81h20m29.882069197s) [noise=true , address=81.171.14.70:4042    , piece_id=52FDIU53UPFPDDXZ5X7SGTYNOVZNVYHIFOQ5FIGCVDROVDNOXG4Q, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.504124550 (81h20m30.201692856s) [noise=true , address=185.167.204.205:4015 , piece_id=MIFYE4R65BH45GNVC2ZLVKVV3NQOCL52CBIVXBGSP6EUQZHI54FA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.535945882 (81h20m30.233514189s) [noise=true , address=81.171.14.70:4025    , piece_id=B3WYBPJ33TH3TXHUNVKIA6ENOZHX5XVJREYH4A4FFQWYMVYH44NQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.607658633 (81h20m30.30522694s) [noise=true , address=89.149.201.147:4020  , piece_id=PPRI2ITIZY7Z6UW4S5CDATQCZDFJYOQKRI7HBTHPF5LLHEZ6ZZHQ, seg_pos={0 0}, upload=71386]: Done uploading piece. err: <nil>
Dec  9 00:49:42.607672208 (81h20m30.305240524s) [seg_pos={0 0}, upload=71386]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:49:42.607978861 (81h20m30.305547166s) [noise=true , address=185.167.204.206:4047 , piece_id=EZMV2FA4LHPHFPC7LKHUI6XHUMXIEQXJKZTDGX3AC2JDJDIVQ7OA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M7W4Yno5rMgemSC7nJd42asmZXqUY9cCyY7mtFFHEh8iqAhCF): protocol: read tcp 5.161.89.252:45946->185.167.204.206:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec  9 00:49:42.607986555 (81h20m30.305554861s) [noise=true , address=185.167.204.206:4047 , piece_id=EZMV2FA4LHPHFPC7LKHUI6XHUMXIEQXJKZTDGX3AC2JDJDIVQ7OA, seg_pos={0 0}, upload=71386]: Long tail cancellation due to optimal threshold
Dec  9 00:49:42.608031139 (81h20m30.305599455s) [noise=true , address=81.171.14.70:4041    , piece_id=H5RVFNAAKV62Q3MBPMIH7B4Z7NCE6MLLFCPJKYCK7GXTSNQ4VWCA, seg_pos={0 0}, upload=71386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF
Dec  9 00:49:42.608041749 (81h20m30.305610065s) [noise=true , address=81.171.14.70:4041    , piece_id=H5RVFNAAKV62Q3MBPMIH7B4Z7NCE6MLLFCPJKYCK7GXTSNQ4VWCA, seg_pos={0 0}, upload=71386]: Long tail cancellation due to optimal threshold
Dec  9 00:49:42.608057588 (81h20m30.305625904s) [seg_pos={0 0}, upload=71386]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:49:42.608144800 (81h20m30.305713107s) [upload=71386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:49:42.608149019 (81h20m30.305717335s) [upload=71386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:49:42.759877479 (81h20m30.457445815s) [upload=71386]: Done uploading segments...
Dec  9 00:49:42.759900101 (81h20m30.457468436s) [upload=71386]: Upload finished. err: <nil>
Duration: 57.376916418s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [................................................X...........]
duration: 
395.652101ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:50:31 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 395.662681ms core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
14 out of 60 is failed (threshold=3) [......X.X.X..XX...X...X.........X........X...XX.....XX..X...]
duration: 
14.283162407s
trace: 
https://jaeger.dev.storj.io/trace/6c622d4d20c6b644
FAIL (2025-12-09 00:49:35 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
7.204.205:4010 , piece_id=X3FJD74HK4CRZ3DUCRFABWK6WXK4LL5CYA4QUDA3473EURTLQJPQ, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.869005256 (81h17m26.566573602s) [noise=true , address=81.171.14.70:4038    , piece_id=B5PXMR3XF3I6YHCUBMBVWYNWUL4HGV7FJD4HUWWA3DCHFAYKRSJA, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.869293724 (81h17m26.566862041s) [noise=true , address=185.167.204.205:4025 , piece_id=RIWZNDDHAQDMBRL7HKZRVACFSX2LT4HTUCFL4WLJNHKGYSBKWZ6Q, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.869617469 (81h17m26.567185815s) [noise=true , address=81.171.14.70:4031    , piece_id=K5HVFRGNYLXIKKRQWYRO72RUGITIJJ6WTTKIDGXJELIALQVGE6DQ, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.869651363 (81h17m26.567219679s) [noise=true , address=89.149.201.147:4020  , piece_id=QGMAYB3ET52LFF3FWSSYVDNWMMFGWP4JMM5KSPW26BAJJUWGBUMA, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.870016183 (81h17m26.567584509s) [noise=true , address=81.171.14.70:4039    , piece_id=WVYS3AHHBZ25BVSH5CECJLM2KWKUYO4GMTJR2X2YZXC4JNTSXSKQ, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.870161465 (81h17m26.567729801s) [noise=true , address=185.167.204.205:4012 , piece_id=M5NCFRWUYK43S3WS2JRYHO6WB7WHGY22LJHH7WREVOELTIUY2C3Q, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.870400913 (81h17m26.567969229s) [noise=true , address=89.149.201.147:4011  , piece_id=Q3MDCZHEG62WLKL53OMY4PY6M2ZIJLBVRJPOZBYYWZ3JMUBTNTIQ, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.870648546 (81h17m26.568216881s) [noise=true , address=89.149.201.147:4010  , piece_id=JCVEDQ5TNKGZC4DMY3PNS25LJBEZXY4Q43KMTLYS7SQWLLDCCTSQ, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.870748171 (81h17m26.568316477s) [noise=true , address=81.171.14.70:4043    , piece_id=ZQMQYMGFEW5FLAAZKGHRUS2RMTQ3BEK2RKNRBC5EWPRN6K6J6AGA, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.871070504 (81h17m26.56863882s) [noise=true , address=89.149.201.147:4012  , piece_id=O4Y4FSA64I7DBVYBKFZ5DZ67PM5V57V2SEVPMD6D6CKOVXNXNHTA, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:39.373856290 (81h17m27.071424627s) [upload=71344]: Next returned nil segment
Dec  9 00:46:39.373868153 (81h17m27.071436489s) [upload=71344]: Waiting for error group managing segments...
Dec  9 00:46:39.617992980 (81h17m27.315561316s) [noise=true , address=81.171.14.70:4031    , piece_id=K5HVFRGNYLXIKKRQWYRO72RUGITIJJ6WTTKIDGXJELIALQVGE6DQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.632102176 (81h17m27.329670513s) [noise=true , address=81.171.14.70:4044    , piece_id=N6MSTK2UKDT2USAZXGRNWXEEPNZ2R4DCLXUZMG7LDPDE7ZVQKNLQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.678894795 (81h17m27.376463101s) [noise=true , address=89.149.201.147:4011  , piece_id=Q3MDCZHEG62WLKL53OMY4PY6M2ZIJLBVRJPOZBYYWZ3JMUBTNTIQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.791701309 (81h17m27.489269645s) [noise=true , address=81.171.14.70:4038    , piece_id=B5PXMR3XF3I6YHCUBMBVWYNWUL4HGV7FJD4HUWWA3DCHFAYKRSJA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.839320061 (81h17m27.536888407s) [noise=true , address=81.171.14.70:4026    , piece_id=J7BSURZGAZ72S5NILWUMEWKZHINOU6JGLN2IUMUX3ERLENSCS5CQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.899821609 (81h17m27.597389954s) [noise=true , address=185.167.204.205:4010 , piece_id=X3FJD74HK4CRZ3DUCRFABWK6WXK4LL5CYA4QUDA3473EURTLQJPQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.948881432 (81h17m27.646449768s) [noise=true , address=185.167.204.205:4012 , piece_id=M5NCFRWUYK43S3WS2JRYHO6WB7WHGY22LJHH7WREVOELTIUY2C3Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.965711181 (81h17m27.663279517s) [noise=true , address=185.167.204.206:4065 , piece_id=6T5SHWDUBKNAPWZP3MRKMLWNCQUUQTQDOIAGL2NLF6BSNDQRQRZQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.015204875 (81h17m27.712773222s) [noise=true , address=81.171.14.70:4043    , piece_id=ZQMQYMGFEW5FLAAZKGHRUS2RMTQ3BEK2RKNRBC5EWPRN6K6J6AGA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.047249966 (81h17m27.744818311s) [noise=true , address=81.171.14.70:4034    , piece_id=JXQW54F2FJ523LWKD3UXVIJCXU2ASPVS4HORUSNA6QH2NZMIJZTQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.047813678 (81h17m27.745382025s) [noise=true , address=89.149.201.147:4010  , piece_id=JCVEDQ5TNKGZC4DMY3PNS25LJBEZXY4Q43KMTLYS7SQWLLDCCTSQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.103102218 (81h17m27.800670534s) [noise=true , address=185.167.204.206:4062 , piece_id=3BRNN272AGNCVPJITWYABRL7E335SXIIGD67HN4U5TXRJ5MIOHUA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.148193038 (81h17m27.845761354s) [noise=true , address=185.167.204.206:4058 , piece_id=UGGHOSQIJEWNXIWQKTKX2RNDYLCX6XH45XFO2ZCIACJYIM7ZJK4Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.295119488 (81h17m27.992687825s) [noise=true , address=185.167.204.206:4038 , piece_id=D2P5Z6L7RXJJW4O3ZR2CR63UECIN4ZUCAQUGYRWQUDD2O6OIP34Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.338952319 (81h17m28.036520625s) [noise=true , address=185.167.204.205:4003 , piece_id=PBM4AUO7CO4VOKF4BHP6PVCB4KDQH57Z3O6BTJ5ZUP34B5ANIIDQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.460976221 (81h17m28.158544567s) [noise=true , address=89.149.201.147:4020  , piece_id=QGMAYB3ET52LFF3FWSSYVDNWMMFGWP4JMM5KSPW26BAJJUWGBUMA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.481412466 (81h17m28.178980802s) [noise=true , address=81.171.14.70:4047    , piece_id=GKMLT7GETX6W5WIOMDFJZKFPQRKH45KAG4AT5GK2W3WMEBOMO6DA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.725250767 (81h17m28.422819083s) [noise=true , address=185.167.204.205:4031 , piece_id=IUYVSNTQEAC4TK4H3AKU2HL3S7OB3MGG2RWOKBRR34KDFFUVFSSA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.769854037 (81h17m28.467422342s) [noise=true , address=81.171.14.70:4025    , piece_id=QRSMR7SP2WN7NLUSLZOAQCKIVH6UMQ4ONYUQMQ4WDHHPKGQLO74Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.786123908 (81h17m28.483692214s) [noise=true , address=185.167.204.205:4035 , piece_id=NLSDKGQ47ZF2NVBPL7PH5ZQUXP5NX3BE5WIUV725UCXNL7ZDIL6Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.991477931 (81h17m28.689046278s) [noise=true , address=185.167.204.206:4061 , piece_id=Z5FCJ2USBPJBN3IXJZNKTGYZD6372VFPILNXI7BWRI2WGW3DCXXQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:41.116505633 (81h17m28.814073939s) [noise=true , address=185.167.204.205:4025 , piece_id=RIWZNDDHAQDMBRL7HKZRVACFSX2LT4HTUCFL4WLJNHKGYSBKWZ6Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:41.199420659 (81h17m28.896988965s) [noise=true , address=81.171.14.70:4037    , piece_id=63NATB62TXRJPWV6DQIQDGQ5ZMODH3JLVHNWO6RNZOEENODM75RA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:41.204718435 (81h17m28.902286741s) [noise=true , address=89.149.201.147:4012  , piece_id=O4Y4FSA64I7DBVYBKFZ5DZ67PM5V57V2SEVPMD6D6CKOVXNXNHTA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:41.240727390 (81h17m28.938295706s) [noise=true , address=185.167.204.205:4023 , piece_id=AMMMVQHQHX5TLVGYCYRUNZ5AB3IQKYFWRFBWK2GYHEJN4NVDOMJA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:42.458234492 (81h17m30.155802828s) [noise=true , address=81.171.14.70:4039    , piece_id=WVYS3AHHBZ25BVSH5CECJLM2KWKUYO4GMTJR2X2YZXC4JNTSXSKQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:42.458256343 (81h17m30.155824689s) [seg_pos={0 0}, upload=71344]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:46:42.458461706 (81h17m30.156030042s) [noise=true , address=185.167.204.205:4002 , piece_id=6YK5N6N56ARA4DND6UZ6FVUQGKTPWEQCHHPRT2CBF4JKRYRSQ5JQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3): protocol: expected piece hash; context canceled; EOF
Dec  9 00:46:42.458471284 (81h17m30.15603962s) [noise=true , address=185.167.204.205:4002 , piece_id=6YK5N6N56ARA4DND6UZ6FVUQGKTPWEQCHHPRT2CBF4JKRYRSQ5JQ, seg_pos={0 0}, upload=71344]: Long tail cancellation due to optimal threshold
Dec  9 00:46:42.458771405 (81h17m30.156339741s) [noise=true , address=185.167.204.206:4050 , piece_id=OTVXXUJZDEU22LSKYIQIWODJNNTWPONKPZVRTU3PAWRTZHRWVY5Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz): protocol: expected piece hash; context canceled; EOF
Dec  9 00:46:42.458789068 (81h17m30.156357414s) [noise=true , address=185.167.204.206:4050 , piece_id=OTVXXUJZDEU22LSKYIQIWODJNNTWPONKPZVRTU3PAWRTZHRWVY5Q, seg_pos={0 0}, upload=71344]: Long tail cancellation due to optimal threshold
Dec  9 00:46:42.458814495 (81h17m30.156382832s) [seg_pos={0 0}, upload=71344]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:46:42.458911497 (81h17m30.156479832s) [upload=71344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:46:42.458917598 (81h17m30.156485934s) [upload=71344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:46:42.642163323 (81h17m30.339731669s) [upload=71344]: Done uploading segments...
Dec  9 00:46:42.642181906 (81h17m30.339750243s) [upload=71344]: Upload finished. err: <nil>
Duration: 14.283180592s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration: 
488.735532ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:49:27 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 488.753867ms core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
14 out of 60 is failed (threshold=3) [.......X.X.X..XX...X...X.........X........X...XX.....XX..X..]
duration: 
8.903969632s
trace: 
https://jaeger.dev.storj.io/trace/6c622d4d20c6b644
FAIL (2025-12-09 00:48:29 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
7.204.205:4010 , piece_id=X3FJD74HK4CRZ3DUCRFABWK6WXK4LL5CYA4QUDA3473EURTLQJPQ, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.869005256 (81h17m26.566573602s) [noise=true , address=81.171.14.70:4038    , piece_id=B5PXMR3XF3I6YHCUBMBVWYNWUL4HGV7FJD4HUWWA3DCHFAYKRSJA, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.869293724 (81h17m26.566862041s) [noise=true , address=185.167.204.205:4025 , piece_id=RIWZNDDHAQDMBRL7HKZRVACFSX2LT4HTUCFL4WLJNHKGYSBKWZ6Q, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.869617469 (81h17m26.567185815s) [noise=true , address=81.171.14.70:4031    , piece_id=K5HVFRGNYLXIKKRQWYRO72RUGITIJJ6WTTKIDGXJELIALQVGE6DQ, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.869651363 (81h17m26.567219679s) [noise=true , address=89.149.201.147:4020  , piece_id=QGMAYB3ET52LFF3FWSSYVDNWMMFGWP4JMM5KSPW26BAJJUWGBUMA, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.870016183 (81h17m26.567584509s) [noise=true , address=81.171.14.70:4039    , piece_id=WVYS3AHHBZ25BVSH5CECJLM2KWKUYO4GMTJR2X2YZXC4JNTSXSKQ, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.870161465 (81h17m26.567729801s) [noise=true , address=185.167.204.205:4012 , piece_id=M5NCFRWUYK43S3WS2JRYHO6WB7WHGY22LJHH7WREVOELTIUY2C3Q, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.870400913 (81h17m26.567969229s) [noise=true , address=89.149.201.147:4011  , piece_id=Q3MDCZHEG62WLKL53OMY4PY6M2ZIJLBVRJPOZBYYWZ3JMUBTNTIQ, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.870648546 (81h17m26.568216881s) [noise=true , address=89.149.201.147:4010  , piece_id=JCVEDQ5TNKGZC4DMY3PNS25LJBEZXY4Q43KMTLYS7SQWLLDCCTSQ, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.870748171 (81h17m26.568316477s) [noise=true , address=81.171.14.70:4043    , piece_id=ZQMQYMGFEW5FLAAZKGHRUS2RMTQ3BEK2RKNRBC5EWPRN6K6J6AGA, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.871070504 (81h17m26.56863882s) [noise=true , address=89.149.201.147:4012  , piece_id=O4Y4FSA64I7DBVYBKFZ5DZ67PM5V57V2SEVPMD6D6CKOVXNXNHTA, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:39.373856290 (81h17m27.071424627s) [upload=71344]: Next returned nil segment
Dec  9 00:46:39.373868153 (81h17m27.071436489s) [upload=71344]: Waiting for error group managing segments...
Dec  9 00:46:39.617992980 (81h17m27.315561316s) [noise=true , address=81.171.14.70:4031    , piece_id=K5HVFRGNYLXIKKRQWYRO72RUGITIJJ6WTTKIDGXJELIALQVGE6DQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.632102176 (81h17m27.329670513s) [noise=true , address=81.171.14.70:4044    , piece_id=N6MSTK2UKDT2USAZXGRNWXEEPNZ2R4DCLXUZMG7LDPDE7ZVQKNLQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.678894795 (81h17m27.376463101s) [noise=true , address=89.149.201.147:4011  , piece_id=Q3MDCZHEG62WLKL53OMY4PY6M2ZIJLBVRJPOZBYYWZ3JMUBTNTIQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.791701309 (81h17m27.489269645s) [noise=true , address=81.171.14.70:4038    , piece_id=B5PXMR3XF3I6YHCUBMBVWYNWUL4HGV7FJD4HUWWA3DCHFAYKRSJA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.839320061 (81h17m27.536888407s) [noise=true , address=81.171.14.70:4026    , piece_id=J7BSURZGAZ72S5NILWUMEWKZHINOU6JGLN2IUMUX3ERLENSCS5CQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.899821609 (81h17m27.597389954s) [noise=true , address=185.167.204.205:4010 , piece_id=X3FJD74HK4CRZ3DUCRFABWK6WXK4LL5CYA4QUDA3473EURTLQJPQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.948881432 (81h17m27.646449768s) [noise=true , address=185.167.204.205:4012 , piece_id=M5NCFRWUYK43S3WS2JRYHO6WB7WHGY22LJHH7WREVOELTIUY2C3Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.965711181 (81h17m27.663279517s) [noise=true , address=185.167.204.206:4065 , piece_id=6T5SHWDUBKNAPWZP3MRKMLWNCQUUQTQDOIAGL2NLF6BSNDQRQRZQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.015204875 (81h17m27.712773222s) [noise=true , address=81.171.14.70:4043    , piece_id=ZQMQYMGFEW5FLAAZKGHRUS2RMTQ3BEK2RKNRBC5EWPRN6K6J6AGA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.047249966 (81h17m27.744818311s) [noise=true , address=81.171.14.70:4034    , piece_id=JXQW54F2FJ523LWKD3UXVIJCXU2ASPVS4HORUSNA6QH2NZMIJZTQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.047813678 (81h17m27.745382025s) [noise=true , address=89.149.201.147:4010  , piece_id=JCVEDQ5TNKGZC4DMY3PNS25LJBEZXY4Q43KMTLYS7SQWLLDCCTSQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.103102218 (81h17m27.800670534s) [noise=true , address=185.167.204.206:4062 , piece_id=3BRNN272AGNCVPJITWYABRL7E335SXIIGD67HN4U5TXRJ5MIOHUA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.148193038 (81h17m27.845761354s) [noise=true , address=185.167.204.206:4058 , piece_id=UGGHOSQIJEWNXIWQKTKX2RNDYLCX6XH45XFO2ZCIACJYIM7ZJK4Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.295119488 (81h17m27.992687825s) [noise=true , address=185.167.204.206:4038 , piece_id=D2P5Z6L7RXJJW4O3ZR2CR63UECIN4ZUCAQUGYRWQUDD2O6OIP34Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.338952319 (81h17m28.036520625s) [noise=true , address=185.167.204.205:4003 , piece_id=PBM4AUO7CO4VOKF4BHP6PVCB4KDQH57Z3O6BTJ5ZUP34B5ANIIDQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.460976221 (81h17m28.158544567s) [noise=true , address=89.149.201.147:4020  , piece_id=QGMAYB3ET52LFF3FWSSYVDNWMMFGWP4JMM5KSPW26BAJJUWGBUMA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.481412466 (81h17m28.178980802s) [noise=true , address=81.171.14.70:4047    , piece_id=GKMLT7GETX6W5WIOMDFJZKFPQRKH45KAG4AT5GK2W3WMEBOMO6DA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.725250767 (81h17m28.422819083s) [noise=true , address=185.167.204.205:4031 , piece_id=IUYVSNTQEAC4TK4H3AKU2HL3S7OB3MGG2RWOKBRR34KDFFUVFSSA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.769854037 (81h17m28.467422342s) [noise=true , address=81.171.14.70:4025    , piece_id=QRSMR7SP2WN7NLUSLZOAQCKIVH6UMQ4ONYUQMQ4WDHHPKGQLO74Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.786123908 (81h17m28.483692214s) [noise=true , address=185.167.204.205:4035 , piece_id=NLSDKGQ47ZF2NVBPL7PH5ZQUXP5NX3BE5WIUV725UCXNL7ZDIL6Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.991477931 (81h17m28.689046278s) [noise=true , address=185.167.204.206:4061 , piece_id=Z5FCJ2USBPJBN3IXJZNKTGYZD6372VFPILNXI7BWRI2WGW3DCXXQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:41.116505633 (81h17m28.814073939s) [noise=true , address=185.167.204.205:4025 , piece_id=RIWZNDDHAQDMBRL7HKZRVACFSX2LT4HTUCFL4WLJNHKGYSBKWZ6Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:41.199420659 (81h17m28.896988965s) [noise=true , address=81.171.14.70:4037    , piece_id=63NATB62TXRJPWV6DQIQDGQ5ZMODH3JLVHNWO6RNZOEENODM75RA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:41.204718435 (81h17m28.902286741s) [noise=true , address=89.149.201.147:4012  , piece_id=O4Y4FSA64I7DBVYBKFZ5DZ67PM5V57V2SEVPMD6D6CKOVXNXNHTA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:41.240727390 (81h17m28.938295706s) [noise=true , address=185.167.204.205:4023 , piece_id=AMMMVQHQHX5TLVGYCYRUNZ5AB3IQKYFWRFBWK2GYHEJN4NVDOMJA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:42.458234492 (81h17m30.155802828s) [noise=true , address=81.171.14.70:4039    , piece_id=WVYS3AHHBZ25BVSH5CECJLM2KWKUYO4GMTJR2X2YZXC4JNTSXSKQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:42.458256343 (81h17m30.155824689s) [seg_pos={0 0}, upload=71344]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:46:42.458461706 (81h17m30.156030042s) [noise=true , address=185.167.204.205:4002 , piece_id=6YK5N6N56ARA4DND6UZ6FVUQGKTPWEQCHHPRT2CBF4JKRYRSQ5JQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3): protocol: expected piece hash; context canceled; EOF
Dec  9 00:46:42.458471284 (81h17m30.15603962s) [noise=true , address=185.167.204.205:4002 , piece_id=6YK5N6N56ARA4DND6UZ6FVUQGKTPWEQCHHPRT2CBF4JKRYRSQ5JQ, seg_pos={0 0}, upload=71344]: Long tail cancellation due to optimal threshold
Dec  9 00:46:42.458771405 (81h17m30.156339741s) [noise=true , address=185.167.204.206:4050 , piece_id=OTVXXUJZDEU22LSKYIQIWODJNNTWPONKPZVRTU3PAWRTZHRWVY5Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz): protocol: expected piece hash; context canceled; EOF
Dec  9 00:46:42.458789068 (81h17m30.156357414s) [noise=true , address=185.167.204.206:4050 , piece_id=OTVXXUJZDEU22LSKYIQIWODJNNTWPONKPZVRTU3PAWRTZHRWVY5Q, seg_pos={0 0}, upload=71344]: Long tail cancellation due to optimal threshold
Dec  9 00:46:42.458814495 (81h17m30.156382832s) [seg_pos={0 0}, upload=71344]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:46:42.458911497 (81h17m30.156479832s) [upload=71344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:46:42.458917598 (81h17m30.156485934s) [upload=71344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:46:42.642163323 (81h17m30.339731669s) [upload=71344]: Done uploading segments...
Dec  9 00:46:42.642181906 (81h17m30.339750243s) [upload=71344]: Upload finished. err: <nil>
Duration: 8.903991814s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration: 
424.023549ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:48:13 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 424.040982ms core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
14 out of 60 is failed (threshold=3) [........X.X.X..XX...X...X.........X........X...XX.....XX..X.]
duration: 
8.896456998s
trace: 
https://jaeger.dev.storj.io/trace/6c622d4d20c6b644
FAIL (2025-12-09 00:47:47 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
7.204.205:4010 , piece_id=X3FJD74HK4CRZ3DUCRFABWK6WXK4LL5CYA4QUDA3473EURTLQJPQ, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.869005256 (81h17m26.566573602s) [noise=true , address=81.171.14.70:4038    , piece_id=B5PXMR3XF3I6YHCUBMBVWYNWUL4HGV7FJD4HUWWA3DCHFAYKRSJA, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.869293724 (81h17m26.566862041s) [noise=true , address=185.167.204.205:4025 , piece_id=RIWZNDDHAQDMBRL7HKZRVACFSX2LT4HTUCFL4WLJNHKGYSBKWZ6Q, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.869617469 (81h17m26.567185815s) [noise=true , address=81.171.14.70:4031    , piece_id=K5HVFRGNYLXIKKRQWYRO72RUGITIJJ6WTTKIDGXJELIALQVGE6DQ, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.869651363 (81h17m26.567219679s) [noise=true , address=89.149.201.147:4020  , piece_id=QGMAYB3ET52LFF3FWSSYVDNWMMFGWP4JMM5KSPW26BAJJUWGBUMA, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.870016183 (81h17m26.567584509s) [noise=true , address=81.171.14.70:4039    , piece_id=WVYS3AHHBZ25BVSH5CECJLM2KWKUYO4GMTJR2X2YZXC4JNTSXSKQ, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.870161465 (81h17m26.567729801s) [noise=true , address=185.167.204.205:4012 , piece_id=M5NCFRWUYK43S3WS2JRYHO6WB7WHGY22LJHH7WREVOELTIUY2C3Q, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.870400913 (81h17m26.567969229s) [noise=true , address=89.149.201.147:4011  , piece_id=Q3MDCZHEG62WLKL53OMY4PY6M2ZIJLBVRJPOZBYYWZ3JMUBTNTIQ, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.870648546 (81h17m26.568216881s) [noise=true , address=89.149.201.147:4010  , piece_id=JCVEDQ5TNKGZC4DMY3PNS25LJBEZXY4Q43KMTLYS7SQWLLDCCTSQ, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.870748171 (81h17m26.568316477s) [noise=true , address=81.171.14.70:4043    , piece_id=ZQMQYMGFEW5FLAAZKGHRUS2RMTQ3BEK2RKNRBC5EWPRN6K6J6AGA, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.871070504 (81h17m26.56863882s) [noise=true , address=89.149.201.147:4012  , piece_id=O4Y4FSA64I7DBVYBKFZ5DZ67PM5V57V2SEVPMD6D6CKOVXNXNHTA, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:39.373856290 (81h17m27.071424627s) [upload=71344]: Next returned nil segment
Dec  9 00:46:39.373868153 (81h17m27.071436489s) [upload=71344]: Waiting for error group managing segments...
Dec  9 00:46:39.617992980 (81h17m27.315561316s) [noise=true , address=81.171.14.70:4031    , piece_id=K5HVFRGNYLXIKKRQWYRO72RUGITIJJ6WTTKIDGXJELIALQVGE6DQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.632102176 (81h17m27.329670513s) [noise=true , address=81.171.14.70:4044    , piece_id=N6MSTK2UKDT2USAZXGRNWXEEPNZ2R4DCLXUZMG7LDPDE7ZVQKNLQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.678894795 (81h17m27.376463101s) [noise=true , address=89.149.201.147:4011  , piece_id=Q3MDCZHEG62WLKL53OMY4PY6M2ZIJLBVRJPOZBYYWZ3JMUBTNTIQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.791701309 (81h17m27.489269645s) [noise=true , address=81.171.14.70:4038    , piece_id=B5PXMR3XF3I6YHCUBMBVWYNWUL4HGV7FJD4HUWWA3DCHFAYKRSJA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.839320061 (81h17m27.536888407s) [noise=true , address=81.171.14.70:4026    , piece_id=J7BSURZGAZ72S5NILWUMEWKZHINOU6JGLN2IUMUX3ERLENSCS5CQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.899821609 (81h17m27.597389954s) [noise=true , address=185.167.204.205:4010 , piece_id=X3FJD74HK4CRZ3DUCRFABWK6WXK4LL5CYA4QUDA3473EURTLQJPQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.948881432 (81h17m27.646449768s) [noise=true , address=185.167.204.205:4012 , piece_id=M5NCFRWUYK43S3WS2JRYHO6WB7WHGY22LJHH7WREVOELTIUY2C3Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.965711181 (81h17m27.663279517s) [noise=true , address=185.167.204.206:4065 , piece_id=6T5SHWDUBKNAPWZP3MRKMLWNCQUUQTQDOIAGL2NLF6BSNDQRQRZQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.015204875 (81h17m27.712773222s) [noise=true , address=81.171.14.70:4043    , piece_id=ZQMQYMGFEW5FLAAZKGHRUS2RMTQ3BEK2RKNRBC5EWPRN6K6J6AGA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.047249966 (81h17m27.744818311s) [noise=true , address=81.171.14.70:4034    , piece_id=JXQW54F2FJ523LWKD3UXVIJCXU2ASPVS4HORUSNA6QH2NZMIJZTQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.047813678 (81h17m27.745382025s) [noise=true , address=89.149.201.147:4010  , piece_id=JCVEDQ5TNKGZC4DMY3PNS25LJBEZXY4Q43KMTLYS7SQWLLDCCTSQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.103102218 (81h17m27.800670534s) [noise=true , address=185.167.204.206:4062 , piece_id=3BRNN272AGNCVPJITWYABRL7E335SXIIGD67HN4U5TXRJ5MIOHUA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.148193038 (81h17m27.845761354s) [noise=true , address=185.167.204.206:4058 , piece_id=UGGHOSQIJEWNXIWQKTKX2RNDYLCX6XH45XFO2ZCIACJYIM7ZJK4Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.295119488 (81h17m27.992687825s) [noise=true , address=185.167.204.206:4038 , piece_id=D2P5Z6L7RXJJW4O3ZR2CR63UECIN4ZUCAQUGYRWQUDD2O6OIP34Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.338952319 (81h17m28.036520625s) [noise=true , address=185.167.204.205:4003 , piece_id=PBM4AUO7CO4VOKF4BHP6PVCB4KDQH57Z3O6BTJ5ZUP34B5ANIIDQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.460976221 (81h17m28.158544567s) [noise=true , address=89.149.201.147:4020  , piece_id=QGMAYB3ET52LFF3FWSSYVDNWMMFGWP4JMM5KSPW26BAJJUWGBUMA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.481412466 (81h17m28.178980802s) [noise=true , address=81.171.14.70:4047    , piece_id=GKMLT7GETX6W5WIOMDFJZKFPQRKH45KAG4AT5GK2W3WMEBOMO6DA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.725250767 (81h17m28.422819083s) [noise=true , address=185.167.204.205:4031 , piece_id=IUYVSNTQEAC4TK4H3AKU2HL3S7OB3MGG2RWOKBRR34KDFFUVFSSA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.769854037 (81h17m28.467422342s) [noise=true , address=81.171.14.70:4025    , piece_id=QRSMR7SP2WN7NLUSLZOAQCKIVH6UMQ4ONYUQMQ4WDHHPKGQLO74Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.786123908 (81h17m28.483692214s) [noise=true , address=185.167.204.205:4035 , piece_id=NLSDKGQ47ZF2NVBPL7PH5ZQUXP5NX3BE5WIUV725UCXNL7ZDIL6Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.991477931 (81h17m28.689046278s) [noise=true , address=185.167.204.206:4061 , piece_id=Z5FCJ2USBPJBN3IXJZNKTGYZD6372VFPILNXI7BWRI2WGW3DCXXQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:41.116505633 (81h17m28.814073939s) [noise=true , address=185.167.204.205:4025 , piece_id=RIWZNDDHAQDMBRL7HKZRVACFSX2LT4HTUCFL4WLJNHKGYSBKWZ6Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:41.199420659 (81h17m28.896988965s) [noise=true , address=81.171.14.70:4037    , piece_id=63NATB62TXRJPWV6DQIQDGQ5ZMODH3JLVHNWO6RNZOEENODM75RA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:41.204718435 (81h17m28.902286741s) [noise=true , address=89.149.201.147:4012  , piece_id=O4Y4FSA64I7DBVYBKFZ5DZ67PM5V57V2SEVPMD6D6CKOVXNXNHTA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:41.240727390 (81h17m28.938295706s) [noise=true , address=185.167.204.205:4023 , piece_id=AMMMVQHQHX5TLVGYCYRUNZ5AB3IQKYFWRFBWK2GYHEJN4NVDOMJA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:42.458234492 (81h17m30.155802828s) [noise=true , address=81.171.14.70:4039    , piece_id=WVYS3AHHBZ25BVSH5CECJLM2KWKUYO4GMTJR2X2YZXC4JNTSXSKQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:42.458256343 (81h17m30.155824689s) [seg_pos={0 0}, upload=71344]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:46:42.458461706 (81h17m30.156030042s) [noise=true , address=185.167.204.205:4002 , piece_id=6YK5N6N56ARA4DND6UZ6FVUQGKTPWEQCHHPRT2CBF4JKRYRSQ5JQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3): protocol: expected piece hash; context canceled; EOF
Dec  9 00:46:42.458471284 (81h17m30.15603962s) [noise=true , address=185.167.204.205:4002 , piece_id=6YK5N6N56ARA4DND6UZ6FVUQGKTPWEQCHHPRT2CBF4JKRYRSQ5JQ, seg_pos={0 0}, upload=71344]: Long tail cancellation due to optimal threshold
Dec  9 00:46:42.458771405 (81h17m30.156339741s) [noise=true , address=185.167.204.206:4050 , piece_id=OTVXXUJZDEU22LSKYIQIWODJNNTWPONKPZVRTU3PAWRTZHRWVY5Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz): protocol: expected piece hash; context canceled; EOF
Dec  9 00:46:42.458789068 (81h17m30.156357414s) [noise=true , address=185.167.204.206:4050 , piece_id=OTVXXUJZDEU22LSKYIQIWODJNNTWPONKPZVRTU3PAWRTZHRWVY5Q, seg_pos={0 0}, upload=71344]: Long tail cancellation due to optimal threshold
Dec  9 00:46:42.458814495 (81h17m30.156382832s) [seg_pos={0 0}, upload=71344]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:46:42.458911497 (81h17m30.156479832s) [upload=71344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:46:42.458917598 (81h17m30.156485934s) [upload=71344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:46:42.642163323 (81h17m30.339731669s) [upload=71344]: Done uploading segments...
Dec  9 00:46:42.642181906 (81h17m30.339750243s) [upload=71344]: Upload finished. err: <nil>
Duration: 8.896472126s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
14 out of 60 is failed (threshold=3) [.........X.X.X..XX...X...X.........X........X...XX.....XX..X]
duration: 
1m0.002750212s
trace: 
https://jaeger.dev.storj.io/trace/6c622d4d20c6b644
FAIL (2025-12-09 00:47:38 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
7.204.205:4010 , piece_id=X3FJD74HK4CRZ3DUCRFABWK6WXK4LL5CYA4QUDA3473EURTLQJPQ, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.869005256 (81h17m26.566573602s) [noise=true , address=81.171.14.70:4038    , piece_id=B5PXMR3XF3I6YHCUBMBVWYNWUL4HGV7FJD4HUWWA3DCHFAYKRSJA, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.869293724 (81h17m26.566862041s) [noise=true , address=185.167.204.205:4025 , piece_id=RIWZNDDHAQDMBRL7HKZRVACFSX2LT4HTUCFL4WLJNHKGYSBKWZ6Q, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.869617469 (81h17m26.567185815s) [noise=true , address=81.171.14.70:4031    , piece_id=K5HVFRGNYLXIKKRQWYRO72RUGITIJJ6WTTKIDGXJELIALQVGE6DQ, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.869651363 (81h17m26.567219679s) [noise=true , address=89.149.201.147:4020  , piece_id=QGMAYB3ET52LFF3FWSSYVDNWMMFGWP4JMM5KSPW26BAJJUWGBUMA, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.870016183 (81h17m26.567584509s) [noise=true , address=81.171.14.70:4039    , piece_id=WVYS3AHHBZ25BVSH5CECJLM2KWKUYO4GMTJR2X2YZXC4JNTSXSKQ, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.870161465 (81h17m26.567729801s) [noise=true , address=185.167.204.205:4012 , piece_id=M5NCFRWUYK43S3WS2JRYHO6WB7WHGY22LJHH7WREVOELTIUY2C3Q, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.870400913 (81h17m26.567969229s) [noise=true , address=89.149.201.147:4011  , piece_id=Q3MDCZHEG62WLKL53OMY4PY6M2ZIJLBVRJPOZBYYWZ3JMUBTNTIQ, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.870648546 (81h17m26.568216881s) [noise=true , address=89.149.201.147:4010  , piece_id=JCVEDQ5TNKGZC4DMY3PNS25LJBEZXY4Q43KMTLYS7SQWLLDCCTSQ, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.870748171 (81h17m26.568316477s) [noise=true , address=81.171.14.70:4043    , piece_id=ZQMQYMGFEW5FLAAZKGHRUS2RMTQ3BEK2RKNRBC5EWPRN6K6J6AGA, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:38.871070504 (81h17m26.56863882s) [noise=true , address=89.149.201.147:4012  , piece_id=O4Y4FSA64I7DBVYBKFZ5DZ67PM5V57V2SEVPMD6D6CKOVXNXNHTA, seg_pos={0 0}, upload=71344]: Uploading piece...
Dec  9 00:46:39.373856290 (81h17m27.071424627s) [upload=71344]: Next returned nil segment
Dec  9 00:46:39.373868153 (81h17m27.071436489s) [upload=71344]: Waiting for error group managing segments...
Dec  9 00:46:39.617992980 (81h17m27.315561316s) [noise=true , address=81.171.14.70:4031    , piece_id=K5HVFRGNYLXIKKRQWYRO72RUGITIJJ6WTTKIDGXJELIALQVGE6DQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.632102176 (81h17m27.329670513s) [noise=true , address=81.171.14.70:4044    , piece_id=N6MSTK2UKDT2USAZXGRNWXEEPNZ2R4DCLXUZMG7LDPDE7ZVQKNLQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.678894795 (81h17m27.376463101s) [noise=true , address=89.149.201.147:4011  , piece_id=Q3MDCZHEG62WLKL53OMY4PY6M2ZIJLBVRJPOZBYYWZ3JMUBTNTIQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.791701309 (81h17m27.489269645s) [noise=true , address=81.171.14.70:4038    , piece_id=B5PXMR3XF3I6YHCUBMBVWYNWUL4HGV7FJD4HUWWA3DCHFAYKRSJA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.839320061 (81h17m27.536888407s) [noise=true , address=81.171.14.70:4026    , piece_id=J7BSURZGAZ72S5NILWUMEWKZHINOU6JGLN2IUMUX3ERLENSCS5CQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.899821609 (81h17m27.597389954s) [noise=true , address=185.167.204.205:4010 , piece_id=X3FJD74HK4CRZ3DUCRFABWK6WXK4LL5CYA4QUDA3473EURTLQJPQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.948881432 (81h17m27.646449768s) [noise=true , address=185.167.204.205:4012 , piece_id=M5NCFRWUYK43S3WS2JRYHO6WB7WHGY22LJHH7WREVOELTIUY2C3Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:39.965711181 (81h17m27.663279517s) [noise=true , address=185.167.204.206:4065 , piece_id=6T5SHWDUBKNAPWZP3MRKMLWNCQUUQTQDOIAGL2NLF6BSNDQRQRZQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.015204875 (81h17m27.712773222s) [noise=true , address=81.171.14.70:4043    , piece_id=ZQMQYMGFEW5FLAAZKGHRUS2RMTQ3BEK2RKNRBC5EWPRN6K6J6AGA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.047249966 (81h17m27.744818311s) [noise=true , address=81.171.14.70:4034    , piece_id=JXQW54F2FJ523LWKD3UXVIJCXU2ASPVS4HORUSNA6QH2NZMIJZTQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.047813678 (81h17m27.745382025s) [noise=true , address=89.149.201.147:4010  , piece_id=JCVEDQ5TNKGZC4DMY3PNS25LJBEZXY4Q43KMTLYS7SQWLLDCCTSQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.103102218 (81h17m27.800670534s) [noise=true , address=185.167.204.206:4062 , piece_id=3BRNN272AGNCVPJITWYABRL7E335SXIIGD67HN4U5TXRJ5MIOHUA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.148193038 (81h17m27.845761354s) [noise=true , address=185.167.204.206:4058 , piece_id=UGGHOSQIJEWNXIWQKTKX2RNDYLCX6XH45XFO2ZCIACJYIM7ZJK4Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.295119488 (81h17m27.992687825s) [noise=true , address=185.167.204.206:4038 , piece_id=D2P5Z6L7RXJJW4O3ZR2CR63UECIN4ZUCAQUGYRWQUDD2O6OIP34Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.338952319 (81h17m28.036520625s) [noise=true , address=185.167.204.205:4003 , piece_id=PBM4AUO7CO4VOKF4BHP6PVCB4KDQH57Z3O6BTJ5ZUP34B5ANIIDQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.460976221 (81h17m28.158544567s) [noise=true , address=89.149.201.147:4020  , piece_id=QGMAYB3ET52LFF3FWSSYVDNWMMFGWP4JMM5KSPW26BAJJUWGBUMA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.481412466 (81h17m28.178980802s) [noise=true , address=81.171.14.70:4047    , piece_id=GKMLT7GETX6W5WIOMDFJZKFPQRKH45KAG4AT5GK2W3WMEBOMO6DA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.725250767 (81h17m28.422819083s) [noise=true , address=185.167.204.205:4031 , piece_id=IUYVSNTQEAC4TK4H3AKU2HL3S7OB3MGG2RWOKBRR34KDFFUVFSSA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.769854037 (81h17m28.467422342s) [noise=true , address=81.171.14.70:4025    , piece_id=QRSMR7SP2WN7NLUSLZOAQCKIVH6UMQ4ONYUQMQ4WDHHPKGQLO74Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.786123908 (81h17m28.483692214s) [noise=true , address=185.167.204.205:4035 , piece_id=NLSDKGQ47ZF2NVBPL7PH5ZQUXP5NX3BE5WIUV725UCXNL7ZDIL6Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:40.991477931 (81h17m28.689046278s) [noise=true , address=185.167.204.206:4061 , piece_id=Z5FCJ2USBPJBN3IXJZNKTGYZD6372VFPILNXI7BWRI2WGW3DCXXQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:41.116505633 (81h17m28.814073939s) [noise=true , address=185.167.204.205:4025 , piece_id=RIWZNDDHAQDMBRL7HKZRVACFSX2LT4HTUCFL4WLJNHKGYSBKWZ6Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:41.199420659 (81h17m28.896988965s) [noise=true , address=81.171.14.70:4037    , piece_id=63NATB62TXRJPWV6DQIQDGQ5ZMODH3JLVHNWO6RNZOEENODM75RA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:41.204718435 (81h17m28.902286741s) [noise=true , address=89.149.201.147:4012  , piece_id=O4Y4FSA64I7DBVYBKFZ5DZ67PM5V57V2SEVPMD6D6CKOVXNXNHTA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:41.240727390 (81h17m28.938295706s) [noise=true , address=185.167.204.205:4023 , piece_id=AMMMVQHQHX5TLVGYCYRUNZ5AB3IQKYFWRFBWK2GYHEJN4NVDOMJA, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:42.458234492 (81h17m30.155802828s) [noise=true , address=81.171.14.70:4039    , piece_id=WVYS3AHHBZ25BVSH5CECJLM2KWKUYO4GMTJR2X2YZXC4JNTSXSKQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: <nil>
Dec  9 00:46:42.458256343 (81h17m30.155824689s) [seg_pos={0 0}, upload=71344]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:46:42.458461706 (81h17m30.156030042s) [noise=true , address=185.167.204.205:4002 , piece_id=6YK5N6N56ARA4DND6UZ6FVUQGKTPWEQCHHPRT2CBF4JKRYRSQ5JQ, seg_pos={0 0}, upload=71344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3): protocol: expected piece hash; context canceled; EOF
Dec  9 00:46:42.458471284 (81h17m30.15603962s) [noise=true , address=185.167.204.205:4002 , piece_id=6YK5N6N56ARA4DND6UZ6FVUQGKTPWEQCHHPRT2CBF4JKRYRSQ5JQ, seg_pos={0 0}, upload=71344]: Long tail cancellation due to optimal threshold
Dec  9 00:46:42.458771405 (81h17m30.156339741s) [noise=true , address=185.167.204.206:4050 , piece_id=OTVXXUJZDEU22LSKYIQIWODJNNTWPONKPZVRTU3PAWRTZHRWVY5Q, seg_pos={0 0}, upload=71344]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UR3Amy4kaFW5xhpD1s4WAVW15smyz4up1EZ5SH5Eg126SnAaz): protocol: expected piece hash; context canceled; EOF
Dec  9 00:46:42.458789068 (81h17m30.156357414s) [noise=true , address=185.167.204.206:4050 , piece_id=OTVXXUJZDEU22LSKYIQIWODJNNTWPONKPZVRTU3PAWRTZHRWVY5Q, seg_pos={0 0}, upload=71344]: Long tail cancellation due to optimal threshold
Dec  9 00:46:42.458814495 (81h17m30.156382832s) [seg_pos={0 0}, upload=71344]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:46:42.458911497 (81h17m30.156479832s) [upload=71344]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:46:42.458917598 (81h17m30.156485934s) [upload=71344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:46:42.642163323 (81h17m30.339731669s) [upload=71344]: Done uploading segments...
Dec  9 00:46:42.642181906 (81h17m30.339750243s) [upload=71344]: Upload finished. err: <nil>
Duration: 1m0.002766352s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...................................................X........]
duration: 
420.60925ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:47:16 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 420.624779ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration: 
475.682234ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:46:15 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 475.709927ms core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
13 out of 60 is failed (threshold=3) [..........X.X.X..XX...X...X.........X........X...XX.....XX..]
duration: 
24.41000223s
trace: 
https://jaeger.dev.storj.io/trace/75dcd7e4875af414
FAIL (2025-12-09 00:45:58 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
398s) [noise=true , address=81.171.14.70:4036    , piece_id=DYA6LTS6A2SHZZVWXQWFPVF7GLEM3GWA4ZS4EO4XMRQATFK4FU3A, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.106583756 (81h14m2.804152061s) [noise=true , address=185.167.204.206:4066 , piece_id=MIZU52E7CMYE6JZ5SZCQPJZSKS7HN5E3ZBV7QM4DJMFNMAIL4BEA, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.106647133 (81h14m2.804215449s) [noise=true , address=185.167.204.206:4062 , piece_id=BQGWPKY63NPY4HVEIQOCN6MEZAMPS35VGK7GKVZ44FF6MM7SGI6A, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.106980667 (81h14m2.804548983s) [noise=true , address=185.167.204.205:4019 , piece_id=3HIGC7BRJ4IOSTU5HGMR2F6WSV6PKDBU7WFOKG4VIWPECYKOWHBA, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.107224031 (81h14m2.804792337s) [noise=true , address=89.149.201.147:4009  , piece_id=J4ZPK7QFCJFIOKZ7QDR75GPDJJKDO57MBDIIRFHUHGRLGTODPSTA, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.107361738 (81h14m2.804930054s) [noise=true , address=185.167.204.206:4046 , piece_id=UQ6VQKFIJN4ZLVGZFL3ZVZ3WSNHF7M4H6NBOUOZTEMFE6JLRFNBQ, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.107724687 (81h14m2.805293003s) [noise=true , address=185.167.204.205:4023 , piece_id=WYXHONKLNM4YOGDOLPMFV6YM5HBWVZTDNS4R3TN4ZDN2YF2DZUAQ, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.107887321 (81h14m2.805455637s) [noise=true , address=185.167.204.206:4063 , piece_id=JQ3NNVKPXYGUMZISYR4Q4EPO6IXFXIAQIYDFDB7L7RMD4QZ5KRFQ, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.108512478 (81h14m2.806080784s) [noise=true , address=89.149.201.147:4016  , piece_id=T2WA27PGLF2IYA7YHZM2BPYIC6KQWLVURT57VXX732NF7JBFMYLA, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.109023092 (81h14m2.806591399s) [noise=true , address=185.167.204.205:4021 , piece_id=Y66ZGAIQBFUBQ5TIEU2ZIYNLV6IEEN7UOHSJLMH6UAJC2BF5HHEQ, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.112609331 (81h14m2.810177648s) [noise=true , address=89.149.201.147:4005  , piece_id=UUO27WPN7HQ3PMHMXJRIIYKEKLEFHZNU2NZFZQCUG3LR3KWSFGMQ, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.601588317 (81h14m3.299156623s) [upload=71293]: Next returned nil segment
Dec  9 00:43:15.601601071 (81h14m3.299169377s) [upload=71293]: Waiting for error group managing segments...
Dec  9 00:43:15.808654279 (81h14m3.506222614s) [noise=true , address=185.167.204.206:4063 , piece_id=JQ3NNVKPXYGUMZISYR4Q4EPO6IXFXIAQIYDFDB7L7RMD4QZ5KRFQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:15.839656430 (81h14m3.537224766s) [noise=true , address=185.167.204.205:4023 , piece_id=WYXHONKLNM4YOGDOLPMFV6YM5HBWVZTDNS4R3TN4ZDN2YF2DZUAQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:15.844433273 (81h14m3.54200158s) [noise=true , address=89.149.201.147:4005  , piece_id=UUO27WPN7HQ3PMHMXJRIIYKEKLEFHZNU2NZFZQCUG3LR3KWSFGMQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:15.856948522 (81h14m3.554516828s) [noise=true , address=89.149.201.147:4008  , piece_id=JM2JZEFMOJUE5T7UYWO37OA24OWAP7AHMCLOS27OBERDNPFMLLTA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:15.880919631 (81h14m3.578487937s) [noise=true , address=81.171.14.70:4036    , piece_id=DYA6LTS6A2SHZZVWXQWFPVF7GLEM3GWA4ZS4EO4XMRQATFK4FU3A, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:16.299379527 (81h14m3.996947873s) [noise=true , address=81.171.14.70:4038    , piece_id=MC3HYQNIRLWRJMPHPJET74U35VJ2ACMM2EPBCUTCGOLRIGRRIVQA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:17.174861203 (81h14m4.872429559s) [noise=true , address=185.167.204.206:4046 , piece_id=UQ6VQKFIJN4ZLVGZFL3ZVZ3WSNHF7M4H6NBOUOZTEMFE6JLRFNBQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:18.088658993 (81h14m5.786227299s) [noise=true , address=185.167.204.206:4062 , piece_id=BQGWPKY63NPY4HVEIQOCN6MEZAMPS35VGK7GKVZ44FF6MM7SGI6A, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:18.905388922 (81h14m6.602957228s) [noise=true , address=89.149.201.147:4010  , piece_id=B3TGIVYUEVCX6LR6CU5FNWUBIESUEC74X2LMNTZA5NMZDMJ7EOVQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:18.995157569 (81h14m6.692725885s) [noise=true , address=185.167.204.205:4029 , piece_id=WYV2PNPJW7X4OOXU543PDJHHPYCPQCH4AGMK5UM2TMVMFDIKRPBQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:19.200620386 (81h14m6.898188722s) [noise=true , address=81.171.14.70:4040    , piece_id=X7LQXFRCULSE4SJ6HY2WEOOLOOKL4K26VRAQTUNGGVSNPCFHQWUQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:19.515665242 (81h14m7.213233558s) [noise=true , address=185.167.204.206:4066 , piece_id=MIZU52E7CMYE6JZ5SZCQPJZSKS7HN5E3ZBV7QM4DJMFNMAIL4BEA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:19.538719257 (81h14m7.236287573s) [noise=true , address=89.149.201.147:4013  , piece_id=ERSIUAXYUAUM3LDJVB3X3I3ZJGYLLJ4UKDLZCYWZFCB7FLZOUPWA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:19.725859919 (81h14m7.423428224s) [noise=true , address=89.149.201.147:4007  , piece_id=J6CIH367GQWMLUULP6DD2MINY2NUU6NB3CFYWHQBXGAOVEWITG6Q, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:20.061903741 (81h14m7.759472057s) [noise=true , address=81.171.14.70:4043    , piece_id=J6ZYJJEBSHAOWJDMEY3HVHGUXZNXX2WVH7WA4DBHSSCIUAH2K5GA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:20.360400735 (81h14m8.057969042s) [noise=true , address=185.167.204.205:4024 , piece_id=YZENGNGTY53ITILKT5ZGMNK6R6NS3TBN5SMUQGQJGQ2UWPEV3INA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:20.629909799 (81h14m8.327478135s) [noise=true , address=185.167.204.205:4021 , piece_id=Y66ZGAIQBFUBQ5TIEU2ZIYNLV6IEEN7UOHSJLMH6UAJC2BF5HHEQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:21.525584064 (81h14m9.2231524s) [noise=true , address=185.167.204.205:4019 , piece_id=3HIGC7BRJ4IOSTU5HGMR2F6WSV6PKDBU7WFOKG4VIWPECYKOWHBA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:21.559224685 (81h14m9.256793062s) [noise=true , address=185.167.204.205:4030 , piece_id=HTRV2CHDAMJEN43ALEIZKFTWRK2FXWDE26OXZJ424H5JZTN7MMLA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:21.627025990 (81h14m9.324594326s) [noise=true , address=89.149.201.147:4016  , piece_id=T2WA27PGLF2IYA7YHZM2BPYIC6KQWLVURT57VXX732NF7JBFMYLA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:22.457429708 (81h14m10.154998025s) [noise=true , address=89.149.201.147:4009  , piece_id=J4ZPK7QFCJFIOKZ7QDR75GPDJJKDO57MBDIIRFHUHGRLGTODPSTA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:22.868321065 (81h14m10.565889371s) [noise=true , address=185.167.204.205:4009 , piece_id=DUWP5WQERFUIZGAALI7YYLJOO3MGP3WJ6SIZSO4TCE3RQH4VOOCQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:22.953572816 (81h14m10.651141153s) [noise=true , address=185.167.204.205:4034 , piece_id=XA7C5UIIELXZSBBSSYL54L7BX34MMHKFFKXIE6VCCJ57A2S3HOSQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:23.513074901 (81h14m11.210643206s) [noise=true , address=81.171.14.70:4041    , piece_id=EAE4CUMLR2OJZPXGAAMCXBHXHJXXVLOEUMVCIAONY43SXPTO26FQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:28.941656930 (81h14m16.639225266s) [noise=true , address=185.167.204.206:4052 , piece_id=2BOUBNB5TBVKAB4MHUOJR4LRIWBFGTZOVUTHS633XTJRHMZTWIWQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:29.486159896 (81h14m17.183728212s) [noise=true , address=185.167.204.206:4054 , piece_id=F5756ZKXBQTDB77F2FXSQXIUVUVEMFM332APN64BNPIFRRSB33JQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:29.486178451 (81h14m17.183746767s) [seg_pos={0 0}, upload=71293]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:43:29.486367084 (81h14m17.1839354s) [noise=true , address=81.171.14.70:4030    , piece_id=OXHLIWH5VRHJHETNWNVEGYEU2HDLOPKWF4NUPU5PLREOD6DM6RQA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde): protocol: expected piece hash; context canceled; EOF
Dec  9 00:43:29.486376923 (81h14m17.183945239s) [noise=true , address=81.171.14.70:4030    , piece_id=OXHLIWH5VRHJHETNWNVEGYEU2HDLOPKWF4NUPU5PLREOD6DM6RQA, seg_pos={0 0}, upload=71293]: Long tail cancellation due to optimal threshold
Dec  9 00:43:29.486395056 (81h14m17.183963372s) [noise=true , address=89.149.201.147:4011  , piece_id=Z56ERSTZYORMH7TA7HOSATHE3NSRL5DUWWYQXR2KKRFWBM3J4QVA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF
Dec  9 00:43:29.486402800 (81h14m17.183971106s) [noise=true , address=89.149.201.147:4011  , piece_id=Z56ERSTZYORMH7TA7HOSATHE3NSRL5DUWWYQXR2KKRFWBM3J4QVA, seg_pos={0 0}, upload=71293]: Long tail cancellation due to optimal threshold
Dec  9 00:43:29.486416105 (81h14m17.183984421s) [seg_pos={0 0}, upload=71293]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:43:29.486480325 (81h14m17.184048641s) [upload=71293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:43:29.486484283 (81h14m17.184052589s) [upload=71293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:43:29.655491169 (81h14m17.353059475s) [upload=71293]: Done uploading segments...
Dec  9 00:43:29.655504725 (81h14m17.353073041s) [upload=71293]: Upload finished. err: <nil>
Duration: 24.410027096s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration: 
407.276978ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:45:32 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 407.288508ms core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
13 out of 60 is failed (threshold=3) [...........X.X.X..XX...X...X.........X........X...XX.....XX.]
duration: 
32.029589941s
trace: 
https://jaeger.dev.storj.io/trace/75dcd7e4875af414
FAIL (2025-12-09 00:44:52 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
398s) [noise=true , address=81.171.14.70:4036    , piece_id=DYA6LTS6A2SHZZVWXQWFPVF7GLEM3GWA4ZS4EO4XMRQATFK4FU3A, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.106583756 (81h14m2.804152061s) [noise=true , address=185.167.204.206:4066 , piece_id=MIZU52E7CMYE6JZ5SZCQPJZSKS7HN5E3ZBV7QM4DJMFNMAIL4BEA, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.106647133 (81h14m2.804215449s) [noise=true , address=185.167.204.206:4062 , piece_id=BQGWPKY63NPY4HVEIQOCN6MEZAMPS35VGK7GKVZ44FF6MM7SGI6A, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.106980667 (81h14m2.804548983s) [noise=true , address=185.167.204.205:4019 , piece_id=3HIGC7BRJ4IOSTU5HGMR2F6WSV6PKDBU7WFOKG4VIWPECYKOWHBA, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.107224031 (81h14m2.804792337s) [noise=true , address=89.149.201.147:4009  , piece_id=J4ZPK7QFCJFIOKZ7QDR75GPDJJKDO57MBDIIRFHUHGRLGTODPSTA, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.107361738 (81h14m2.804930054s) [noise=true , address=185.167.204.206:4046 , piece_id=UQ6VQKFIJN4ZLVGZFL3ZVZ3WSNHF7M4H6NBOUOZTEMFE6JLRFNBQ, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.107724687 (81h14m2.805293003s) [noise=true , address=185.167.204.205:4023 , piece_id=WYXHONKLNM4YOGDOLPMFV6YM5HBWVZTDNS4R3TN4ZDN2YF2DZUAQ, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.107887321 (81h14m2.805455637s) [noise=true , address=185.167.204.206:4063 , piece_id=JQ3NNVKPXYGUMZISYR4Q4EPO6IXFXIAQIYDFDB7L7RMD4QZ5KRFQ, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.108512478 (81h14m2.806080784s) [noise=true , address=89.149.201.147:4016  , piece_id=T2WA27PGLF2IYA7YHZM2BPYIC6KQWLVURT57VXX732NF7JBFMYLA, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.109023092 (81h14m2.806591399s) [noise=true , address=185.167.204.205:4021 , piece_id=Y66ZGAIQBFUBQ5TIEU2ZIYNLV6IEEN7UOHSJLMH6UAJC2BF5HHEQ, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.112609331 (81h14m2.810177648s) [noise=true , address=89.149.201.147:4005  , piece_id=UUO27WPN7HQ3PMHMXJRIIYKEKLEFHZNU2NZFZQCUG3LR3KWSFGMQ, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.601588317 (81h14m3.299156623s) [upload=71293]: Next returned nil segment
Dec  9 00:43:15.601601071 (81h14m3.299169377s) [upload=71293]: Waiting for error group managing segments...
Dec  9 00:43:15.808654279 (81h14m3.506222614s) [noise=true , address=185.167.204.206:4063 , piece_id=JQ3NNVKPXYGUMZISYR4Q4EPO6IXFXIAQIYDFDB7L7RMD4QZ5KRFQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:15.839656430 (81h14m3.537224766s) [noise=true , address=185.167.204.205:4023 , piece_id=WYXHONKLNM4YOGDOLPMFV6YM5HBWVZTDNS4R3TN4ZDN2YF2DZUAQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:15.844433273 (81h14m3.54200158s) [noise=true , address=89.149.201.147:4005  , piece_id=UUO27WPN7HQ3PMHMXJRIIYKEKLEFHZNU2NZFZQCUG3LR3KWSFGMQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:15.856948522 (81h14m3.554516828s) [noise=true , address=89.149.201.147:4008  , piece_id=JM2JZEFMOJUE5T7UYWO37OA24OWAP7AHMCLOS27OBERDNPFMLLTA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:15.880919631 (81h14m3.578487937s) [noise=true , address=81.171.14.70:4036    , piece_id=DYA6LTS6A2SHZZVWXQWFPVF7GLEM3GWA4ZS4EO4XMRQATFK4FU3A, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:16.299379527 (81h14m3.996947873s) [noise=true , address=81.171.14.70:4038    , piece_id=MC3HYQNIRLWRJMPHPJET74U35VJ2ACMM2EPBCUTCGOLRIGRRIVQA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:17.174861203 (81h14m4.872429559s) [noise=true , address=185.167.204.206:4046 , piece_id=UQ6VQKFIJN4ZLVGZFL3ZVZ3WSNHF7M4H6NBOUOZTEMFE6JLRFNBQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:18.088658993 (81h14m5.786227299s) [noise=true , address=185.167.204.206:4062 , piece_id=BQGWPKY63NPY4HVEIQOCN6MEZAMPS35VGK7GKVZ44FF6MM7SGI6A, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:18.905388922 (81h14m6.602957228s) [noise=true , address=89.149.201.147:4010  , piece_id=B3TGIVYUEVCX6LR6CU5FNWUBIESUEC74X2LMNTZA5NMZDMJ7EOVQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:18.995157569 (81h14m6.692725885s) [noise=true , address=185.167.204.205:4029 , piece_id=WYV2PNPJW7X4OOXU543PDJHHPYCPQCH4AGMK5UM2TMVMFDIKRPBQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:19.200620386 (81h14m6.898188722s) [noise=true , address=81.171.14.70:4040    , piece_id=X7LQXFRCULSE4SJ6HY2WEOOLOOKL4K26VRAQTUNGGVSNPCFHQWUQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:19.515665242 (81h14m7.213233558s) [noise=true , address=185.167.204.206:4066 , piece_id=MIZU52E7CMYE6JZ5SZCQPJZSKS7HN5E3ZBV7QM4DJMFNMAIL4BEA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:19.538719257 (81h14m7.236287573s) [noise=true , address=89.149.201.147:4013  , piece_id=ERSIUAXYUAUM3LDJVB3X3I3ZJGYLLJ4UKDLZCYWZFCB7FLZOUPWA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:19.725859919 (81h14m7.423428224s) [noise=true , address=89.149.201.147:4007  , piece_id=J6CIH367GQWMLUULP6DD2MINY2NUU6NB3CFYWHQBXGAOVEWITG6Q, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:20.061903741 (81h14m7.759472057s) [noise=true , address=81.171.14.70:4043    , piece_id=J6ZYJJEBSHAOWJDMEY3HVHGUXZNXX2WVH7WA4DBHSSCIUAH2K5GA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:20.360400735 (81h14m8.057969042s) [noise=true , address=185.167.204.205:4024 , piece_id=YZENGNGTY53ITILKT5ZGMNK6R6NS3TBN5SMUQGQJGQ2UWPEV3INA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:20.629909799 (81h14m8.327478135s) [noise=true , address=185.167.204.205:4021 , piece_id=Y66ZGAIQBFUBQ5TIEU2ZIYNLV6IEEN7UOHSJLMH6UAJC2BF5HHEQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:21.525584064 (81h14m9.2231524s) [noise=true , address=185.167.204.205:4019 , piece_id=3HIGC7BRJ4IOSTU5HGMR2F6WSV6PKDBU7WFOKG4VIWPECYKOWHBA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:21.559224685 (81h14m9.256793062s) [noise=true , address=185.167.204.205:4030 , piece_id=HTRV2CHDAMJEN43ALEIZKFTWRK2FXWDE26OXZJ424H5JZTN7MMLA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:21.627025990 (81h14m9.324594326s) [noise=true , address=89.149.201.147:4016  , piece_id=T2WA27PGLF2IYA7YHZM2BPYIC6KQWLVURT57VXX732NF7JBFMYLA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:22.457429708 (81h14m10.154998025s) [noise=true , address=89.149.201.147:4009  , piece_id=J4ZPK7QFCJFIOKZ7QDR75GPDJJKDO57MBDIIRFHUHGRLGTODPSTA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:22.868321065 (81h14m10.565889371s) [noise=true , address=185.167.204.205:4009 , piece_id=DUWP5WQERFUIZGAALI7YYLJOO3MGP3WJ6SIZSO4TCE3RQH4VOOCQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:22.953572816 (81h14m10.651141153s) [noise=true , address=185.167.204.205:4034 , piece_id=XA7C5UIIELXZSBBSSYL54L7BX34MMHKFFKXIE6VCCJ57A2S3HOSQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:23.513074901 (81h14m11.210643206s) [noise=true , address=81.171.14.70:4041    , piece_id=EAE4CUMLR2OJZPXGAAMCXBHXHJXXVLOEUMVCIAONY43SXPTO26FQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:28.941656930 (81h14m16.639225266s) [noise=true , address=185.167.204.206:4052 , piece_id=2BOUBNB5TBVKAB4MHUOJR4LRIWBFGTZOVUTHS633XTJRHMZTWIWQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:29.486159896 (81h14m17.183728212s) [noise=true , address=185.167.204.206:4054 , piece_id=F5756ZKXBQTDB77F2FXSQXIUVUVEMFM332APN64BNPIFRRSB33JQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:29.486178451 (81h14m17.183746767s) [seg_pos={0 0}, upload=71293]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:43:29.486367084 (81h14m17.1839354s) [noise=true , address=81.171.14.70:4030    , piece_id=OXHLIWH5VRHJHETNWNVEGYEU2HDLOPKWF4NUPU5PLREOD6DM6RQA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde): protocol: expected piece hash; context canceled; EOF
Dec  9 00:43:29.486376923 (81h14m17.183945239s) [noise=true , address=81.171.14.70:4030    , piece_id=OXHLIWH5VRHJHETNWNVEGYEU2HDLOPKWF4NUPU5PLREOD6DM6RQA, seg_pos={0 0}, upload=71293]: Long tail cancellation due to optimal threshold
Dec  9 00:43:29.486395056 (81h14m17.183963372s) [noise=true , address=89.149.201.147:4011  , piece_id=Z56ERSTZYORMH7TA7HOSATHE3NSRL5DUWWYQXR2KKRFWBM3J4QVA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF
Dec  9 00:43:29.486402800 (81h14m17.183971106s) [noise=true , address=89.149.201.147:4011  , piece_id=Z56ERSTZYORMH7TA7HOSATHE3NSRL5DUWWYQXR2KKRFWBM3J4QVA, seg_pos={0 0}, upload=71293]: Long tail cancellation due to optimal threshold
Dec  9 00:43:29.486416105 (81h14m17.183984421s) [seg_pos={0 0}, upload=71293]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:43:29.486480325 (81h14m17.184048641s) [upload=71293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:43:29.486484283 (81h14m17.184052589s) [upload=71293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:43:29.655491169 (81h14m17.353059475s) [upload=71293]: Done uploading segments...
Dec  9 00:43:29.655504725 (81h14m17.353073041s) [upload=71293]: Upload finished. err: <nil>
Duration: 32.029609136s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration: 
436.293691ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:44:40 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 436.308187ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration: 
439.884468ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:44:10 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 439.90674ms core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
13 out of 60 is failed (threshold=3) [............X.X.X..XX...X...X.........X........X...XX.....XX]
duration: 
40.398772516s
trace: 
https://jaeger.dev.storj.io/trace/75dcd7e4875af414
FAIL (2025-12-09 00:43:55 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
398s) [noise=true , address=81.171.14.70:4036    , piece_id=DYA6LTS6A2SHZZVWXQWFPVF7GLEM3GWA4ZS4EO4XMRQATFK4FU3A, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.106583756 (81h14m2.804152061s) [noise=true , address=185.167.204.206:4066 , piece_id=MIZU52E7CMYE6JZ5SZCQPJZSKS7HN5E3ZBV7QM4DJMFNMAIL4BEA, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.106647133 (81h14m2.804215449s) [noise=true , address=185.167.204.206:4062 , piece_id=BQGWPKY63NPY4HVEIQOCN6MEZAMPS35VGK7GKVZ44FF6MM7SGI6A, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.106980667 (81h14m2.804548983s) [noise=true , address=185.167.204.205:4019 , piece_id=3HIGC7BRJ4IOSTU5HGMR2F6WSV6PKDBU7WFOKG4VIWPECYKOWHBA, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.107224031 (81h14m2.804792337s) [noise=true , address=89.149.201.147:4009  , piece_id=J4ZPK7QFCJFIOKZ7QDR75GPDJJKDO57MBDIIRFHUHGRLGTODPSTA, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.107361738 (81h14m2.804930054s) [noise=true , address=185.167.204.206:4046 , piece_id=UQ6VQKFIJN4ZLVGZFL3ZVZ3WSNHF7M4H6NBOUOZTEMFE6JLRFNBQ, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.107724687 (81h14m2.805293003s) [noise=true , address=185.167.204.205:4023 , piece_id=WYXHONKLNM4YOGDOLPMFV6YM5HBWVZTDNS4R3TN4ZDN2YF2DZUAQ, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.107887321 (81h14m2.805455637s) [noise=true , address=185.167.204.206:4063 , piece_id=JQ3NNVKPXYGUMZISYR4Q4EPO6IXFXIAQIYDFDB7L7RMD4QZ5KRFQ, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.108512478 (81h14m2.806080784s) [noise=true , address=89.149.201.147:4016  , piece_id=T2WA27PGLF2IYA7YHZM2BPYIC6KQWLVURT57VXX732NF7JBFMYLA, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.109023092 (81h14m2.806591399s) [noise=true , address=185.167.204.205:4021 , piece_id=Y66ZGAIQBFUBQ5TIEU2ZIYNLV6IEEN7UOHSJLMH6UAJC2BF5HHEQ, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.112609331 (81h14m2.810177648s) [noise=true , address=89.149.201.147:4005  , piece_id=UUO27WPN7HQ3PMHMXJRIIYKEKLEFHZNU2NZFZQCUG3LR3KWSFGMQ, seg_pos={0 0}, upload=71293]: Uploading piece...
Dec  9 00:43:15.601588317 (81h14m3.299156623s) [upload=71293]: Next returned nil segment
Dec  9 00:43:15.601601071 (81h14m3.299169377s) [upload=71293]: Waiting for error group managing segments...
Dec  9 00:43:15.808654279 (81h14m3.506222614s) [noise=true , address=185.167.204.206:4063 , piece_id=JQ3NNVKPXYGUMZISYR4Q4EPO6IXFXIAQIYDFDB7L7RMD4QZ5KRFQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:15.839656430 (81h14m3.537224766s) [noise=true , address=185.167.204.205:4023 , piece_id=WYXHONKLNM4YOGDOLPMFV6YM5HBWVZTDNS4R3TN4ZDN2YF2DZUAQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:15.844433273 (81h14m3.54200158s) [noise=true , address=89.149.201.147:4005  , piece_id=UUO27WPN7HQ3PMHMXJRIIYKEKLEFHZNU2NZFZQCUG3LR3KWSFGMQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:15.856948522 (81h14m3.554516828s) [noise=true , address=89.149.201.147:4008  , piece_id=JM2JZEFMOJUE5T7UYWO37OA24OWAP7AHMCLOS27OBERDNPFMLLTA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:15.880919631 (81h14m3.578487937s) [noise=true , address=81.171.14.70:4036    , piece_id=DYA6LTS6A2SHZZVWXQWFPVF7GLEM3GWA4ZS4EO4XMRQATFK4FU3A, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:16.299379527 (81h14m3.996947873s) [noise=true , address=81.171.14.70:4038    , piece_id=MC3HYQNIRLWRJMPHPJET74U35VJ2ACMM2EPBCUTCGOLRIGRRIVQA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:17.174861203 (81h14m4.872429559s) [noise=true , address=185.167.204.206:4046 , piece_id=UQ6VQKFIJN4ZLVGZFL3ZVZ3WSNHF7M4H6NBOUOZTEMFE6JLRFNBQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:18.088658993 (81h14m5.786227299s) [noise=true , address=185.167.204.206:4062 , piece_id=BQGWPKY63NPY4HVEIQOCN6MEZAMPS35VGK7GKVZ44FF6MM7SGI6A, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:18.905388922 (81h14m6.602957228s) [noise=true , address=89.149.201.147:4010  , piece_id=B3TGIVYUEVCX6LR6CU5FNWUBIESUEC74X2LMNTZA5NMZDMJ7EOVQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:18.995157569 (81h14m6.692725885s) [noise=true , address=185.167.204.205:4029 , piece_id=WYV2PNPJW7X4OOXU543PDJHHPYCPQCH4AGMK5UM2TMVMFDIKRPBQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:19.200620386 (81h14m6.898188722s) [noise=true , address=81.171.14.70:4040    , piece_id=X7LQXFRCULSE4SJ6HY2WEOOLOOKL4K26VRAQTUNGGVSNPCFHQWUQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:19.515665242 (81h14m7.213233558s) [noise=true , address=185.167.204.206:4066 , piece_id=MIZU52E7CMYE6JZ5SZCQPJZSKS7HN5E3ZBV7QM4DJMFNMAIL4BEA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:19.538719257 (81h14m7.236287573s) [noise=true , address=89.149.201.147:4013  , piece_id=ERSIUAXYUAUM3LDJVB3X3I3ZJGYLLJ4UKDLZCYWZFCB7FLZOUPWA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:19.725859919 (81h14m7.423428224s) [noise=true , address=89.149.201.147:4007  , piece_id=J6CIH367GQWMLUULP6DD2MINY2NUU6NB3CFYWHQBXGAOVEWITG6Q, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:20.061903741 (81h14m7.759472057s) [noise=true , address=81.171.14.70:4043    , piece_id=J6ZYJJEBSHAOWJDMEY3HVHGUXZNXX2WVH7WA4DBHSSCIUAH2K5GA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:20.360400735 (81h14m8.057969042s) [noise=true , address=185.167.204.205:4024 , piece_id=YZENGNGTY53ITILKT5ZGMNK6R6NS3TBN5SMUQGQJGQ2UWPEV3INA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:20.629909799 (81h14m8.327478135s) [noise=true , address=185.167.204.205:4021 , piece_id=Y66ZGAIQBFUBQ5TIEU2ZIYNLV6IEEN7UOHSJLMH6UAJC2BF5HHEQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:21.525584064 (81h14m9.2231524s) [noise=true , address=185.167.204.205:4019 , piece_id=3HIGC7BRJ4IOSTU5HGMR2F6WSV6PKDBU7WFOKG4VIWPECYKOWHBA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:21.559224685 (81h14m9.256793062s) [noise=true , address=185.167.204.205:4030 , piece_id=HTRV2CHDAMJEN43ALEIZKFTWRK2FXWDE26OXZJ424H5JZTN7MMLA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:21.627025990 (81h14m9.324594326s) [noise=true , address=89.149.201.147:4016  , piece_id=T2WA27PGLF2IYA7YHZM2BPYIC6KQWLVURT57VXX732NF7JBFMYLA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:22.457429708 (81h14m10.154998025s) [noise=true , address=89.149.201.147:4009  , piece_id=J4ZPK7QFCJFIOKZ7QDR75GPDJJKDO57MBDIIRFHUHGRLGTODPSTA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:22.868321065 (81h14m10.565889371s) [noise=true , address=185.167.204.205:4009 , piece_id=DUWP5WQERFUIZGAALI7YYLJOO3MGP3WJ6SIZSO4TCE3RQH4VOOCQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:22.953572816 (81h14m10.651141153s) [noise=true , address=185.167.204.205:4034 , piece_id=XA7C5UIIELXZSBBSSYL54L7BX34MMHKFFKXIE6VCCJ57A2S3HOSQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:23.513074901 (81h14m11.210643206s) [noise=true , address=81.171.14.70:4041    , piece_id=EAE4CUMLR2OJZPXGAAMCXBHXHJXXVLOEUMVCIAONY43SXPTO26FQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:28.941656930 (81h14m16.639225266s) [noise=true , address=185.167.204.206:4052 , piece_id=2BOUBNB5TBVKAB4MHUOJR4LRIWBFGTZOVUTHS633XTJRHMZTWIWQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:29.486159896 (81h14m17.183728212s) [noise=true , address=185.167.204.206:4054 , piece_id=F5756ZKXBQTDB77F2FXSQXIUVUVEMFM332APN64BNPIFRRSB33JQ, seg_pos={0 0}, upload=71293]: Done uploading piece. err: <nil>
Dec  9 00:43:29.486178451 (81h14m17.183746767s) [seg_pos={0 0}, upload=71293]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:43:29.486367084 (81h14m17.1839354s) [noise=true , address=81.171.14.70:4030    , piece_id=OXHLIWH5VRHJHETNWNVEGYEU2HDLOPKWF4NUPU5PLREOD6DM6RQA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde): protocol: expected piece hash; context canceled; EOF
Dec  9 00:43:29.486376923 (81h14m17.183945239s) [noise=true , address=81.171.14.70:4030    , piece_id=OXHLIWH5VRHJHETNWNVEGYEU2HDLOPKWF4NUPU5PLREOD6DM6RQA, seg_pos={0 0}, upload=71293]: Long tail cancellation due to optimal threshold
Dec  9 00:43:29.486395056 (81h14m17.183963372s) [noise=true , address=89.149.201.147:4011  , piece_id=Z56ERSTZYORMH7TA7HOSATHE3NSRL5DUWWYQXR2KKRFWBM3J4QVA, seg_pos={0 0}, upload=71293]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg): protocol: expected piece hash; context canceled; EOF
Dec  9 00:43:29.486402800 (81h14m17.183971106s) [noise=true , address=89.149.201.147:4011  , piece_id=Z56ERSTZYORMH7TA7HOSATHE3NSRL5DUWWYQXR2KKRFWBM3J4QVA, seg_pos={0 0}, upload=71293]: Long tail cancellation due to optimal threshold
Dec  9 00:43:29.486416105 (81h14m17.183984421s) [seg_pos={0 0}, upload=71293]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:43:29.486480325 (81h14m17.184048641s) [upload=71293]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:43:29.486484283 (81h14m17.184052589s) [upload=71293]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:43:29.655491169 (81h14m17.353059475s) [upload=71293]: Done uploading segments...
Dec  9 00:43:29.655504725 (81h14m17.353073041s) [upload=71293]: Upload finished. err: <nil>
Duration: 40.398816006s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [........................................................X...]
duration: 
491.75324ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:43:34 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 491.778407ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration: 
512.334866ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:43:16 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 512.354903ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration: 
471.782543ms
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:42:53 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 471.798043ms core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
12 out of 60 is failed (threshold=3) [.............X.X.X..XX...X...X.........X........X...XX.....X]
duration: 
28.046869837s
trace: 
https://jaeger.dev.storj.io/trace/765a34a639afff58
FAIL (2025-12-09 00:42:47 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
2156s) [noise=true , address=81.171.14.70:4044    , piece_id=WCJZ46JBPN2UI2WFZS6QDAORPXEPI22RVGC6RWG4SOP4B2GVVTFA, seg_pos={0 0}, upload=71282]: Uploading piece...
Dec  9 00:42:20.271461366 (81h13m7.969029671s) [noise=true , address=185.167.204.206:4071 , piece_id=BTCIRP3WDXFI3PWVNACRAOLJT6GAO7D6WHSPE2VK6HW7HU7536OQ, seg_pos={0 0}, upload=71282]: Uploading piece...
Dec  9 00:42:20.271687548 (81h13m7.969255864s) [noise=true , address=185.167.204.205:4028 , piece_id=YLG6O3EJQSYIWZY377ROO5Z27CO2T6H4MVEUH36M3WSCPREYGQVQ, seg_pos={0 0}, upload=71282]: Uploading piece...
Dec  9 00:42:20.271940781 (81h13m7.969509097s) [noise=true , address=81.171.14.70:4046    , piece_id=DLIGVOHMWVIPKS6KXYZVHZ25U54AHQ6J3CT3V3PMLAOAMWDDNBVQ, seg_pos={0 0}, upload=71282]: Uploading piece...
Dec  9 00:42:20.272189005 (81h13m7.969757321s) [noise=true , address=185.167.204.205:4034 , piece_id=XF3CKC2GU5OWQ5PZTVNLKJNYBYTG7LMF6WXSJG5EXZB3D5KPGX2A, seg_pos={0 0}, upload=71282]: Uploading piece...
Dec  9 00:42:20.272425086 (81h13m7.969993402s) [noise=true , address=185.167.204.205:4005 , piece_id=TPWHONWKJPX3XSYKFJ5SRC32AKRQBHEPPRM57UTCZWRV6JTZC27Q, seg_pos={0 0}, upload=71282]: Uploading piece...
Dec  9 00:42:20.272662308 (81h13m7.970230615s) [noise=true , address=81.171.14.70:4028    , piece_id=GTVYKF24KCQLQFC6NNZ4JCIJOOZNRHNLFI72GPZQ6RW23ZUPBTOQ, seg_pos={0 0}, upload=71282]: Uploading piece...
Dec  9 00:42:20.272901085 (81h13m7.970469401s) [noise=true , address=89.149.201.147:4008  , piece_id=LP5XQRV4RTS4GZKYZ5KSC33BS4NBFIGA5TKQNBA5QISRVVPGBIGA, seg_pos={0 0}, upload=71282]: Uploading piece...
Dec  9 00:42:20.273167794 (81h13m7.970736099s) [noise=true , address=81.171.14.70:4048    , piece_id=AAFZRY4N3R7OLVUJNV7WNCNWU4OKU6EDP42P57HLXNLTLTCEF37A, seg_pos={0 0}, upload=71282]: Uploading piece...
Dec  9 00:42:20.273435824 (81h13m7.97100414s) [noise=true , address=185.167.204.205:4033 , piece_id=5JZJXBBT7MJUK3NGR3BQ4CLSCPTFBRU7RTIVLZ7YEO4JMB6EPRIA, seg_pos={0 0}, upload=71282]: Uploading piece...
Dec  9 00:42:20.273809111 (81h13m7.971377417s) [noise=true , address=185.167.204.205:4004 , piece_id=7RXIO6VKKX7TBKDJWNXVSZ2LNRTZRK7TTDGIS3UXUYQSUZM7AF7Q, seg_pos={0 0}, upload=71282]: Uploading piece...
Dec  9 00:42:20.764885566 (81h13m8.462453902s) [upload=71282]: Next returned nil segment
Dec  9 00:42:20.764897047 (81h13m8.462465384s) [upload=71282]: Waiting for error group managing segments...
Dec  9 00:42:20.966678306 (81h13m8.664246633s) [noise=true , address=81.171.14.70:4036    , piece_id=XGVIGMTYR3SEYSWW224RMKBKXGNGN4WVMXMH2UC5GXB6TCIA47HQ, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:20.969345990 (81h13m8.666914316s) [noise=true , address=185.167.204.205:4006 , piece_id=FYNG3YBCYRP2W3BXKFKJGJWK2RG56WFSXK7ZWRKGQCA4SVIPLY3A, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:20.969717584 (81h13m8.66728593s) [noise=true , address=185.167.204.205:4008 , piece_id=KXZG4ONTTLG7QWIHRTVKTE2BVTRZOBHHHKSQTEOCKZSK44UIABVA, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:20.971202047 (81h13m8.668770373s) [noise=true , address=89.149.201.147:4011  , piece_id=2JI5VFVC6EQ2ZCM4NTE2DB3XSJPCIXAWAHIMTP5GVAC6SQ3D4YWA, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:21.000108915 (81h13m8.697677271s) [noise=true , address=185.167.204.205:4033 , piece_id=5JZJXBBT7MJUK3NGR3BQ4CLSCPTFBRU7RTIVLZ7YEO4JMB6EPRIA, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:21.035854178 (81h13m8.733422504s) [noise=true , address=81.171.14.70:4027    , piece_id=2KUNOZBPT7UIK23BPRTY3IYHDGJ3Q2EADEUV37GYS5EVKOMT6JFQ, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:21.178498820 (81h13m8.876067186s) [noise=true , address=185.167.204.206:4063 , piece_id=G4YLROLEUGTAHYNDZIVAWPIISEI2ZJVPY4AD76LUFP4AFT7EIO3Q, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:21.412181241 (81h13m9.109749577s) [noise=true , address=185.167.204.205:4004 , piece_id=7RXIO6VKKX7TBKDJWNXVSZ2LNRTZRK7TTDGIS3UXUYQSUZM7AF7Q, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:21.518219090 (81h13m9.215787426s) [noise=true , address=185.167.204.205:4030 , piece_id=QO3IEO65INW3JTPUGVMNNWPVTB3XFPYVYAEII6VDYSSY5E7UHHIQ, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:21.532343786 (81h13m9.229912131s) [noise=true , address=185.167.204.206:4065 , piece_id=4EHLDEDJUGQQT7LSRVKWSSQBJQLMAD2FBXXB2XXO4JFKSE7ZJY2Q, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:21.548687275 (81h13m9.246255621s) [noise=true , address=185.167.204.206:4047 , piece_id=ZAUT6H4WMTBTRYLHZVWIJITRGSRA576SGPRZK4NBYKLWHVTG5MVA, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:21.549605500 (81h13m9.247173836s) [noise=true , address=81.171.14.70:4035    , piece_id=G7GGX6MHQSBGGM7POV4VSJ55H6Q3GMYUAX2MS5KJONI5KMBB6BPQ, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:21.812878485 (81h13m9.510446801s) [noise=true , address=185.167.204.205:4005 , piece_id=TPWHONWKJPX3XSYKFJ5SRC32AKRQBHEPPRM57UTCZWRV6JTZC27Q, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:21.852604343 (81h13m9.55017265s) [noise=true , address=81.171.14.70:4028    , piece_id=GTVYKF24KCQLQFC6NNZ4JCIJOOZNRHNLFI72GPZQ6RW23ZUPBTOQ, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:21.854124293 (81h13m9.551692609s) [noise=true , address=81.171.14.70:4048    , piece_id=AAFZRY4N3R7OLVUJNV7WNCNWU4OKU6EDP42P57HLXNLTLTCEF37A, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:21.882881973 (81h13m9.580450279s) [noise=true , address=185.167.204.206:4071 , piece_id=BTCIRP3WDXFI3PWVNACRAOLJT6GAO7D6WHSPE2VK6HW7HU7536OQ, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:21.982907131 (81h13m9.680475437s) [noise=true , address=89.149.201.147:4016  , piece_id=PRDEDCUH3U5GZNUXWBE6OIWSFQQ2KNWNZ7MH5JKAUBLUX3WPTBGQ, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:22.103934711 (81h13m9.801503027s) [noise=true , address=81.171.14.70:4046    , piece_id=DLIGVOHMWVIPKS6KXYZVHZ25U54AHQ6J3CT3V3PMLAOAMWDDNBVQ, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:22.243181906 (81h13m9.940750243s) [noise=true , address=89.149.201.147:4003  , piece_id=IDUYE6BZW5XJKHQXVGYL6HPKILI7YFL6SBD53MZ4CKXLCW5MINCQ, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:22.554375979 (81h13m10.251944295s) [noise=true , address=185.167.204.205:4034 , piece_id=XF3CKC2GU5OWQ5PZTVNLKJNYBYTG7LMF6WXSJG5EXZB3D5KPGX2A, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:22.710683173 (81h13m10.408251478s) [noise=true , address=89.149.201.147:4018  , piece_id=77EUKQO4M4Q3NRFRJW5E6EP2LXRQG53P36ATNJYWYVFRZGR5HVWQ, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:22.766029881 (81h13m10.463598197s) [noise=true , address=185.167.204.206:4068 , piece_id=YKLVGXDKEQG5JUUNYIKWCMSRTLLI6NBGRPKFTLWHKPC6NWHOPJVQ, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:22.795340903 (81h13m10.492909219s) [noise=true , address=185.167.204.205:4011 , piece_id=V3JDGM2NSBDOZOQHYWUWQ7MU56TRBBWQBEYIKQDD7TV3S2HFTXBQ, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:22.903256991 (81h13m10.600825308s) [noise=true , address=89.149.201.147:4008  , piece_id=LP5XQRV4RTS4GZKYZ5KSC33BS4NBFIGA5TKQNBA5QISRVVPGBIGA, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:23.138584915 (81h13m10.836153231s) [noise=true , address=81.171.14.70:4044    , piece_id=WCJZ46JBPN2UI2WFZS6QDAORPXEPI22RVGC6RWG4SOP4B2GVVTFA, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:23.321001952 (81h13m11.018570289s) [noise=true , address=185.167.204.205:4009 , piece_id=443N46EE5H7EK4T4JADSCJGIQQWU47MSMLNNM6QZB24Q5A2GZS6A, seg_pos={0 0}, upload=71282]: Done uploading piece. err: <nil>
Dec  9 00:42:23.321023012 (81h13m11.018591358s) [seg_pos={0 0}, upload=71282]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:42:23.321338231 (81h13m11.018906567s) [noise=true , address=185.167.204.206:4064 , piece_id=JGTM5KWPHQHXKIOZIE2CGBEABPJYIYN7UDISVRI63OYTWT3KRE5Q, seg_pos={0 0}, upload=71282]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb): protocol: expected piece hash; context canceled; EOF
Dec  9 00:42:23.321353489 (81h13m11.018921826s) [noise=true , address=185.167.204.206:4064 , piece_id=JGTM5KWPHQHXKIOZIE2CGBEABPJYIYN7UDISVRI63OYTWT3KRE5Q, seg_pos={0 0}, upload=71282]: Long tail cancellation due to optimal threshold
Dec  9 00:42:23.321592797 (81h13m11.019161132s) [noise=true , address=185.167.204.205:4028 , piece_id=YLG6O3EJQSYIWZY377ROO5Z27CO2T6H4MVEUH36M3WSCPREYGQVQ, seg_pos={0 0}, upload=71282]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61): protocol: expected piece hash; context canceled; EOF
Dec  9 00:42:23.321610960 (81h13m11.019179307s) [noise=true , address=185.167.204.205:4028 , piece_id=YLG6O3EJQSYIWZY377ROO5Z27CO2T6H4MVEUH36M3WSCPREYGQVQ, seg_pos={0 0}, upload=71282]: Long tail cancellation due to optimal threshold
Dec  9 00:42:23.321641426 (81h13m11.019209773s) [seg_pos={0 0}, upload=71282]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:42:23.321754298 (81h13m11.019322634s) [upload=71282]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:42:23.321762854 (81h13m11.0193312s) [upload=71282]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:42:23.475521345 (81h13m11.173089681s) [upload=71282]: Done uploading segments...
Dec  9 00:42:23.475540801 (81h13m11.173109138s) [upload=71282]: Upload finished. err: <nil>
Duration: 28.046915853s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...........................................................X]
duration: 
30.021109477s
trace: 
https://jaeger.dev.storj.io/trace/4dbaa1759c71b1f4
FAIL (2025-12-09 00:42:24 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec  9 00:41:54.622468710 (81h12m42.320037046s) [upload=71278]: Starting upload
Dec  9 00:41:54.622543659 (81h12m42.320111995s) [upload=71278]: Done starting upload
Dec  9 00:41:54.622571812 (81h12m42.320140128s) [upload=71278]: Uploading segments...
Dec  9 00:41:54.622994281 (81h12m42.320562588s) [upload=71278]: Got next segment. Inline: false
Dec  9 00:41:54.623028135 (81h12m42.320596451s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec  9 00:41:54.623032322 (81h12m42.320600629s) [upload=71278]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec  9 00:41:54.645317651 (81h12m42.342885968s) [seg_pos={0 0}, upload=71278]: Begin upload segment...
Dec  9 00:41:54.645344462 (81h12m42.342912778s) [seg_pos={0 0}, upload=71278]: Done begin upload segment.
Dec  9 00:41:54.645381130 (81h12m42.342949447s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645391058 (81h12m42.342959375s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.645865044 (81h12m42.34343336s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646379516 (81h12m42.343947832s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.646694834 (81h12m42.34426315s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647101132 (81h12m42.344669438s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647561132 (81h12m42.345129438s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647976397 (81h12m42.345544714s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.647983160 (81h12m42.345551476s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648389529 (81h12m42.345957845s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.648769520 (81h12m42.346337826s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650448076 (81h12m42.348016392s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.650815922 (81h12m42.348384228s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.651280570 (81h12m42.348848876s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652276761 (81h12m42.349845077s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.652581671 (81h12m42.350149977s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Uploading piece...
Dec  9 00:41:54.690634333 (81h12m42.388202649s) [noise=true , address=77.90.31.19:4841     , piece_id=3DSCPC5E7M4NDL5RNHCROVN5IV3DFP7K35SE6QEC6FCP6STWUL6A, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.691392579 (81h12m42.388960895s) [noise=true , address=77.90.31.13:4626     , piece_id=B35MAB25LESGWCMN2VPVF5G745IV6GG7IUV5VYUXFM6PCRDMBMDQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec  9 00:41:54.758795599 (81h12m42.456363906s) [upload=71278]: Next returned nil segment
Dec  9 00:41:54.758816898 (81h12m42.456385204s) [upload=71278]: Waiting for error group managing segments...
Dec  9 00:41:54.770879913 (81h12m42.468448219s) [noise=true , address=145.79.227.38:4979   , piece_id=MPDDCNRUUZMRYBEXCGFKOGJHAXXJXFRPKQNIE7AUK6OSEP3WDAQA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.770996430 (81h12m42.468564737s) [noise=true , address=145.79.227.32:4836   , piece_id=LTIOGO4JLKGYSZ4ZEF4RR2MM3JPYBOROG537MXTUMMU5LD6LOHTA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.771564952 (81h12m42.469133258s) [noise=true , address=145.79.227.20:4438   , piece_id=WXPDD7Q7FIRZL6XD4C5V6G5UTL4K5D2NBRDVGBWELCYRGELVJNIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772355418 (81h12m42.469923725s) [noise=true , address=145.79.227.39:4015   , piece_id=UTKFDAUOSNLSDIIEWSIVUIVVIQ7LVZD2BVVBEAG52S5X2UTHMVLQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772720121 (81h12m42.470288426s) [noise=true , address=145.79.227.34:4906   , piece_id=JSE5ZBJTJDC4ATEN36BP4S3TRS64OQX3YIZFEEN2EVB23JVJ5QUQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.772728877 (81h12m42.470297183s) [noise=true , address=145.79.227.20:4437   , piece_id=4SLNFSLHALWUU4LSELTRV3TJQ6N6EZBO3FDOOKPLEMAKGSNC6K6Q, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773353122 (81h12m42.470921429s) [noise=true , address=145.79.227.43:4158   , piece_id=LRMYWFEOLEDFNODKIHHQP6HDXPJMFSYD47LKWS6UA3PLIYNVS2GA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.773928217 (81h12m42.471496522s) [noise=true , address=145.79.227.33:4869   , piece_id=7VXDZ3KG4P4Z5ZOEPTECUC3EGZMHEZIBG2RLENV3FE3QZKPQUCIQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.774308768 (81h12m42.471877073s) [noise=true , address=145.79.227.22:4510   , piece_id=DUBIKMD2ZWQE3OS4A2VHZ2G5MI7GMAGGNFOQUHKU2UNRHUMPQMGA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.777437452 (81h12m42.475005768s) [noise=true , address=145.79.227.21:4473   , piece_id=GJFPZXBIINXKBIAAHJZNLU67VQAIO7W5QFRQXL5P4ASYBCTIPPBA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.780306472 (81h12m42.477874778s) [noise=true , address=145.79.227.32:4834   , piece_id=HYV7C7TQKP4F4ZQKSY7WVUMGV3SJMMDYHVAIYFZEGRRF2YHGVMYQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:41:54.783206629 (81h12m42.480774925s) [noise=true , address=145.79.227.26:4653   , piece_id=7HRZZI34QXWHDXMA67PRSG37BBRMXJ7G7VR5A3PLBX3AZKTAV7TQ, seg_pos={0 0}, upload=71278]: Done uploading piece. err: <nil>
Dec  9 00:42:24.611357608 (81h13m12.308925954s) [noise=true , address=77.90.31.12:4592     , piece_id=UV23TFTJZOO3EM56IPX3GLAXPH4DKJONC6UFMCH5GC4TWRCVOVHA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611392572 (81h13m12.308960909s) [noise=true , address=77.90.31.15:4698     , piece_id=AMI7LXWHC7QZLDEHLV5AMUTT6JW3MDU6HRJKH44H2XGXNKJBDIEA, seg_pos={0 0}, upload=71278]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: expected piece hash; context deadline exceeded; EOF
Dec  9 00:42:24.611436074 (81h13m12.30900441s) [seg_pos={0 0}, upload=71278]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec  9 00:42:24.629340400 (81h13m12.326908736s) [upload=71278]: Done uploading segments...
Dec  9 00:42:24.629373512 (81h13m12.326941858s) [upload=71278]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 30.021125496s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
11 out of 60 is failed (threshold=3) [..............X.X.X..XX...X...X.........X........X...XX.....]
duration: 
5.231356778s
trace: 
https://jaeger.dev.storj.io/trace/38524bad4deddf54
FAIL (2025-12-09 00:41:47 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
0:37:09.490875739 (81h7m57.188444055s) [noise=true , address=185.167.204.206:4053 , piece_id=QLUC44XY4O5JMCLFZPF7GXEA2NVMSZGK3BARHUVMJP4KIIR6AICA, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491119565 (81h7m57.188687901s) [noise=true , address=89.149.201.147:4024  , piece_id=IIC4GNME5FXLDGRAYJ65UFEN2ZQDAFH2MU32JBPUD35U6VJLM3CQ, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491159349 (81h7m57.188727665s) [noise=true , address=89.149.201.147:4002  , piece_id=5A7XWZ6JXWGZEMOB2MZI2ERNSU4QWMU5MTDK7JYA2FBLQ3ZPQPJQ, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491429032 (81h7m57.188997348s) [noise=true , address=185.167.204.206:4048 , piece_id=ALO4LP2E5LS6KWBRCHXXN5T3SY6ELH6XDQZKESUAE6SWGC233RHA, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491562311 (81h7m57.189130647s) [noise=true , address=81.171.14.70:4030    , piece_id=VUUJT5FBV5QY6LRGPQGHHQRGJQMFAEK73M72FNGMBGAYPBA6UG7A, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491685843 (81h7m57.189254159s) [noise=true , address=185.167.204.205:4004 , piece_id=OLPXFIH3ZCNF5XK5KCYA6APWJ5P4RFOF6VYM4EQYGH62XXFDOJNQ, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491964223 (81h7m57.189532539s) [noise=true , address=81.171.14.70:4028    , piece_id=5D6QTJWWSRFWUVGBJGPYGCNHPDCGE5ZR4D45PTZMKR7IFSYEMD5Q, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.492058819 (81h7m57.189627165s) [noise=true , address=81.171.14.70:4042    , piece_id=7DNMIFGMO3BHLWFOHR5HGN7LPO4TDO7FUAWBO7TUIEGINN2HOEWA, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.492527706 (81h7m57.190096051s) [noise=true , address=185.167.204.206:4043 , piece_id=FGAWPYIZNIR3CY2EF4W777XNVVOVPKWUFDMI7BVSRDH2XSHC3INQ, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.493007201 (81h7m57.190575537s) [noise=true , address=81.171.14.70:4026    , piece_id=PSHPWQ2ZBMWBULF45TOBEPXEPBBZIUY3BFPLXEHAHV5VMQO7OIKA, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.493493029 (81h7m57.191061365s) [noise=true , address=81.171.14.70:4036    , piece_id=L3QIBUO233ADPMS23NG5HERSQ22OG2EMWVWHOJIFOJVFBEX3LC4A, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.983937683 (81h7m57.681505999s) [upload=71212]: Next returned nil segment
Dec  9 00:37:09.983948663 (81h7m57.681516979s) [upload=71212]: Waiting for error group managing segments...
Dec  9 00:37:10.224411079 (81h7m57.921979395s) [noise=true , address=89.149.201.147:4001  , piece_id=ID2T2GAEFX76ZNYLZBWZM3KD7M7EYZDEVMCE656DBPKKZP6LHHSQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:10.226062234 (81h7m57.923630539s) [noise=true , address=185.167.204.205:4010 , piece_id=ZHPZHCSGB277G77GIBXUFTOYXXQCKZZQ3VFIJOH2BRGVVBPGZEZA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:10.270053380 (81h7m57.967621686s) [noise=true , address=185.167.204.206:4048 , piece_id=ALO4LP2E5LS6KWBRCHXXN5T3SY6ELH6XDQZKESUAE6SWGC233RHA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:10.286107950 (81h7m57.983676256s) [noise=true , address=81.171.14.70:4039    , piece_id=IACSWA6CH4UJUMWW2REHM7NBFSEVJ2N4WW5UMD4YJOFQK4DTO5UA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:10.322312129 (81h7m58.019880435s) [noise=true , address=89.149.201.147:4002  , piece_id=5A7XWZ6JXWGZEMOB2MZI2ERNSU4QWMU5MTDK7JYA2FBLQ3ZPQPJQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:10.666987785 (81h7m58.364556092s) [noise=true , address=185.167.204.205:4018 , piece_id=4A3NKFHE7DJTV24CG3S2REQ473IGGZ72QYGV7FP2F5WZEKJ6WUBQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.186066218 (81h7m58.883634525s) [noise=true , address=185.167.204.206:4060 , piece_id=VYWSVVOQUGFIL5BCOUG3NRSONFYWDDVVTMT6WK6CD4MQOHDZZKJA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.209083936 (81h7m58.906652243s) [noise=true , address=185.167.204.206:4053 , piece_id=QLUC44XY4O5JMCLFZPF7GXEA2NVMSZGK3BARHUVMJP4KIIR6AICA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.560894641 (81h7m59.258462967s) [noise=true , address=81.171.14.70:4030    , piece_id=VUUJT5FBV5QY6LRGPQGHHQRGJQMFAEK73M72FNGMBGAYPBA6UG7A, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.581256807 (81h7m59.278825153s) [noise=true , address=81.171.14.70:4035    , piece_id=G72LVKHT4XOW2LWLLC64PQAG53JMNCNET6A25PPGZSG4VZ5Z2TBA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.584865397 (81h7m59.282433734s) [noise=true , address=185.167.204.205:4015 , piece_id=UTG4QF3XQP3DZWMEJOVDHL4ND46G62TLUGPWQFEFVIHEDO63RGTA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.631255115 (81h7m59.328823451s) [noise=true , address=89.149.201.147:4023  , piece_id=VRNPTSSHKMCKD3FDWWKVPTMELHL45Z424K4YXRZTOOJDJW64YZHA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.632578908 (81h7m59.330147244s) [noise=true , address=81.171.14.70:4032    , piece_id=R6VRUBRULWHETGIVF5GELD5XGYXJXJMX7ZB6NEA2ZFJB4F4BK5PA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.794168909 (81h7m59.491737245s) [noise=true , address=89.149.201.147:4024  , piece_id=IIC4GNME5FXLDGRAYJ65UFEN2ZQDAFH2MU32JBPUD35U6VJLM3CQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.885734444 (81h7m59.58330278s) [noise=true , address=89.149.201.147:4014  , piece_id=VNQRXL6AP5PIMMDVECDJYXW27224OCB5RFMKUSVVHVI67JDJDAHQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.929502934 (81h7m59.62707128s) [noise=true , address=81.171.14.70:4026    , piece_id=PSHPWQ2ZBMWBULF45TOBEPXEPBBZIUY3BFPLXEHAHV5VMQO7OIKA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:12.418613577 (81h8m0.116181913s) [noise=true , address=81.171.14.70:4036    , piece_id=L3QIBUO233ADPMS23NG5HERSQ22OG2EMWVWHOJIFOJVFBEX3LC4A, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:12.422262583 (81h8m0.119830899s) [noise=true , address=81.171.14.70:4028    , piece_id=5D6QTJWWSRFWUVGBJGPYGCNHPDCGE5ZR4D45PTZMKR7IFSYEMD5Q, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:12.457174688 (81h8m0.154743024s) [noise=true , address=185.167.204.205:4003 , piece_id=NFXCTQNGAFR3D2NE6URHZZQX5VAUP62ECNFT27GARMWMKYCJVQQQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:13.048217611 (81h8m0.745785946s) [noise=true , address=185.167.204.205:4013 , piece_id=7J2TBRFWUX5VYBLNGPFQJWMX4Q73AYXMYO6OQ52QKEX3IJ65PMUQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:13.093771526 (81h8m0.791339863s) [noise=true , address=81.171.14.70:4042    , piece_id=7DNMIFGMO3BHLWFOHR5HGN7LPO4TDO7FUAWBO7TUIEGINN2HOEWA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:13.237640915 (81h8m0.935209241s) [noise=true , address=185.167.204.206:4043 , piece_id=FGAWPYIZNIR3CY2EF4W777XNVVOVPKWUFDMI7BVSRDH2XSHC3INQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:13.332322832 (81h8m1.029891168s) [noise=true , address=81.171.14.70:4047    , piece_id=CZM5C2FFHIWHHTGWFZOVVALBFC6H6F53MYDEAPAD46RGDPAMGK2A, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:13.504416634 (81h8m1.201984981s) [noise=true , address=89.149.201.147:4009  , piece_id=JU2NGEQULR5ZQFIPZV3NUKU3X6526T73C3BPMLYNPO4CQX55KGXQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:14.665602892 (81h8m2.363171227s) [noise=true , address=185.167.204.205:4027 , piece_id=E7TRR4ZDYJORLYGALA6HVWAHALRMZDKOVHGPEO2GAK6L7WMSPZKQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:15.162761226 (81h8m2.860329531s) [noise=true , address=81.171.14.70:4031    , piece_id=XUTF53T5KB7DCRJQC4Y2S4TJLKLKQEDJX4VB5CO7G3NKFCCYYX3A, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:15.162775793 (81h8m2.860344109s) [seg_pos={0 0}, upload=71212]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:37:15.162930783 (81h8m2.860499099s) [noise=true , address=81.171.14.70:4048    , piece_id=2WT5CTUZTR42UO5SMMV4H6V632RLPDXQE66DGPYQS25Y7DXU7ROQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG): protocol: expected piece hash; context canceled; EOF
Dec  9 00:37:15.162937695 (81h8m2.860506001s) [noise=true , address=81.171.14.70:4048    , piece_id=2WT5CTUZTR42UO5SMMV4H6V632RLPDXQE66DGPYQS25Y7DXU7ROQ, seg_pos={0 0}, upload=71212]: Long tail cancellation due to optimal threshold
Dec  9 00:37:15.162991326 (81h8m2.860559632s) [noise=true , address=185.167.204.205:4004 , piece_id=OLPXFIH3ZCNF5XK5KCYA6APWJ5P4RFOF6VYM4EQYGH62XXFDOJNQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm): protocol: expected piece hash; context canceled; EOF
Dec  9 00:37:15.162998980 (81h8m2.860567286s) [noise=true , address=185.167.204.205:4004 , piece_id=OLPXFIH3ZCNF5XK5KCYA6APWJ5P4RFOF6VYM4EQYGH62XXFDOJNQ, seg_pos={0 0}, upload=71212]: Long tail cancellation due to optimal threshold
Dec  9 00:37:15.163014108 (81h8m2.860582424s) [seg_pos={0 0}, upload=71212]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:37:15.163084930 (81h8m2.860653246s) [upload=71212]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:37:15.163088838 (81h8m2.860657154s) [upload=71212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:37:15.320360762 (81h8m3.017929078s) [upload=71212]: Done uploading segments...
Dec  9 00:37:15.320374708 (81h8m3.017943024s) [upload=71212]: Upload finished. err: <nil>
Duration: 5.2313685s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
11 out of 60 is failed (threshold=3) [...............X.X.X..XX...X...X.........X........X...XX....]
duration: 
5.798437927s
trace: 
https://jaeger.dev.storj.io/trace/38524bad4deddf54
FAIL (2025-12-09 00:40:56 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
0:37:09.490875739 (81h7m57.188444055s) [noise=true , address=185.167.204.206:4053 , piece_id=QLUC44XY4O5JMCLFZPF7GXEA2NVMSZGK3BARHUVMJP4KIIR6AICA, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491119565 (81h7m57.188687901s) [noise=true , address=89.149.201.147:4024  , piece_id=IIC4GNME5FXLDGRAYJ65UFEN2ZQDAFH2MU32JBPUD35U6VJLM3CQ, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491159349 (81h7m57.188727665s) [noise=true , address=89.149.201.147:4002  , piece_id=5A7XWZ6JXWGZEMOB2MZI2ERNSU4QWMU5MTDK7JYA2FBLQ3ZPQPJQ, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491429032 (81h7m57.188997348s) [noise=true , address=185.167.204.206:4048 , piece_id=ALO4LP2E5LS6KWBRCHXXN5T3SY6ELH6XDQZKESUAE6SWGC233RHA, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491562311 (81h7m57.189130647s) [noise=true , address=81.171.14.70:4030    , piece_id=VUUJT5FBV5QY6LRGPQGHHQRGJQMFAEK73M72FNGMBGAYPBA6UG7A, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491685843 (81h7m57.189254159s) [noise=true , address=185.167.204.205:4004 , piece_id=OLPXFIH3ZCNF5XK5KCYA6APWJ5P4RFOF6VYM4EQYGH62XXFDOJNQ, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491964223 (81h7m57.189532539s) [noise=true , address=81.171.14.70:4028    , piece_id=5D6QTJWWSRFWUVGBJGPYGCNHPDCGE5ZR4D45PTZMKR7IFSYEMD5Q, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.492058819 (81h7m57.189627165s) [noise=true , address=81.171.14.70:4042    , piece_id=7DNMIFGMO3BHLWFOHR5HGN7LPO4TDO7FUAWBO7TUIEGINN2HOEWA, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.492527706 (81h7m57.190096051s) [noise=true , address=185.167.204.206:4043 , piece_id=FGAWPYIZNIR3CY2EF4W777XNVVOVPKWUFDMI7BVSRDH2XSHC3INQ, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.493007201 (81h7m57.190575537s) [noise=true , address=81.171.14.70:4026    , piece_id=PSHPWQ2ZBMWBULF45TOBEPXEPBBZIUY3BFPLXEHAHV5VMQO7OIKA, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.493493029 (81h7m57.191061365s) [noise=true , address=81.171.14.70:4036    , piece_id=L3QIBUO233ADPMS23NG5HERSQ22OG2EMWVWHOJIFOJVFBEX3LC4A, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.983937683 (81h7m57.681505999s) [upload=71212]: Next returned nil segment
Dec  9 00:37:09.983948663 (81h7m57.681516979s) [upload=71212]: Waiting for error group managing segments...
Dec  9 00:37:10.224411079 (81h7m57.921979395s) [noise=true , address=89.149.201.147:4001  , piece_id=ID2T2GAEFX76ZNYLZBWZM3KD7M7EYZDEVMCE656DBPKKZP6LHHSQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:10.226062234 (81h7m57.923630539s) [noise=true , address=185.167.204.205:4010 , piece_id=ZHPZHCSGB277G77GIBXUFTOYXXQCKZZQ3VFIJOH2BRGVVBPGZEZA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:10.270053380 (81h7m57.967621686s) [noise=true , address=185.167.204.206:4048 , piece_id=ALO4LP2E5LS6KWBRCHXXN5T3SY6ELH6XDQZKESUAE6SWGC233RHA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:10.286107950 (81h7m57.983676256s) [noise=true , address=81.171.14.70:4039    , piece_id=IACSWA6CH4UJUMWW2REHM7NBFSEVJ2N4WW5UMD4YJOFQK4DTO5UA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:10.322312129 (81h7m58.019880435s) [noise=true , address=89.149.201.147:4002  , piece_id=5A7XWZ6JXWGZEMOB2MZI2ERNSU4QWMU5MTDK7JYA2FBLQ3ZPQPJQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:10.666987785 (81h7m58.364556092s) [noise=true , address=185.167.204.205:4018 , piece_id=4A3NKFHE7DJTV24CG3S2REQ473IGGZ72QYGV7FP2F5WZEKJ6WUBQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.186066218 (81h7m58.883634525s) [noise=true , address=185.167.204.206:4060 , piece_id=VYWSVVOQUGFIL5BCOUG3NRSONFYWDDVVTMT6WK6CD4MQOHDZZKJA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.209083936 (81h7m58.906652243s) [noise=true , address=185.167.204.206:4053 , piece_id=QLUC44XY4O5JMCLFZPF7GXEA2NVMSZGK3BARHUVMJP4KIIR6AICA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.560894641 (81h7m59.258462967s) [noise=true , address=81.171.14.70:4030    , piece_id=VUUJT5FBV5QY6LRGPQGHHQRGJQMFAEK73M72FNGMBGAYPBA6UG7A, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.581256807 (81h7m59.278825153s) [noise=true , address=81.171.14.70:4035    , piece_id=G72LVKHT4XOW2LWLLC64PQAG53JMNCNET6A25PPGZSG4VZ5Z2TBA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.584865397 (81h7m59.282433734s) [noise=true , address=185.167.204.205:4015 , piece_id=UTG4QF3XQP3DZWMEJOVDHL4ND46G62TLUGPWQFEFVIHEDO63RGTA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.631255115 (81h7m59.328823451s) [noise=true , address=89.149.201.147:4023  , piece_id=VRNPTSSHKMCKD3FDWWKVPTMELHL45Z424K4YXRZTOOJDJW64YZHA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.632578908 (81h7m59.330147244s) [noise=true , address=81.171.14.70:4032    , piece_id=R6VRUBRULWHETGIVF5GELD5XGYXJXJMX7ZB6NEA2ZFJB4F4BK5PA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.794168909 (81h7m59.491737245s) [noise=true , address=89.149.201.147:4024  , piece_id=IIC4GNME5FXLDGRAYJ65UFEN2ZQDAFH2MU32JBPUD35U6VJLM3CQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.885734444 (81h7m59.58330278s) [noise=true , address=89.149.201.147:4014  , piece_id=VNQRXL6AP5PIMMDVECDJYXW27224OCB5RFMKUSVVHVI67JDJDAHQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.929502934 (81h7m59.62707128s) [noise=true , address=81.171.14.70:4026    , piece_id=PSHPWQ2ZBMWBULF45TOBEPXEPBBZIUY3BFPLXEHAHV5VMQO7OIKA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:12.418613577 (81h8m0.116181913s) [noise=true , address=81.171.14.70:4036    , piece_id=L3QIBUO233ADPMS23NG5HERSQ22OG2EMWVWHOJIFOJVFBEX3LC4A, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:12.422262583 (81h8m0.119830899s) [noise=true , address=81.171.14.70:4028    , piece_id=5D6QTJWWSRFWUVGBJGPYGCNHPDCGE5ZR4D45PTZMKR7IFSYEMD5Q, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:12.457174688 (81h8m0.154743024s) [noise=true , address=185.167.204.205:4003 , piece_id=NFXCTQNGAFR3D2NE6URHZZQX5VAUP62ECNFT27GARMWMKYCJVQQQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:13.048217611 (81h8m0.745785946s) [noise=true , address=185.167.204.205:4013 , piece_id=7J2TBRFWUX5VYBLNGPFQJWMX4Q73AYXMYO6OQ52QKEX3IJ65PMUQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:13.093771526 (81h8m0.791339863s) [noise=true , address=81.171.14.70:4042    , piece_id=7DNMIFGMO3BHLWFOHR5HGN7LPO4TDO7FUAWBO7TUIEGINN2HOEWA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:13.237640915 (81h8m0.935209241s) [noise=true , address=185.167.204.206:4043 , piece_id=FGAWPYIZNIR3CY2EF4W777XNVVOVPKWUFDMI7BVSRDH2XSHC3INQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:13.332322832 (81h8m1.029891168s) [noise=true , address=81.171.14.70:4047    , piece_id=CZM5C2FFHIWHHTGWFZOVVALBFC6H6F53MYDEAPAD46RGDPAMGK2A, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:13.504416634 (81h8m1.201984981s) [noise=true , address=89.149.201.147:4009  , piece_id=JU2NGEQULR5ZQFIPZV3NUKU3X6526T73C3BPMLYNPO4CQX55KGXQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:14.665602892 (81h8m2.363171227s) [noise=true , address=185.167.204.205:4027 , piece_id=E7TRR4ZDYJORLYGALA6HVWAHALRMZDKOVHGPEO2GAK6L7WMSPZKQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:15.162761226 (81h8m2.860329531s) [noise=true , address=81.171.14.70:4031    , piece_id=XUTF53T5KB7DCRJQC4Y2S4TJLKLKQEDJX4VB5CO7G3NKFCCYYX3A, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:15.162775793 (81h8m2.860344109s) [seg_pos={0 0}, upload=71212]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:37:15.162930783 (81h8m2.860499099s) [noise=true , address=81.171.14.70:4048    , piece_id=2WT5CTUZTR42UO5SMMV4H6V632RLPDXQE66DGPYQS25Y7DXU7ROQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG): protocol: expected piece hash; context canceled; EOF
Dec  9 00:37:15.162937695 (81h8m2.860506001s) [noise=true , address=81.171.14.70:4048    , piece_id=2WT5CTUZTR42UO5SMMV4H6V632RLPDXQE66DGPYQS25Y7DXU7ROQ, seg_pos={0 0}, upload=71212]: Long tail cancellation due to optimal threshold
Dec  9 00:37:15.162991326 (81h8m2.860559632s) [noise=true , address=185.167.204.205:4004 , piece_id=OLPXFIH3ZCNF5XK5KCYA6APWJ5P4RFOF6VYM4EQYGH62XXFDOJNQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm): protocol: expected piece hash; context canceled; EOF
Dec  9 00:37:15.162998980 (81h8m2.860567286s) [noise=true , address=185.167.204.205:4004 , piece_id=OLPXFIH3ZCNF5XK5KCYA6APWJ5P4RFOF6VYM4EQYGH62XXFDOJNQ, seg_pos={0 0}, upload=71212]: Long tail cancellation due to optimal threshold
Dec  9 00:37:15.163014108 (81h8m2.860582424s) [seg_pos={0 0}, upload=71212]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:37:15.163084930 (81h8m2.860653246s) [upload=71212]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:37:15.163088838 (81h8m2.860657154s) [upload=71212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:37:15.320360762 (81h8m3.017929078s) [upload=71212]: Done uploading segments...
Dec  9 00:37:15.320374708 (81h8m3.017943024s) [upload=71212]: Upload finished. err: <nil>
Duration: 5.798466071s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
11 out of 60 is failed (threshold=3) [................X.X.X..XX...X...X.........X........X...XX...]
duration: 
29.772783512s
trace: 
https://jaeger.dev.storj.io/trace/38524bad4deddf54
FAIL (2025-12-09 00:40:19 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
0:37:09.490875739 (81h7m57.188444055s) [noise=true , address=185.167.204.206:4053 , piece_id=QLUC44XY4O5JMCLFZPF7GXEA2NVMSZGK3BARHUVMJP4KIIR6AICA, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491119565 (81h7m57.188687901s) [noise=true , address=89.149.201.147:4024  , piece_id=IIC4GNME5FXLDGRAYJ65UFEN2ZQDAFH2MU32JBPUD35U6VJLM3CQ, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491159349 (81h7m57.188727665s) [noise=true , address=89.149.201.147:4002  , piece_id=5A7XWZ6JXWGZEMOB2MZI2ERNSU4QWMU5MTDK7JYA2FBLQ3ZPQPJQ, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491429032 (81h7m57.188997348s) [noise=true , address=185.167.204.206:4048 , piece_id=ALO4LP2E5LS6KWBRCHXXN5T3SY6ELH6XDQZKESUAE6SWGC233RHA, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491562311 (81h7m57.189130647s) [noise=true , address=81.171.14.70:4030    , piece_id=VUUJT5FBV5QY6LRGPQGHHQRGJQMFAEK73M72FNGMBGAYPBA6UG7A, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491685843 (81h7m57.189254159s) [noise=true , address=185.167.204.205:4004 , piece_id=OLPXFIH3ZCNF5XK5KCYA6APWJ5P4RFOF6VYM4EQYGH62XXFDOJNQ, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491964223 (81h7m57.189532539s) [noise=true , address=81.171.14.70:4028    , piece_id=5D6QTJWWSRFWUVGBJGPYGCNHPDCGE5ZR4D45PTZMKR7IFSYEMD5Q, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.492058819 (81h7m57.189627165s) [noise=true , address=81.171.14.70:4042    , piece_id=7DNMIFGMO3BHLWFOHR5HGN7LPO4TDO7FUAWBO7TUIEGINN2HOEWA, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.492527706 (81h7m57.190096051s) [noise=true , address=185.167.204.206:4043 , piece_id=FGAWPYIZNIR3CY2EF4W777XNVVOVPKWUFDMI7BVSRDH2XSHC3INQ, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.493007201 (81h7m57.190575537s) [noise=true , address=81.171.14.70:4026    , piece_id=PSHPWQ2ZBMWBULF45TOBEPXEPBBZIUY3BFPLXEHAHV5VMQO7OIKA, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.493493029 (81h7m57.191061365s) [noise=true , address=81.171.14.70:4036    , piece_id=L3QIBUO233ADPMS23NG5HERSQ22OG2EMWVWHOJIFOJVFBEX3LC4A, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.983937683 (81h7m57.681505999s) [upload=71212]: Next returned nil segment
Dec  9 00:37:09.983948663 (81h7m57.681516979s) [upload=71212]: Waiting for error group managing segments...
Dec  9 00:37:10.224411079 (81h7m57.921979395s) [noise=true , address=89.149.201.147:4001  , piece_id=ID2T2GAEFX76ZNYLZBWZM3KD7M7EYZDEVMCE656DBPKKZP6LHHSQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:10.226062234 (81h7m57.923630539s) [noise=true , address=185.167.204.205:4010 , piece_id=ZHPZHCSGB277G77GIBXUFTOYXXQCKZZQ3VFIJOH2BRGVVBPGZEZA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:10.270053380 (81h7m57.967621686s) [noise=true , address=185.167.204.206:4048 , piece_id=ALO4LP2E5LS6KWBRCHXXN5T3SY6ELH6XDQZKESUAE6SWGC233RHA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:10.286107950 (81h7m57.983676256s) [noise=true , address=81.171.14.70:4039    , piece_id=IACSWA6CH4UJUMWW2REHM7NBFSEVJ2N4WW5UMD4YJOFQK4DTO5UA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:10.322312129 (81h7m58.019880435s) [noise=true , address=89.149.201.147:4002  , piece_id=5A7XWZ6JXWGZEMOB2MZI2ERNSU4QWMU5MTDK7JYA2FBLQ3ZPQPJQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:10.666987785 (81h7m58.364556092s) [noise=true , address=185.167.204.205:4018 , piece_id=4A3NKFHE7DJTV24CG3S2REQ473IGGZ72QYGV7FP2F5WZEKJ6WUBQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.186066218 (81h7m58.883634525s) [noise=true , address=185.167.204.206:4060 , piece_id=VYWSVVOQUGFIL5BCOUG3NRSONFYWDDVVTMT6WK6CD4MQOHDZZKJA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.209083936 (81h7m58.906652243s) [noise=true , address=185.167.204.206:4053 , piece_id=QLUC44XY4O5JMCLFZPF7GXEA2NVMSZGK3BARHUVMJP4KIIR6AICA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.560894641 (81h7m59.258462967s) [noise=true , address=81.171.14.70:4030    , piece_id=VUUJT5FBV5QY6LRGPQGHHQRGJQMFAEK73M72FNGMBGAYPBA6UG7A, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.581256807 (81h7m59.278825153s) [noise=true , address=81.171.14.70:4035    , piece_id=G72LVKHT4XOW2LWLLC64PQAG53JMNCNET6A25PPGZSG4VZ5Z2TBA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.584865397 (81h7m59.282433734s) [noise=true , address=185.167.204.205:4015 , piece_id=UTG4QF3XQP3DZWMEJOVDHL4ND46G62TLUGPWQFEFVIHEDO63RGTA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.631255115 (81h7m59.328823451s) [noise=true , address=89.149.201.147:4023  , piece_id=VRNPTSSHKMCKD3FDWWKVPTMELHL45Z424K4YXRZTOOJDJW64YZHA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.632578908 (81h7m59.330147244s) [noise=true , address=81.171.14.70:4032    , piece_id=R6VRUBRULWHETGIVF5GELD5XGYXJXJMX7ZB6NEA2ZFJB4F4BK5PA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.794168909 (81h7m59.491737245s) [noise=true , address=89.149.201.147:4024  , piece_id=IIC4GNME5FXLDGRAYJ65UFEN2ZQDAFH2MU32JBPUD35U6VJLM3CQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.885734444 (81h7m59.58330278s) [noise=true , address=89.149.201.147:4014  , piece_id=VNQRXL6AP5PIMMDVECDJYXW27224OCB5RFMKUSVVHVI67JDJDAHQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.929502934 (81h7m59.62707128s) [noise=true , address=81.171.14.70:4026    , piece_id=PSHPWQ2ZBMWBULF45TOBEPXEPBBZIUY3BFPLXEHAHV5VMQO7OIKA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:12.418613577 (81h8m0.116181913s) [noise=true , address=81.171.14.70:4036    , piece_id=L3QIBUO233ADPMS23NG5HERSQ22OG2EMWVWHOJIFOJVFBEX3LC4A, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:12.422262583 (81h8m0.119830899s) [noise=true , address=81.171.14.70:4028    , piece_id=5D6QTJWWSRFWUVGBJGPYGCNHPDCGE5ZR4D45PTZMKR7IFSYEMD5Q, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:12.457174688 (81h8m0.154743024s) [noise=true , address=185.167.204.205:4003 , piece_id=NFXCTQNGAFR3D2NE6URHZZQX5VAUP62ECNFT27GARMWMKYCJVQQQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:13.048217611 (81h8m0.745785946s) [noise=true , address=185.167.204.205:4013 , piece_id=7J2TBRFWUX5VYBLNGPFQJWMX4Q73AYXMYO6OQ52QKEX3IJ65PMUQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:13.093771526 (81h8m0.791339863s) [noise=true , address=81.171.14.70:4042    , piece_id=7DNMIFGMO3BHLWFOHR5HGN7LPO4TDO7FUAWBO7TUIEGINN2HOEWA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:13.237640915 (81h8m0.935209241s) [noise=true , address=185.167.204.206:4043 , piece_id=FGAWPYIZNIR3CY2EF4W777XNVVOVPKWUFDMI7BVSRDH2XSHC3INQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:13.332322832 (81h8m1.029891168s) [noise=true , address=81.171.14.70:4047    , piece_id=CZM5C2FFHIWHHTGWFZOVVALBFC6H6F53MYDEAPAD46RGDPAMGK2A, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:13.504416634 (81h8m1.201984981s) [noise=true , address=89.149.201.147:4009  , piece_id=JU2NGEQULR5ZQFIPZV3NUKU3X6526T73C3BPMLYNPO4CQX55KGXQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:14.665602892 (81h8m2.363171227s) [noise=true , address=185.167.204.205:4027 , piece_id=E7TRR4ZDYJORLYGALA6HVWAHALRMZDKOVHGPEO2GAK6L7WMSPZKQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:15.162761226 (81h8m2.860329531s) [noise=true , address=81.171.14.70:4031    , piece_id=XUTF53T5KB7DCRJQC4Y2S4TJLKLKQEDJX4VB5CO7G3NKFCCYYX3A, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:15.162775793 (81h8m2.860344109s) [seg_pos={0 0}, upload=71212]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:37:15.162930783 (81h8m2.860499099s) [noise=true , address=81.171.14.70:4048    , piece_id=2WT5CTUZTR42UO5SMMV4H6V632RLPDXQE66DGPYQS25Y7DXU7ROQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG): protocol: expected piece hash; context canceled; EOF
Dec  9 00:37:15.162937695 (81h8m2.860506001s) [noise=true , address=81.171.14.70:4048    , piece_id=2WT5CTUZTR42UO5SMMV4H6V632RLPDXQE66DGPYQS25Y7DXU7ROQ, seg_pos={0 0}, upload=71212]: Long tail cancellation due to optimal threshold
Dec  9 00:37:15.162991326 (81h8m2.860559632s) [noise=true , address=185.167.204.205:4004 , piece_id=OLPXFIH3ZCNF5XK5KCYA6APWJ5P4RFOF6VYM4EQYGH62XXFDOJNQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm): protocol: expected piece hash; context canceled; EOF
Dec  9 00:37:15.162998980 (81h8m2.860567286s) [noise=true , address=185.167.204.205:4004 , piece_id=OLPXFIH3ZCNF5XK5KCYA6APWJ5P4RFOF6VYM4EQYGH62XXFDOJNQ, seg_pos={0 0}, upload=71212]: Long tail cancellation due to optimal threshold
Dec  9 00:37:15.163014108 (81h8m2.860582424s) [seg_pos={0 0}, upload=71212]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:37:15.163084930 (81h8m2.860653246s) [upload=71212]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:37:15.163088838 (81h8m2.860657154s) [upload=71212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:37:15.320360762 (81h8m3.017929078s) [upload=71212]: Done uploading segments...
Dec  9 00:37:15.320374708 (81h8m3.017943024s) [upload=71212]: Upload finished. err: <nil>
Duration: 29.772805232s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
11 out of 60 is failed (threshold=3) [.................X.X.X..XX...X...X.........X........X...XX..]
duration: 
29.142028859s
trace: 
https://jaeger.dev.storj.io/trace/38524bad4deddf54
FAIL (2025-12-09 00:39:47 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
0:37:09.490875739 (81h7m57.188444055s) [noise=true , address=185.167.204.206:4053 , piece_id=QLUC44XY4O5JMCLFZPF7GXEA2NVMSZGK3BARHUVMJP4KIIR6AICA, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491119565 (81h7m57.188687901s) [noise=true , address=89.149.201.147:4024  , piece_id=IIC4GNME5FXLDGRAYJ65UFEN2ZQDAFH2MU32JBPUD35U6VJLM3CQ, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491159349 (81h7m57.188727665s) [noise=true , address=89.149.201.147:4002  , piece_id=5A7XWZ6JXWGZEMOB2MZI2ERNSU4QWMU5MTDK7JYA2FBLQ3ZPQPJQ, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491429032 (81h7m57.188997348s) [noise=true , address=185.167.204.206:4048 , piece_id=ALO4LP2E5LS6KWBRCHXXN5T3SY6ELH6XDQZKESUAE6SWGC233RHA, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491562311 (81h7m57.189130647s) [noise=true , address=81.171.14.70:4030    , piece_id=VUUJT5FBV5QY6LRGPQGHHQRGJQMFAEK73M72FNGMBGAYPBA6UG7A, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491685843 (81h7m57.189254159s) [noise=true , address=185.167.204.205:4004 , piece_id=OLPXFIH3ZCNF5XK5KCYA6APWJ5P4RFOF6VYM4EQYGH62XXFDOJNQ, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.491964223 (81h7m57.189532539s) [noise=true , address=81.171.14.70:4028    , piece_id=5D6QTJWWSRFWUVGBJGPYGCNHPDCGE5ZR4D45PTZMKR7IFSYEMD5Q, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.492058819 (81h7m57.189627165s) [noise=true , address=81.171.14.70:4042    , piece_id=7DNMIFGMO3BHLWFOHR5HGN7LPO4TDO7FUAWBO7TUIEGINN2HOEWA, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.492527706 (81h7m57.190096051s) [noise=true , address=185.167.204.206:4043 , piece_id=FGAWPYIZNIR3CY2EF4W777XNVVOVPKWUFDMI7BVSRDH2XSHC3INQ, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.493007201 (81h7m57.190575537s) [noise=true , address=81.171.14.70:4026    , piece_id=PSHPWQ2ZBMWBULF45TOBEPXEPBBZIUY3BFPLXEHAHV5VMQO7OIKA, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.493493029 (81h7m57.191061365s) [noise=true , address=81.171.14.70:4036    , piece_id=L3QIBUO233ADPMS23NG5HERSQ22OG2EMWVWHOJIFOJVFBEX3LC4A, seg_pos={0 0}, upload=71212]: Uploading piece...
Dec  9 00:37:09.983937683 (81h7m57.681505999s) [upload=71212]: Next returned nil segment
Dec  9 00:37:09.983948663 (81h7m57.681516979s) [upload=71212]: Waiting for error group managing segments...
Dec  9 00:37:10.224411079 (81h7m57.921979395s) [noise=true , address=89.149.201.147:4001  , piece_id=ID2T2GAEFX76ZNYLZBWZM3KD7M7EYZDEVMCE656DBPKKZP6LHHSQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:10.226062234 (81h7m57.923630539s) [noise=true , address=185.167.204.205:4010 , piece_id=ZHPZHCSGB277G77GIBXUFTOYXXQCKZZQ3VFIJOH2BRGVVBPGZEZA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:10.270053380 (81h7m57.967621686s) [noise=true , address=185.167.204.206:4048 , piece_id=ALO4LP2E5LS6KWBRCHXXN5T3SY6ELH6XDQZKESUAE6SWGC233RHA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:10.286107950 (81h7m57.983676256s) [noise=true , address=81.171.14.70:4039    , piece_id=IACSWA6CH4UJUMWW2REHM7NBFSEVJ2N4WW5UMD4YJOFQK4DTO5UA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:10.322312129 (81h7m58.019880435s) [noise=true , address=89.149.201.147:4002  , piece_id=5A7XWZ6JXWGZEMOB2MZI2ERNSU4QWMU5MTDK7JYA2FBLQ3ZPQPJQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:10.666987785 (81h7m58.364556092s) [noise=true , address=185.167.204.205:4018 , piece_id=4A3NKFHE7DJTV24CG3S2REQ473IGGZ72QYGV7FP2F5WZEKJ6WUBQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.186066218 (81h7m58.883634525s) [noise=true , address=185.167.204.206:4060 , piece_id=VYWSVVOQUGFIL5BCOUG3NRSONFYWDDVVTMT6WK6CD4MQOHDZZKJA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.209083936 (81h7m58.906652243s) [noise=true , address=185.167.204.206:4053 , piece_id=QLUC44XY4O5JMCLFZPF7GXEA2NVMSZGK3BARHUVMJP4KIIR6AICA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.560894641 (81h7m59.258462967s) [noise=true , address=81.171.14.70:4030    , piece_id=VUUJT5FBV5QY6LRGPQGHHQRGJQMFAEK73M72FNGMBGAYPBA6UG7A, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.581256807 (81h7m59.278825153s) [noise=true , address=81.171.14.70:4035    , piece_id=G72LVKHT4XOW2LWLLC64PQAG53JMNCNET6A25PPGZSG4VZ5Z2TBA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.584865397 (81h7m59.282433734s) [noise=true , address=185.167.204.205:4015 , piece_id=UTG4QF3XQP3DZWMEJOVDHL4ND46G62TLUGPWQFEFVIHEDO63RGTA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.631255115 (81h7m59.328823451s) [noise=true , address=89.149.201.147:4023  , piece_id=VRNPTSSHKMCKD3FDWWKVPTMELHL45Z424K4YXRZTOOJDJW64YZHA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.632578908 (81h7m59.330147244s) [noise=true , address=81.171.14.70:4032    , piece_id=R6VRUBRULWHETGIVF5GELD5XGYXJXJMX7ZB6NEA2ZFJB4F4BK5PA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.794168909 (81h7m59.491737245s) [noise=true , address=89.149.201.147:4024  , piece_id=IIC4GNME5FXLDGRAYJ65UFEN2ZQDAFH2MU32JBPUD35U6VJLM3CQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.885734444 (81h7m59.58330278s) [noise=true , address=89.149.201.147:4014  , piece_id=VNQRXL6AP5PIMMDVECDJYXW27224OCB5RFMKUSVVHVI67JDJDAHQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:11.929502934 (81h7m59.62707128s) [noise=true , address=81.171.14.70:4026    , piece_id=PSHPWQ2ZBMWBULF45TOBEPXEPBBZIUY3BFPLXEHAHV5VMQO7OIKA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:12.418613577 (81h8m0.116181913s) [noise=true , address=81.171.14.70:4036    , piece_id=L3QIBUO233ADPMS23NG5HERSQ22OG2EMWVWHOJIFOJVFBEX3LC4A, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:12.422262583 (81h8m0.119830899s) [noise=true , address=81.171.14.70:4028    , piece_id=5D6QTJWWSRFWUVGBJGPYGCNHPDCGE5ZR4D45PTZMKR7IFSYEMD5Q, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:12.457174688 (81h8m0.154743024s) [noise=true , address=185.167.204.205:4003 , piece_id=NFXCTQNGAFR3D2NE6URHZZQX5VAUP62ECNFT27GARMWMKYCJVQQQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:13.048217611 (81h8m0.745785946s) [noise=true , address=185.167.204.205:4013 , piece_id=7J2TBRFWUX5VYBLNGPFQJWMX4Q73AYXMYO6OQ52QKEX3IJ65PMUQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:13.093771526 (81h8m0.791339863s) [noise=true , address=81.171.14.70:4042    , piece_id=7DNMIFGMO3BHLWFOHR5HGN7LPO4TDO7FUAWBO7TUIEGINN2HOEWA, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:13.237640915 (81h8m0.935209241s) [noise=true , address=185.167.204.206:4043 , piece_id=FGAWPYIZNIR3CY2EF4W777XNVVOVPKWUFDMI7BVSRDH2XSHC3INQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:13.332322832 (81h8m1.029891168s) [noise=true , address=81.171.14.70:4047    , piece_id=CZM5C2FFHIWHHTGWFZOVVALBFC6H6F53MYDEAPAD46RGDPAMGK2A, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:13.504416634 (81h8m1.201984981s) [noise=true , address=89.149.201.147:4009  , piece_id=JU2NGEQULR5ZQFIPZV3NUKU3X6526T73C3BPMLYNPO4CQX55KGXQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:14.665602892 (81h8m2.363171227s) [noise=true , address=185.167.204.205:4027 , piece_id=E7TRR4ZDYJORLYGALA6HVWAHALRMZDKOVHGPEO2GAK6L7WMSPZKQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:15.162761226 (81h8m2.860329531s) [noise=true , address=81.171.14.70:4031    , piece_id=XUTF53T5KB7DCRJQC4Y2S4TJLKLKQEDJX4VB5CO7G3NKFCCYYX3A, seg_pos={0 0}, upload=71212]: Done uploading piece. err: <nil>
Dec  9 00:37:15.162775793 (81h8m2.860344109s) [seg_pos={0 0}, upload=71212]: Segment reached optimal threshold of 26 pieces.
Dec  9 00:37:15.162930783 (81h8m2.860499099s) [noise=true , address=81.171.14.70:4048    , piece_id=2WT5CTUZTR42UO5SMMV4H6V632RLPDXQE66DGPYQS25Y7DXU7ROQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG): protocol: expected piece hash; context canceled; EOF
Dec  9 00:37:15.162937695 (81h8m2.860506001s) [noise=true , address=81.171.14.70:4048    , piece_id=2WT5CTUZTR42UO5SMMV4H6V632RLPDXQE66DGPYQS25Y7DXU7ROQ, seg_pos={0 0}, upload=71212]: Long tail cancellation due to optimal threshold
Dec  9 00:37:15.162991326 (81h8m2.860559632s) [noise=true , address=185.167.204.205:4004 , piece_id=OLPXFIH3ZCNF5XK5KCYA6APWJ5P4RFOF6VYM4EQYGH62XXFDOJNQ, seg_pos={0 0}, upload=71212]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm): protocol: expected piece hash; context canceled; EOF
Dec  9 00:37:15.162998980 (81h8m2.860567286s) [noise=true , address=185.167.204.205:4004 , piece_id=OLPXFIH3ZCNF5XK5KCYA6APWJ5P4RFOF6VYM4EQYGH62XXFDOJNQ, seg_pos={0 0}, upload=71212]: Long tail cancellation due to optimal threshold
Dec  9 00:37:15.163014108 (81h8m2.860582424s) [seg_pos={0 0}, upload=71212]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec  9 00:37:15.163084930 (81h8m2.860653246s) [upload=71212]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  9 00:37:15.163088838 (81h8m2.860657154s) [upload=71212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  9 00:37:15.320360762 (81h8m3.017929078s) [upload=71212]: Done uploading segments...
Dec  9 00:37:15.320374708 (81h8m3.017943024s) [upload=71212]: Upload finished. err: <nil>
Duration: 29.142048997s core uplink eu-select-1 eu1-placement-15