Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [X.X..X......................................................] duration:
2.615272831s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 02:14:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.615292026s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [XX.X..X.....................................................] duration:
2.835783302s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 02:13:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.835807757s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.XX.X..X....................................................] duration:
2.655961301s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 02:12:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.655985827s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [X.XX.X..X...................................................] duration:
2.196658477s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 02:11:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.196678024s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
6 out of 60 is failed (threshold=3) [XX.XX.X..X..................................................] duration:
29.472464893s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 02:10:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 29.472492955s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
7 out of 60 is failed (threshold=3) [XXX.XX.X..X.................................................] duration:
4.029884813s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 02:09:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 4.0299045s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
7 out of 60 is failed (threshold=3) [.XXX.XX.X..X................................................] duration:
2.617832343s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 02:08:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.617853792s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
7 out of 60 is failed (threshold=3) [..XXX.XX.X..X...............................................] duration:
2.657381138s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 02:06:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.657396036s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
7 out of 60 is failed (threshold=3) [...XXX.XX.X..X..............................................] duration:
2.743985662s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 02:06:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.74400664s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
7 out of 60 is failed (threshold=3) [....XXX.XX.X..X.............................................] duration:
2.654658147s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 02:04:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.654675659s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
7 out of 60 is failed (threshold=3) [.....XXX.XX.X..X............................................] duration:
2.158429554s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 02:03:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.158446747s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
7 out of 60 is failed (threshold=3) [......XXX.XX.X..X...........................................] duration:
2.694050371s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 02:03:26 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.694074214s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
7 out of 60 is failed (threshold=3) [.......XXX.XX.X..X..........................................] duration:
2.869823475s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 02:02:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.869851026s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
7 out of 60 is failed (threshold=3) [........XXX.XX.X..X.........................................] duration:
2.641471042s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 02:01:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.641491671s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
7 out of 60 is failed (threshold=3) [.........XXX.XX.X..X........................................] duration:
2.257804658s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 02:00:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.257822441s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
7 out of 60 is failed (threshold=3) [..........XXX.XX.X..X.......................................] duration:
2.787476348s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 02:00:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.787496677s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
7 out of 60 is failed (threshold=3) [...........XXX.XX.X..X......................................] duration:
2.279971663s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:59:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.279994215s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
8 out of 60 is failed (threshold=3) [X...........XXX.XX.X..X.....................................] duration:
2.69091646s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:58:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.690939583s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
8 out of 60 is failed (threshold=3) [.X...........XXX.XX.X..X....................................] duration:
2.185527399s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:57:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.185551152s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
9 out of 60 is failed (threshold=3) [X.X...........XXX.XX.X..X...................................] duration:
2.259827571s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:56:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.25984837s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
9 out of 60 is failed (threshold=3) [.X.X...........XXX.XX.X..X..................................] duration:
2.734523461s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:56:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.734536185s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
9 out of 60 is failed (threshold=3) [..X.X...........XXX.XX.X..X.................................] duration:
2.746150189s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:55:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.746171347s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
9 out of 60 is failed (threshold=3) [...X.X...........XXX.XX.X..X................................] duration:
2.213022273s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:54:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.213040097s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
9 out of 60 is failed (threshold=3) [....X.X...........XXX.XX.X..X...............................] duration:
2.679583447s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:53:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.67960131s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
9 out of 60 is failed (threshold=3) [.....X.X...........XXX.XX.X..X..............................] duration:
2.688907507s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:52:49 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.688924869s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
9 out of 60 is failed (threshold=3) [......X.X...........XXX.XX.X..X.............................] duration:
2.671563585s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:52:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.671580818s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
9 out of 60 is failed (threshold=3) [.......X.X...........XXX.XX.X..X............................] duration:
2.622328318s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:51:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.622449896s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
10 out of 60 is failed (threshold=3) [X.......X.X...........XXX.XX.X..X...........................] duration:
2.292101793s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:51:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.292125779s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
10 out of 60 is failed (threshold=3) [.X.......X.X...........XXX.XX.X..X..........................] duration:
2.152688118s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:50:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.152703266s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
10 out of 60 is failed (threshold=3) [..X.......X.X...........XXX.XX.X..X.........................] duration:
2.243117053s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:50:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.243158942s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
10 out of 60 is failed (threshold=3) [...X.......X.X...........XXX.XX.X..X........................] duration:
2.229990591s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:49:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.230014557s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
10 out of 60 is failed (threshold=3) [....X.......X.X...........XXX.XX.X..X.......................] duration:
2.159136636s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:49:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.159160402s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
10 out of 60 is failed (threshold=3) [.....X.......X.X...........XXX.XX.X..X......................] duration:
2.620695347s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:48:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.62071833s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
10 out of 60 is failed (threshold=3) [......X.......X.X...........XXX.XX.X..X.....................] duration:
2.680002422s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:48:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.680026307s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
11 out of 60 is failed (threshold=3) [X......X.......X.X...........XXX.XX.X..X....................] duration:
2.214166119s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:47:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.214184694s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
12 out of 60 is failed (threshold=3) [XX......X.......X.X...........XXX.XX.X..X...................] duration:
2.653711205s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:46:49 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.653734839s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
13 out of 60 is failed (threshold=3) [XXX......X.......X.X...........XXX.XX.X..X..................] duration:
2.617692506s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:45:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.617725668s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
14 out of 60 is failed (threshold=3) [XXXX......X.......X.X...........XXX.XX.X..X.................] duration:
2.656491348s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:45:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.656511906s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
14 out of 60 is failed (threshold=3) [.XXXX......X.......X.X...........XXX.XX.X..X................] duration:
2.61862547s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:44:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.61864642s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
14 out of 60 is failed (threshold=3) [..XXXX......X.......X.X...........XXX.XX.X..X...............] duration:
2.682488213s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:44:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.682499284s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
15 out of 60 is failed (threshold=3) [X..XXXX......X.......X.X...........XXX.XX.X..X..............] duration:
2.209452514s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:43:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.209470206s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
15 out of 60 is failed (threshold=3) [.X..XXXX......X.......X.X...........XXX.XX.X..X.............] duration:
2.590350563s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:42:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.590370611s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
16 out of 60 is failed (threshold=3) [X.X..XXXX......X.......X.X...........XXX.XX.X..X............] duration:
2.566414099s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:41:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.566438325s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
17 out of 60 is failed (threshold=3) [XX.X..XXXX......X.......X.X...........XXX.XX.X..X...........] duration:
2.60179779s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:41:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.601819931s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
18 out of 60 is failed (threshold=3) [XXX.X..XXXX......X.......X.X...........XXX.XX.X..X..........] duration:
2.599440221s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:40:26 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.599464496s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
19 out of 60 is failed (threshold=3) [XXXX.X..XXXX......X.......X.X...........XXX.XX.X..X.........] duration:
2.610037982s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:40:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.610053922s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
20 out of 60 is failed (threshold=3) [XXXXX.X..XXXX......X.......X.X...........XXX.XX.X..X........] duration:
2.723211001s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:39:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.723232932s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
21 out of 60 is failed (threshold=3) [XXXXXX.X..XXXX......X.......X.X...........XXX.XX.X..X.......] duration:
2.39835209s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:38:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.398370946s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
22 out of 60 is failed (threshold=3) [XXXXXXX.X..XXXX......X.......X.X...........XXX.XX.X..X......] duration:
2.711441335s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:37:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.711459749s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
22 out of 60 is failed (threshold=3) [.XXXXXXX.X..XXXX......X.......X.X...........XXX.XX.X..X.....] duration:
2.23171789s trace:
https://jaeger.dev.storj.io/trace/202d60131efd69df
FAIL (2026-01-01 01:37:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 18)
======LOGS======
LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136866283 (634h3m21.834434629s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.136873006 (634h3m21.834441342s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.137591488 (634h3m21.835159824s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.138183304 (634h3m21.835751639s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:34.142784067 (634h3m21.840352404s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Uploading piece...
Jan 1 01:32:36.882879762 (634h3m24.580448098s) [upload=557793]: Next returned nil segment
Jan 1 01:32:36.882896873 (634h3m24.58046526s) [upload=557793]: Waiting for error group managing segments...
Jan 1 01:32:38.820585647 (634h3m26.518153984s) [noise=true , address=185.167.204.205:4029 , piece_id=XGCPJFHMSZRUOQG5CGEBQDXUO3S275GWOCX5ZSXALYN74ETOZ2AA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.640989521 (634h4m7.338557827s) [noise=true , address=89.149.201.147:4011 , piece_id=7WSNIMVE7VFDAD6OMLRVSQRYVQQC45QCGHWDY2RHK3LEH7MSKWDA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:19.826457724 (634h4m7.52402604s) [noise=true , address=81.171.14.70:4036 , piece_id=BFLIU3P6FR6LOZP7HRTAGJUQIT2Y3URDKJ7LYFFRQZICZ7BRHLPA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.054319458 (634h4m8.751887794s) [noise=true , address=185.167.204.206:4063 , piece_id=6PZZ72IKUB2GIYRPCD4VWIV3KFCU2BIHRHUYJ5WSQXFYC5N2AIAA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.062265873 (634h4m8.75983422s) [noise=true , address=81.171.14.70:4043 , piece_id=4F2VBNHGFST72XR4WJMGO2Y2WFS5OTBUGO7GGURGORUDIDEJO4QQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:21.376510216 (634h4m9.074078561s) [noise=true , address=89.149.201.147:4020 , piece_id=OK6GOHJ66M3ZZDY52SB6GYADYVVJQVHHVZ6VBJBE7EN3RNALT7NQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:22.460154807 (634h4m10.157723143s) [noise=true , address=81.171.14.70:4031 , piece_id=4OFVMESNUK5ZSMCP67NBJYHGJOY3GN63XVP2GSCXSN2FGSJDFDOA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:23.466646037 (634h4m11.164214344s) [noise=true , address=185.167.204.206:4056 , piece_id=BBFSIWB6EZBKU57S5G2IF6GHQ4PYAZY7PEB2G6IZCGXI2CQKRK7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.626871483 (634h4m13.32443983s) [noise=true , address=185.167.204.206:4038 , piece_id=RTGMBXZH5UERWQKJZSODI6XIBQH46YZDQVBAILKLN4EFA2LU6GMA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:25.680196581 (634h4m13.377764918s) [noise=true , address=89.149.201.147:4017 , piece_id=H2F6IXJJNGOKPO7ENLQ625JAGVTXLIRVXF3KOFQBL54NSTMI7N7A, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:26.283578010 (634h4m13.981146356s) [noise=true , address=81.171.14.70:4026 , piece_id=4EPANSBWYGRT3LLQJUII7ZR7EIMGD2RDVRMGXCSQJJYJ45QLOPHA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.418728907 (634h4m17.116297244s) [noise=true , address=185.167.204.206:4046 , piece_id=SXZAJ2A36THYCPJUF5JEULGXY532RSC65MOBKSCG5PNUQHX6NSFA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:29.547886558 (634h4m17.245454894s) [noise=true , address=81.171.14.70:4040 , piece_id=KZMBRVUZXUIQ3B2AM6JNXGUN5HKAUYU6FBWDMSMHTIXWNBYZ4SGQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.494818818 (634h4m19.192387165s) [noise=true , address=185.167.204.205:4005 , piece_id=GNFXLSQH2TT7QARBDMK65XEWCMK6W5SJ6RIFHIOIDTH4A4H7L3RQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.495446351 (634h4m19.193014687s) [noise=true , address=185.167.204.205:4030 , piece_id=RQVMSF276CJOMONY4IN4E5ZTX4WL4MHQEZ6GJVJZ7XQNROVECGSA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.540578342 (634h4m19.238146688s) [noise=true , address=185.167.204.206:4052 , piece_id=BTHGXEG5OJXUJAVUK5DKXAPVW636EQM4WB2XVFXQSQSXO7CTPRJQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:31.561010051 (634h4m19.258578387s) [noise=true , address=89.149.201.147:4009 , piece_id=VIA7GRJNTNAWEJSK4LLR7D2FCKBXCBO46QVFYZ4OEA2QL5E23QKA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.480566423 (634h4m21.178134729s) [noise=true , address=81.171.14.70:4025 , piece_id=CLGHRG7EYQE5BVR4OJ5M6HYRGXZBWI44M3OH2QCMVS47YN5HJU7Q, seg_pos={0 0}, upload=557793]: Done uploading piece. err: <nil>
Jan 1 01:33:33.743538782 (634h4m21.441107098s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUTNIOKAQ6PJ4OIAUEVTVQEPB64LB3YNQIW6HT5LXHTVV5KA6HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743677591 (634h4m21.441245907s) [noise=true , address=81.171.14.70:4037 , piece_id=SSKNWZCW5LEKITMPPS5UGKTFDNOU6QDXJ2MBBRLAGUTJIBXLEGOQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: rpc: dial tcp 81.171.14.70:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743704522 (634h4m21.441272838s) [noise=true , address=185.167.204.206:4067 , piece_id=VCSGYV3GTLENBS3KXGLSQEK6YLB5K67JUEQPOQGQS4BBS7Y2CKFQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12khRPUvAHZgwi8rajx8TYpzujWybn3tcwZeG81R7JzHFRGL8PS, address:185.167.204.206:4067): protocol: rpc: dial tcp 185.167.204.206:4067: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743796854 (634h4m21.44136517s) [noise=true , address=81.171.14.70:4034 , piece_id=FN3XJ6YC77V5LZVNHGYLRDUDXIE5P7UZMB3L2ZHWOUN47E7256VA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: rpc: dial tcp 81.171.14.70:4034: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jan 1 01:33:33.743822432 (634h4m21.441390748s) [noise=true , address=81.171.14.70:4029 , piece_id=CV4D72T32KFITZWMFR456BUIMVDQMHNWBAKRDIG7JKSVBMBAY4HQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: read tcp 5.161.89.252:59698->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.743873678 (634h4m21.441441994s) [noise=true , address=89.149.201.147:4007 , piece_id=RSNFXGCGTUEREZ5DZUAS2UKJTOIC3BYVKV4N2T6UE6BXU7PZK4PQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.743904515 (634h4m21.441472821s) [noise=true , address=185.167.204.206:4059 , piece_id=4NI6UFXMFROS5SCZYH7YS6QNOOJNIRS3GQZYWGAG5X2DRVINQ3AQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:121gTedy8TPx44wmLqdQpZ1gDDsL8D9K1EvQJffR7oKY3bT9DXh, address:185.167.204.206:4059): protocol: read tcp 5.161.89.252:28548->185.167.204.206:4059: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 1 01:33:33.744014531 (634h4m21.441582838s) [noise=true , address=185.167.204.206:4054 , piece_id=UFOFNEWOQHFL6ZBB3SWZ7OTXGVHH4LIP2F7D7OKGOBRYORQRHUDQ, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; context deadline exceeded
Jan 1 01:33:33.744091685 (634h4m21.441659991s) [noise=true , address=89.149.201.147:4024 , piece_id=KBZ46DDQ4YKS25UJZRLHEG3TMKQU5DAZAIWQMRRV5UZYGJ5K52EA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744160824 (634h4m21.44172913s) [noise=true , address=81.171.14.70:4027 , piece_id=MS3U2CMERSZU4PG5MALQ2DNMUYQQY7244NPUTFIWWEKWK773UNRA, seg_pos={0 0}, upload=557793]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: context deadline exceeded; context deadline exceeded
Jan 1 01:33:33.744178277 (634h4m21.441746584s) [seg_pos={0 0}, upload=557793]: Done waiting for segment. successful: 18 optimal: 26 errs: <nil>
Jan 1 01:33:33.846277178 (634h4m21.543845494s) [upload=557793]: Done uploading segments...
Jan 1 01:33:33.846300372 (634h4m21.543868678s) [upload=557793]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 18)
Duration: 2.231747995s
core
uplink
eu-select-1
eu1-placement-15
|