Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
183.624869ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 21:08:12 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 183.643384ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
166.443944ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 21:07:14 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 166.462317ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
189.521423ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 21:06:24 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 189.542212ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
182.193202ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 21:05:31 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 182.21841ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
140.084986ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 21:04:58 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 140.108619ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
232.514603ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 21:04:11 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 232.537425ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
208.145792ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 21:03:53 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 208.161923ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
154.758594ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 21:03:23 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 154.777109ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
152.225494ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 21:02:56 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 152.246032ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
263.170357ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 21:02:01 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 263.189412ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
231.300805ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 21:01:26 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 231.322055ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
188.432066ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 21:00:48 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 188.473685ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
171.88617ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:59:44 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 171.910055ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
127.241886ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:58:41 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 127.25466ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
220.503085ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:58:06 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 220.52216ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
173.781481ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:57:28 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 173.801979ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
139.334521ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:56:46 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 139.356011ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
137.090393ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:56:09 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 137.112524ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
145.323611ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:55:19 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 145.341544ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
220.991989ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:55:02 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 221.040339ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
170.077451ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:54:17 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 170.096557ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
246.691024ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:53:26 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 246.70548ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
149.543335ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:52:35 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 149.561267ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
139.363088ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:51:44 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 139.376714ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
160.471976ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:51:03 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 160.491522ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
164.635677ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:50:01 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 164.656856ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
284.845277ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:49:08 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 284.86303ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
196.077757ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:48:03 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 196.101712ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
147.297559ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:47:13 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 147.315662ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
235.567157ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:46:55 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 235.585711ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
227.672328ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:45:51 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 227.693316ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
237.245009ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:44:55 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 237.268042ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
131.659486ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:44:40 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 131.678ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
266.680683ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:44:12 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 266.720398ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
278.480947ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:43:08 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 278.500384ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
187.412864ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:41:56 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 187.437159ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
147.40992ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:40:51 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 147.426641ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
252.950577ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:40:05 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 252.972329ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.623350388s trace:
https://jaeger.dev.storj.io/trace/4844502e2a926458
FAIL (2026-01-13 20:39:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
15775452 (940h24m47.113343758s) [noise=true , address=185.167.204.206:4071 , piece_id=CCQWEOUKVUJWP6HCOVP3CVJHNCMBJOI37LYG7UT7V5PB2UICRYTA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416056437 (940h24m47.113624753s) [noise=true , address=81.171.14.70:4036 , piece_id=KKG4BOL5GERDMMQGYDMBUSTWSFBJRDYCHGEUBXNH3USYUM3NEWHA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416296104 (940h24m47.11386441s) [noise=true , address=81.171.14.70:4034 , piece_id=OMXZFG7QTJI5FENUZEJEJH26JVHU2NRFJ5WKOEVBBTD372MTHTLA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416532666 (940h24m47.114100983s) [noise=true , address=185.167.204.206:4041 , piece_id=I66YBRAVI3RRZWGTS5TATOXGG4RLVPEMUIOH7ZFWEIEU7A4NWLSQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416781050 (940h24m47.114349366s) [noise=true , address=81.171.14.70:4035 , piece_id=DAQQ2TB2GQ7FX4GASMUDTAXBQSJVJOPUZSTPST6HEINE2P4EMZPQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416940859 (940h24m47.114509175s) [noise=true , address=185.167.204.206:4066 , piece_id=4ZE5QZNLZYOZBFNP5ZPKYFPIDJ23TJ5OIED2LDELYAAM4H6LP7FQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.417316110 (940h24m47.114884426s) [noise=true , address=185.167.204.206:4061 , piece_id=V75RDU4ZULOTZ3UWCFKIC6CP37QJJ5MVMMMETOES5WNWX5RYI2GA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.417683546 (940h24m47.115251852s) [noise=true , address=185.167.204.206:4068 , piece_id=4ZLWAHB37KTGYARVB2DYWQXQBUOKT6ZEEAIABEZN2NLUM7O4XYRQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.417905471 (940h24m47.115473787s) [noise=true , address=89.149.201.147:4009 , piece_id=SB5MGTDT7ZYWRJHAT7DXEXVPRUOYQHOE26ZPSMIAYDBKXKSMC4GQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.418182899 (940h24m47.115751205s) [noise=true , address=185.167.204.206:4044 , piece_id=AGHSAM6TTOCAV6DQ4CNQYL7Z2JCW5WBR3ZFHA54NBQ4KKUNFR3DA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.906863790 (940h24m47.604432106s) [upload=827407]: Next returned nil segment
Jan 13 19:53:59.906879790 (940h24m47.604448116s) [upload=827407]: Waiting for error group managing segments...
Jan 13 19:54:00.101800919 (940h24m47.799369225s) [noise=true , address=185.167.204.206:4040 , piece_id=7LJIR5IYSOOVDMBBDCSOWKKSVDVNBVPSBE56MSFSXFAAIBNOHRPQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.111306073 (940h24m47.808874389s) [noise=true , address=185.167.204.206:4050 , piece_id=JD3FGI65CTBJ5JNU46MEEDUUPCZOAZEPAWY7IX6I65T7NOSWNSIA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.125302258 (940h24m47.822870574s) [noise=true , address=89.149.201.147:4002 , piece_id=WU4GGUI4MAN3ZAOSAESKGIXPGGFVLZNDZZAKX6WFFEW7SLURVCJQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.136910571 (940h24m47.834478887s) [noise=true , address=185.167.204.205:4002 , piece_id=BMBVB5UTH3J64ILAURAZLELVKVYHBKW5AOO43B4ZUFBGPRHOHWCA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.137705626 (940h24m47.835273942s) [noise=true , address=185.167.204.206:4066 , piece_id=4ZE5QZNLZYOZBFNP5ZPKYFPIDJ23TJ5OIED2LDELYAAM4H6LP7FQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.140468797 (940h24m47.838037113s) [noise=true , address=185.167.204.206:4061 , piece_id=V75RDU4ZULOTZ3UWCFKIC6CP37QJJ5MVMMMETOES5WNWX5RYI2GA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.142415674 (940h24m47.83998398s) [noise=true , address=185.167.204.205:4027 , piece_id=2N25T6ZYMTW2UQK77VD2KUYPVSCLFQO4NU2HQTNQ3PB3YTPTTRHQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.144376346 (940h24m47.841944662s) [noise=true , address=81.171.14.70:4043 , piece_id=W5V5K6S23EYEEACDEK3GBYBMLUUE3NVST6TI3WX67TLNW7BH3VCA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.145056828 (940h24m47.842625144s) [noise=true , address=185.167.204.206:4047 , piece_id=KXFGOO7M73EJOOPV2LHA6TSZO3OWOPQMAGTY2OOLG2WWOTKDWK4Q, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.152514547 (940h24m47.850082863s) [noise=true , address=81.171.14.70:4036 , piece_id=KKG4BOL5GERDMMQGYDMBUSTWSFBJRDYCHGEUBXNH3USYUM3NEWHA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.153860011 (940h24m47.851428328s) [noise=true , address=81.171.14.70:4037 , piece_id=YJBSCGS72RCQFYP36LOTW47KEQN3EZZP7RZJ7EQZLZYAZLZARGDA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.163119087 (940h24m47.860687392s) [noise=true , address=81.171.14.70:4039 , piece_id=GHTSYJLRNW7SO5EKTLWNBPV5UV4VQFYCPEV62QIKLNWJNRELQUHQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:11.009492969 (940h24m58.707061275s) [noise=true , address=185.167.204.206:4053 , piece_id=COIFRESLRMMEZWJWZBRXRKWIWYQTTX2HNMQ2HZEU4W2HOEYN2BAQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:14.848602514 (940h25m2.54617086s) [noise=true , address=81.171.14.70:4034 , piece_id=OMXZFG7QTJI5FENUZEJEJH26JVHU2NRFJ5WKOEVBBTD372MTHTLA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:18.923171710 (940h25m6.620740016s) [noise=true , address=185.167.204.206:4044 , piece_id=AGHSAM6TTOCAV6DQ4CNQYL7Z2JCW5WBR3ZFHA54NBQ4KKUNFR3DA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:24.178084820 (940h25m11.875653156s) [noise=true , address=81.171.14.70:4048 , piece_id=H2JISB6CIB6GXDOJGRFZGT3PTO6CXWTMIP35HP4EJ6UFDR6VAFHA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:24.345580139 (940h25m12.043148476s) [noise=true , address=185.167.204.206:4043 , piece_id=XVR5SSKXFBJQ6IJYRZWVYMP7U7QX4DI573IJLNIQDMGLWUURJ5BA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:30.650190383 (940h25m18.34775873s) [noise=true , address=89.149.201.147:4009 , piece_id=SB5MGTDT7ZYWRJHAT7DXEXVPRUOYQHOE26ZPSMIAYDBKXKSMC4GQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:33.145653670 (940h25m20.843221986s) [noise=true , address=185.167.204.205:4024 , piece_id=S4ZQSSK5NC67YCB77KNFJ2N3HIKKNSLAVEKYLE7RNJHVB4QNKDJA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:52.229080657 (940h25m39.926648994s) [noise=true , address=185.167.204.206:4041 , piece_id=I66YBRAVI3RRZWGTS5TATOXGG4RLVPEMUIOH7ZFWEIEU7A4NWLSQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:54.705198722 (940h25m42.402767067s) [noise=true , address=81.171.14.70:4035 , piece_id=DAQQ2TB2GQ7FX4GASMUDTAXBQSJVJOPUZSTPST6HEINE2P4EMZPQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:57.788015936 (940h25m45.485584252s) [noise=true , address=81.171.14.70:4047 , piece_id=UEWDA7RSKDB3HBRGXVFTLGURRCNPUCGQXYPVISAYRAFJD6FBCVZQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:58.342240486 (940h25m46.039808792s) [noise=true , address=185.167.204.206:4057 , piece_id=3WC4CODN7WMVGWXMNRCOPOMGOOQCAHYIK5WI5SC2CN5A2SIHBI2Q, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:59.013162301 (940h25m46.710730617s) [noise=true , address=185.167.204.205:4014 , piece_id=AX672A773Q3HALY4B5DG5UAU5KXNGTTO2MM3V5F23LIS2DVRODUQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: expected piece hash; context deadline exceeded; EOF
Jan 13 19:54:59.013255815 (940h25m46.710824131s) [noise=true , address=185.167.204.206:4071 , piece_id=CCQWEOUKVUJWP6HCOVP3CVJHNCMBJOI37LYG7UT7V5PB2UICRYTA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: expected piece hash; context deadline exceeded; EOF
Jan 13 19:54:59.013267066 (940h25m46.710835373s) [noise=true , address=81.171.14.70:4033 , piece_id=OF3EGAEVGTG7JFHZC66SO6UPJJ6H3CZNWS3LXRIUFBJDJ6BC3WAQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 5.161.89.252:31528->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 13 19:54:59.013314736 (940h25m46.710883052s) [noise=true , address=185.167.204.206:4068 , piece_id=4ZLWAHB37KTGYARVB2DYWQXQBUOKT6ZEEAIABEZN2NLUM7O4XYRQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: write tcp 5.161.89.252:25924->185.167.204.206:4068: use of closed network connection; write tcp 5.161.89.252:25924->185.167.204.206:4068: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:25924->185.167.204.206:4068: use of closed network connection
Jan 13 19:54:59.013331217 (940h25m46.710899523s) [noise=true , address=185.167.204.205:4018 , piece_id=KHCXAC7XYSUZRCG5IMNZWF4YUUAW7BEXKJWMX3IGN4RH2LXH5JTQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: expected piece hash; context deadline exceeded; EOF
Jan 13 19:54:59.013350463 (940h25m46.710918769s) [seg_pos={0 0}, upload=827407]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Jan 13 19:54:59.121040217 (940h25m46.818608524s) [upload=827407]: Done uploading segments...
Jan 13 19:54:59.121073530 (940h25m46.818641836s) [upload=827407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.62336738s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
198.192147ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:38:58 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 198.216202ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.640538626s trace:
https://jaeger.dev.storj.io/trace/4844502e2a926458
FAIL (2026-01-13 20:37:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
15775452 (940h24m47.113343758s) [noise=true , address=185.167.204.206:4071 , piece_id=CCQWEOUKVUJWP6HCOVP3CVJHNCMBJOI37LYG7UT7V5PB2UICRYTA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416056437 (940h24m47.113624753s) [noise=true , address=81.171.14.70:4036 , piece_id=KKG4BOL5GERDMMQGYDMBUSTWSFBJRDYCHGEUBXNH3USYUM3NEWHA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416296104 (940h24m47.11386441s) [noise=true , address=81.171.14.70:4034 , piece_id=OMXZFG7QTJI5FENUZEJEJH26JVHU2NRFJ5WKOEVBBTD372MTHTLA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416532666 (940h24m47.114100983s) [noise=true , address=185.167.204.206:4041 , piece_id=I66YBRAVI3RRZWGTS5TATOXGG4RLVPEMUIOH7ZFWEIEU7A4NWLSQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416781050 (940h24m47.114349366s) [noise=true , address=81.171.14.70:4035 , piece_id=DAQQ2TB2GQ7FX4GASMUDTAXBQSJVJOPUZSTPST6HEINE2P4EMZPQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416940859 (940h24m47.114509175s) [noise=true , address=185.167.204.206:4066 , piece_id=4ZE5QZNLZYOZBFNP5ZPKYFPIDJ23TJ5OIED2LDELYAAM4H6LP7FQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.417316110 (940h24m47.114884426s) [noise=true , address=185.167.204.206:4061 , piece_id=V75RDU4ZULOTZ3UWCFKIC6CP37QJJ5MVMMMETOES5WNWX5RYI2GA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.417683546 (940h24m47.115251852s) [noise=true , address=185.167.204.206:4068 , piece_id=4ZLWAHB37KTGYARVB2DYWQXQBUOKT6ZEEAIABEZN2NLUM7O4XYRQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.417905471 (940h24m47.115473787s) [noise=true , address=89.149.201.147:4009 , piece_id=SB5MGTDT7ZYWRJHAT7DXEXVPRUOYQHOE26ZPSMIAYDBKXKSMC4GQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.418182899 (940h24m47.115751205s) [noise=true , address=185.167.204.206:4044 , piece_id=AGHSAM6TTOCAV6DQ4CNQYL7Z2JCW5WBR3ZFHA54NBQ4KKUNFR3DA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.906863790 (940h24m47.604432106s) [upload=827407]: Next returned nil segment
Jan 13 19:53:59.906879790 (940h24m47.604448116s) [upload=827407]: Waiting for error group managing segments...
Jan 13 19:54:00.101800919 (940h24m47.799369225s) [noise=true , address=185.167.204.206:4040 , piece_id=7LJIR5IYSOOVDMBBDCSOWKKSVDVNBVPSBE56MSFSXFAAIBNOHRPQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.111306073 (940h24m47.808874389s) [noise=true , address=185.167.204.206:4050 , piece_id=JD3FGI65CTBJ5JNU46MEEDUUPCZOAZEPAWY7IX6I65T7NOSWNSIA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.125302258 (940h24m47.822870574s) [noise=true , address=89.149.201.147:4002 , piece_id=WU4GGUI4MAN3ZAOSAESKGIXPGGFVLZNDZZAKX6WFFEW7SLURVCJQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.136910571 (940h24m47.834478887s) [noise=true , address=185.167.204.205:4002 , piece_id=BMBVB5UTH3J64ILAURAZLELVKVYHBKW5AOO43B4ZUFBGPRHOHWCA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.137705626 (940h24m47.835273942s) [noise=true , address=185.167.204.206:4066 , piece_id=4ZE5QZNLZYOZBFNP5ZPKYFPIDJ23TJ5OIED2LDELYAAM4H6LP7FQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.140468797 (940h24m47.838037113s) [noise=true , address=185.167.204.206:4061 , piece_id=V75RDU4ZULOTZ3UWCFKIC6CP37QJJ5MVMMMETOES5WNWX5RYI2GA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.142415674 (940h24m47.83998398s) [noise=true , address=185.167.204.205:4027 , piece_id=2N25T6ZYMTW2UQK77VD2KUYPVSCLFQO4NU2HQTNQ3PB3YTPTTRHQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.144376346 (940h24m47.841944662s) [noise=true , address=81.171.14.70:4043 , piece_id=W5V5K6S23EYEEACDEK3GBYBMLUUE3NVST6TI3WX67TLNW7BH3VCA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.145056828 (940h24m47.842625144s) [noise=true , address=185.167.204.206:4047 , piece_id=KXFGOO7M73EJOOPV2LHA6TSZO3OWOPQMAGTY2OOLG2WWOTKDWK4Q, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.152514547 (940h24m47.850082863s) [noise=true , address=81.171.14.70:4036 , piece_id=KKG4BOL5GERDMMQGYDMBUSTWSFBJRDYCHGEUBXNH3USYUM3NEWHA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.153860011 (940h24m47.851428328s) [noise=true , address=81.171.14.70:4037 , piece_id=YJBSCGS72RCQFYP36LOTW47KEQN3EZZP7RZJ7EQZLZYAZLZARGDA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.163119087 (940h24m47.860687392s) [noise=true , address=81.171.14.70:4039 , piece_id=GHTSYJLRNW7SO5EKTLWNBPV5UV4VQFYCPEV62QIKLNWJNRELQUHQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:11.009492969 (940h24m58.707061275s) [noise=true , address=185.167.204.206:4053 , piece_id=COIFRESLRMMEZWJWZBRXRKWIWYQTTX2HNMQ2HZEU4W2HOEYN2BAQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:14.848602514 (940h25m2.54617086s) [noise=true , address=81.171.14.70:4034 , piece_id=OMXZFG7QTJI5FENUZEJEJH26JVHU2NRFJ5WKOEVBBTD372MTHTLA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:18.923171710 (940h25m6.620740016s) [noise=true , address=185.167.204.206:4044 , piece_id=AGHSAM6TTOCAV6DQ4CNQYL7Z2JCW5WBR3ZFHA54NBQ4KKUNFR3DA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:24.178084820 (940h25m11.875653156s) [noise=true , address=81.171.14.70:4048 , piece_id=H2JISB6CIB6GXDOJGRFZGT3PTO6CXWTMIP35HP4EJ6UFDR6VAFHA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:24.345580139 (940h25m12.043148476s) [noise=true , address=185.167.204.206:4043 , piece_id=XVR5SSKXFBJQ6IJYRZWVYMP7U7QX4DI573IJLNIQDMGLWUURJ5BA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:30.650190383 (940h25m18.34775873s) [noise=true , address=89.149.201.147:4009 , piece_id=SB5MGTDT7ZYWRJHAT7DXEXVPRUOYQHOE26ZPSMIAYDBKXKSMC4GQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:33.145653670 (940h25m20.843221986s) [noise=true , address=185.167.204.205:4024 , piece_id=S4ZQSSK5NC67YCB77KNFJ2N3HIKKNSLAVEKYLE7RNJHVB4QNKDJA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:52.229080657 (940h25m39.926648994s) [noise=true , address=185.167.204.206:4041 , piece_id=I66YBRAVI3RRZWGTS5TATOXGG4RLVPEMUIOH7ZFWEIEU7A4NWLSQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:54.705198722 (940h25m42.402767067s) [noise=true , address=81.171.14.70:4035 , piece_id=DAQQ2TB2GQ7FX4GASMUDTAXBQSJVJOPUZSTPST6HEINE2P4EMZPQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:57.788015936 (940h25m45.485584252s) [noise=true , address=81.171.14.70:4047 , piece_id=UEWDA7RSKDB3HBRGXVFTLGURRCNPUCGQXYPVISAYRAFJD6FBCVZQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:58.342240486 (940h25m46.039808792s) [noise=true , address=185.167.204.206:4057 , piece_id=3WC4CODN7WMVGWXMNRCOPOMGOOQCAHYIK5WI5SC2CN5A2SIHBI2Q, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:59.013162301 (940h25m46.710730617s) [noise=true , address=185.167.204.205:4014 , piece_id=AX672A773Q3HALY4B5DG5UAU5KXNGTTO2MM3V5F23LIS2DVRODUQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: expected piece hash; context deadline exceeded; EOF
Jan 13 19:54:59.013255815 (940h25m46.710824131s) [noise=true , address=185.167.204.206:4071 , piece_id=CCQWEOUKVUJWP6HCOVP3CVJHNCMBJOI37LYG7UT7V5PB2UICRYTA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: expected piece hash; context deadline exceeded; EOF
Jan 13 19:54:59.013267066 (940h25m46.710835373s) [noise=true , address=81.171.14.70:4033 , piece_id=OF3EGAEVGTG7JFHZC66SO6UPJJ6H3CZNWS3LXRIUFBJDJ6BC3WAQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 5.161.89.252:31528->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 13 19:54:59.013314736 (940h25m46.710883052s) [noise=true , address=185.167.204.206:4068 , piece_id=4ZLWAHB37KTGYARVB2DYWQXQBUOKT6ZEEAIABEZN2NLUM7O4XYRQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: write tcp 5.161.89.252:25924->185.167.204.206:4068: use of closed network connection; write tcp 5.161.89.252:25924->185.167.204.206:4068: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:25924->185.167.204.206:4068: use of closed network connection
Jan 13 19:54:59.013331217 (940h25m46.710899523s) [noise=true , address=185.167.204.205:4018 , piece_id=KHCXAC7XYSUZRCG5IMNZWF4YUUAW7BEXKJWMX3IGN4RH2LXH5JTQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: expected piece hash; context deadline exceeded; EOF
Jan 13 19:54:59.013350463 (940h25m46.710918769s) [seg_pos={0 0}, upload=827407]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Jan 13 19:54:59.121040217 (940h25m46.818608524s) [upload=827407]: Done uploading segments...
Jan 13 19:54:59.121073530 (940h25m46.818641836s) [upload=827407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.640559686s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
158.220923ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:37:48 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 158.238656ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.555611885s trace:
https://jaeger.dev.storj.io/trace/4844502e2a926458
FAIL (2026-01-13 20:37:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
15775452 (940h24m47.113343758s) [noise=true , address=185.167.204.206:4071 , piece_id=CCQWEOUKVUJWP6HCOVP3CVJHNCMBJOI37LYG7UT7V5PB2UICRYTA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416056437 (940h24m47.113624753s) [noise=true , address=81.171.14.70:4036 , piece_id=KKG4BOL5GERDMMQGYDMBUSTWSFBJRDYCHGEUBXNH3USYUM3NEWHA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416296104 (940h24m47.11386441s) [noise=true , address=81.171.14.70:4034 , piece_id=OMXZFG7QTJI5FENUZEJEJH26JVHU2NRFJ5WKOEVBBTD372MTHTLA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416532666 (940h24m47.114100983s) [noise=true , address=185.167.204.206:4041 , piece_id=I66YBRAVI3RRZWGTS5TATOXGG4RLVPEMUIOH7ZFWEIEU7A4NWLSQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416781050 (940h24m47.114349366s) [noise=true , address=81.171.14.70:4035 , piece_id=DAQQ2TB2GQ7FX4GASMUDTAXBQSJVJOPUZSTPST6HEINE2P4EMZPQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416940859 (940h24m47.114509175s) [noise=true , address=185.167.204.206:4066 , piece_id=4ZE5QZNLZYOZBFNP5ZPKYFPIDJ23TJ5OIED2LDELYAAM4H6LP7FQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.417316110 (940h24m47.114884426s) [noise=true , address=185.167.204.206:4061 , piece_id=V75RDU4ZULOTZ3UWCFKIC6CP37QJJ5MVMMMETOES5WNWX5RYI2GA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.417683546 (940h24m47.115251852s) [noise=true , address=185.167.204.206:4068 , piece_id=4ZLWAHB37KTGYARVB2DYWQXQBUOKT6ZEEAIABEZN2NLUM7O4XYRQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.417905471 (940h24m47.115473787s) [noise=true , address=89.149.201.147:4009 , piece_id=SB5MGTDT7ZYWRJHAT7DXEXVPRUOYQHOE26ZPSMIAYDBKXKSMC4GQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.418182899 (940h24m47.115751205s) [noise=true , address=185.167.204.206:4044 , piece_id=AGHSAM6TTOCAV6DQ4CNQYL7Z2JCW5WBR3ZFHA54NBQ4KKUNFR3DA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.906863790 (940h24m47.604432106s) [upload=827407]: Next returned nil segment
Jan 13 19:53:59.906879790 (940h24m47.604448116s) [upload=827407]: Waiting for error group managing segments...
Jan 13 19:54:00.101800919 (940h24m47.799369225s) [noise=true , address=185.167.204.206:4040 , piece_id=7LJIR5IYSOOVDMBBDCSOWKKSVDVNBVPSBE56MSFSXFAAIBNOHRPQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.111306073 (940h24m47.808874389s) [noise=true , address=185.167.204.206:4050 , piece_id=JD3FGI65CTBJ5JNU46MEEDUUPCZOAZEPAWY7IX6I65T7NOSWNSIA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.125302258 (940h24m47.822870574s) [noise=true , address=89.149.201.147:4002 , piece_id=WU4GGUI4MAN3ZAOSAESKGIXPGGFVLZNDZZAKX6WFFEW7SLURVCJQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.136910571 (940h24m47.834478887s) [noise=true , address=185.167.204.205:4002 , piece_id=BMBVB5UTH3J64ILAURAZLELVKVYHBKW5AOO43B4ZUFBGPRHOHWCA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.137705626 (940h24m47.835273942s) [noise=true , address=185.167.204.206:4066 , piece_id=4ZE5QZNLZYOZBFNP5ZPKYFPIDJ23TJ5OIED2LDELYAAM4H6LP7FQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.140468797 (940h24m47.838037113s) [noise=true , address=185.167.204.206:4061 , piece_id=V75RDU4ZULOTZ3UWCFKIC6CP37QJJ5MVMMMETOES5WNWX5RYI2GA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.142415674 (940h24m47.83998398s) [noise=true , address=185.167.204.205:4027 , piece_id=2N25T6ZYMTW2UQK77VD2KUYPVSCLFQO4NU2HQTNQ3PB3YTPTTRHQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.144376346 (940h24m47.841944662s) [noise=true , address=81.171.14.70:4043 , piece_id=W5V5K6S23EYEEACDEK3GBYBMLUUE3NVST6TI3WX67TLNW7BH3VCA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.145056828 (940h24m47.842625144s) [noise=true , address=185.167.204.206:4047 , piece_id=KXFGOO7M73EJOOPV2LHA6TSZO3OWOPQMAGTY2OOLG2WWOTKDWK4Q, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.152514547 (940h24m47.850082863s) [noise=true , address=81.171.14.70:4036 , piece_id=KKG4BOL5GERDMMQGYDMBUSTWSFBJRDYCHGEUBXNH3USYUM3NEWHA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.153860011 (940h24m47.851428328s) [noise=true , address=81.171.14.70:4037 , piece_id=YJBSCGS72RCQFYP36LOTW47KEQN3EZZP7RZJ7EQZLZYAZLZARGDA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.163119087 (940h24m47.860687392s) [noise=true , address=81.171.14.70:4039 , piece_id=GHTSYJLRNW7SO5EKTLWNBPV5UV4VQFYCPEV62QIKLNWJNRELQUHQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:11.009492969 (940h24m58.707061275s) [noise=true , address=185.167.204.206:4053 , piece_id=COIFRESLRMMEZWJWZBRXRKWIWYQTTX2HNMQ2HZEU4W2HOEYN2BAQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:14.848602514 (940h25m2.54617086s) [noise=true , address=81.171.14.70:4034 , piece_id=OMXZFG7QTJI5FENUZEJEJH26JVHU2NRFJ5WKOEVBBTD372MTHTLA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:18.923171710 (940h25m6.620740016s) [noise=true , address=185.167.204.206:4044 , piece_id=AGHSAM6TTOCAV6DQ4CNQYL7Z2JCW5WBR3ZFHA54NBQ4KKUNFR3DA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:24.178084820 (940h25m11.875653156s) [noise=true , address=81.171.14.70:4048 , piece_id=H2JISB6CIB6GXDOJGRFZGT3PTO6CXWTMIP35HP4EJ6UFDR6VAFHA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:24.345580139 (940h25m12.043148476s) [noise=true , address=185.167.204.206:4043 , piece_id=XVR5SSKXFBJQ6IJYRZWVYMP7U7QX4DI573IJLNIQDMGLWUURJ5BA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:30.650190383 (940h25m18.34775873s) [noise=true , address=89.149.201.147:4009 , piece_id=SB5MGTDT7ZYWRJHAT7DXEXVPRUOYQHOE26ZPSMIAYDBKXKSMC4GQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:33.145653670 (940h25m20.843221986s) [noise=true , address=185.167.204.205:4024 , piece_id=S4ZQSSK5NC67YCB77KNFJ2N3HIKKNSLAVEKYLE7RNJHVB4QNKDJA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:52.229080657 (940h25m39.926648994s) [noise=true , address=185.167.204.206:4041 , piece_id=I66YBRAVI3RRZWGTS5TATOXGG4RLVPEMUIOH7ZFWEIEU7A4NWLSQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:54.705198722 (940h25m42.402767067s) [noise=true , address=81.171.14.70:4035 , piece_id=DAQQ2TB2GQ7FX4GASMUDTAXBQSJVJOPUZSTPST6HEINE2P4EMZPQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:57.788015936 (940h25m45.485584252s) [noise=true , address=81.171.14.70:4047 , piece_id=UEWDA7RSKDB3HBRGXVFTLGURRCNPUCGQXYPVISAYRAFJD6FBCVZQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:58.342240486 (940h25m46.039808792s) [noise=true , address=185.167.204.206:4057 , piece_id=3WC4CODN7WMVGWXMNRCOPOMGOOQCAHYIK5WI5SC2CN5A2SIHBI2Q, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:59.013162301 (940h25m46.710730617s) [noise=true , address=185.167.204.205:4014 , piece_id=AX672A773Q3HALY4B5DG5UAU5KXNGTTO2MM3V5F23LIS2DVRODUQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: expected piece hash; context deadline exceeded; EOF
Jan 13 19:54:59.013255815 (940h25m46.710824131s) [noise=true , address=185.167.204.206:4071 , piece_id=CCQWEOUKVUJWP6HCOVP3CVJHNCMBJOI37LYG7UT7V5PB2UICRYTA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: expected piece hash; context deadline exceeded; EOF
Jan 13 19:54:59.013267066 (940h25m46.710835373s) [noise=true , address=81.171.14.70:4033 , piece_id=OF3EGAEVGTG7JFHZC66SO6UPJJ6H3CZNWS3LXRIUFBJDJ6BC3WAQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 5.161.89.252:31528->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 13 19:54:59.013314736 (940h25m46.710883052s) [noise=true , address=185.167.204.206:4068 , piece_id=4ZLWAHB37KTGYARVB2DYWQXQBUOKT6ZEEAIABEZN2NLUM7O4XYRQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: write tcp 5.161.89.252:25924->185.167.204.206:4068: use of closed network connection; write tcp 5.161.89.252:25924->185.167.204.206:4068: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:25924->185.167.204.206:4068: use of closed network connection
Jan 13 19:54:59.013331217 (940h25m46.710899523s) [noise=true , address=185.167.204.205:4018 , piece_id=KHCXAC7XYSUZRCG5IMNZWF4YUUAW7BEXKJWMX3IGN4RH2LXH5JTQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: expected piece hash; context deadline exceeded; EOF
Jan 13 19:54:59.013350463 (940h25m46.710918769s) [seg_pos={0 0}, upload=827407]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Jan 13 19:54:59.121040217 (940h25m46.818608524s) [upload=827407]: Done uploading segments...
Jan 13 19:54:59.121073530 (940h25m46.818641836s) [upload=827407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.555634808s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.610927742s trace:
https://jaeger.dev.storj.io/trace/4844502e2a926458
FAIL (2026-01-13 20:37:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
15775452 (940h24m47.113343758s) [noise=true , address=185.167.204.206:4071 , piece_id=CCQWEOUKVUJWP6HCOVP3CVJHNCMBJOI37LYG7UT7V5PB2UICRYTA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416056437 (940h24m47.113624753s) [noise=true , address=81.171.14.70:4036 , piece_id=KKG4BOL5GERDMMQGYDMBUSTWSFBJRDYCHGEUBXNH3USYUM3NEWHA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416296104 (940h24m47.11386441s) [noise=true , address=81.171.14.70:4034 , piece_id=OMXZFG7QTJI5FENUZEJEJH26JVHU2NRFJ5WKOEVBBTD372MTHTLA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416532666 (940h24m47.114100983s) [noise=true , address=185.167.204.206:4041 , piece_id=I66YBRAVI3RRZWGTS5TATOXGG4RLVPEMUIOH7ZFWEIEU7A4NWLSQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416781050 (940h24m47.114349366s) [noise=true , address=81.171.14.70:4035 , piece_id=DAQQ2TB2GQ7FX4GASMUDTAXBQSJVJOPUZSTPST6HEINE2P4EMZPQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416940859 (940h24m47.114509175s) [noise=true , address=185.167.204.206:4066 , piece_id=4ZE5QZNLZYOZBFNP5ZPKYFPIDJ23TJ5OIED2LDELYAAM4H6LP7FQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.417316110 (940h24m47.114884426s) [noise=true , address=185.167.204.206:4061 , piece_id=V75RDU4ZULOTZ3UWCFKIC6CP37QJJ5MVMMMETOES5WNWX5RYI2GA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.417683546 (940h24m47.115251852s) [noise=true , address=185.167.204.206:4068 , piece_id=4ZLWAHB37KTGYARVB2DYWQXQBUOKT6ZEEAIABEZN2NLUM7O4XYRQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.417905471 (940h24m47.115473787s) [noise=true , address=89.149.201.147:4009 , piece_id=SB5MGTDT7ZYWRJHAT7DXEXVPRUOYQHOE26ZPSMIAYDBKXKSMC4GQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.418182899 (940h24m47.115751205s) [noise=true , address=185.167.204.206:4044 , piece_id=AGHSAM6TTOCAV6DQ4CNQYL7Z2JCW5WBR3ZFHA54NBQ4KKUNFR3DA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.906863790 (940h24m47.604432106s) [upload=827407]: Next returned nil segment
Jan 13 19:53:59.906879790 (940h24m47.604448116s) [upload=827407]: Waiting for error group managing segments...
Jan 13 19:54:00.101800919 (940h24m47.799369225s) [noise=true , address=185.167.204.206:4040 , piece_id=7LJIR5IYSOOVDMBBDCSOWKKSVDVNBVPSBE56MSFSXFAAIBNOHRPQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.111306073 (940h24m47.808874389s) [noise=true , address=185.167.204.206:4050 , piece_id=JD3FGI65CTBJ5JNU46MEEDUUPCZOAZEPAWY7IX6I65T7NOSWNSIA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.125302258 (940h24m47.822870574s) [noise=true , address=89.149.201.147:4002 , piece_id=WU4GGUI4MAN3ZAOSAESKGIXPGGFVLZNDZZAKX6WFFEW7SLURVCJQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.136910571 (940h24m47.834478887s) [noise=true , address=185.167.204.205:4002 , piece_id=BMBVB5UTH3J64ILAURAZLELVKVYHBKW5AOO43B4ZUFBGPRHOHWCA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.137705626 (940h24m47.835273942s) [noise=true , address=185.167.204.206:4066 , piece_id=4ZE5QZNLZYOZBFNP5ZPKYFPIDJ23TJ5OIED2LDELYAAM4H6LP7FQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.140468797 (940h24m47.838037113s) [noise=true , address=185.167.204.206:4061 , piece_id=V75RDU4ZULOTZ3UWCFKIC6CP37QJJ5MVMMMETOES5WNWX5RYI2GA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.142415674 (940h24m47.83998398s) [noise=true , address=185.167.204.205:4027 , piece_id=2N25T6ZYMTW2UQK77VD2KUYPVSCLFQO4NU2HQTNQ3PB3YTPTTRHQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.144376346 (940h24m47.841944662s) [noise=true , address=81.171.14.70:4043 , piece_id=W5V5K6S23EYEEACDEK3GBYBMLUUE3NVST6TI3WX67TLNW7BH3VCA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.145056828 (940h24m47.842625144s) [noise=true , address=185.167.204.206:4047 , piece_id=KXFGOO7M73EJOOPV2LHA6TSZO3OWOPQMAGTY2OOLG2WWOTKDWK4Q, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.152514547 (940h24m47.850082863s) [noise=true , address=81.171.14.70:4036 , piece_id=KKG4BOL5GERDMMQGYDMBUSTWSFBJRDYCHGEUBXNH3USYUM3NEWHA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.153860011 (940h24m47.851428328s) [noise=true , address=81.171.14.70:4037 , piece_id=YJBSCGS72RCQFYP36LOTW47KEQN3EZZP7RZJ7EQZLZYAZLZARGDA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.163119087 (940h24m47.860687392s) [noise=true , address=81.171.14.70:4039 , piece_id=GHTSYJLRNW7SO5EKTLWNBPV5UV4VQFYCPEV62QIKLNWJNRELQUHQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:11.009492969 (940h24m58.707061275s) [noise=true , address=185.167.204.206:4053 , piece_id=COIFRESLRMMEZWJWZBRXRKWIWYQTTX2HNMQ2HZEU4W2HOEYN2BAQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:14.848602514 (940h25m2.54617086s) [noise=true , address=81.171.14.70:4034 , piece_id=OMXZFG7QTJI5FENUZEJEJH26JVHU2NRFJ5WKOEVBBTD372MTHTLA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:18.923171710 (940h25m6.620740016s) [noise=true , address=185.167.204.206:4044 , piece_id=AGHSAM6TTOCAV6DQ4CNQYL7Z2JCW5WBR3ZFHA54NBQ4KKUNFR3DA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:24.178084820 (940h25m11.875653156s) [noise=true , address=81.171.14.70:4048 , piece_id=H2JISB6CIB6GXDOJGRFZGT3PTO6CXWTMIP35HP4EJ6UFDR6VAFHA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:24.345580139 (940h25m12.043148476s) [noise=true , address=185.167.204.206:4043 , piece_id=XVR5SSKXFBJQ6IJYRZWVYMP7U7QX4DI573IJLNIQDMGLWUURJ5BA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:30.650190383 (940h25m18.34775873s) [noise=true , address=89.149.201.147:4009 , piece_id=SB5MGTDT7ZYWRJHAT7DXEXVPRUOYQHOE26ZPSMIAYDBKXKSMC4GQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:33.145653670 (940h25m20.843221986s) [noise=true , address=185.167.204.205:4024 , piece_id=S4ZQSSK5NC67YCB77KNFJ2N3HIKKNSLAVEKYLE7RNJHVB4QNKDJA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:52.229080657 (940h25m39.926648994s) [noise=true , address=185.167.204.206:4041 , piece_id=I66YBRAVI3RRZWGTS5TATOXGG4RLVPEMUIOH7ZFWEIEU7A4NWLSQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:54.705198722 (940h25m42.402767067s) [noise=true , address=81.171.14.70:4035 , piece_id=DAQQ2TB2GQ7FX4GASMUDTAXBQSJVJOPUZSTPST6HEINE2P4EMZPQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:57.788015936 (940h25m45.485584252s) [noise=true , address=81.171.14.70:4047 , piece_id=UEWDA7RSKDB3HBRGXVFTLGURRCNPUCGQXYPVISAYRAFJD6FBCVZQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:58.342240486 (940h25m46.039808792s) [noise=true , address=185.167.204.206:4057 , piece_id=3WC4CODN7WMVGWXMNRCOPOMGOOQCAHYIK5WI5SC2CN5A2SIHBI2Q, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:59.013162301 (940h25m46.710730617s) [noise=true , address=185.167.204.205:4014 , piece_id=AX672A773Q3HALY4B5DG5UAU5KXNGTTO2MM3V5F23LIS2DVRODUQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: expected piece hash; context deadline exceeded; EOF
Jan 13 19:54:59.013255815 (940h25m46.710824131s) [noise=true , address=185.167.204.206:4071 , piece_id=CCQWEOUKVUJWP6HCOVP3CVJHNCMBJOI37LYG7UT7V5PB2UICRYTA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: expected piece hash; context deadline exceeded; EOF
Jan 13 19:54:59.013267066 (940h25m46.710835373s) [noise=true , address=81.171.14.70:4033 , piece_id=OF3EGAEVGTG7JFHZC66SO6UPJJ6H3CZNWS3LXRIUFBJDJ6BC3WAQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 5.161.89.252:31528->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 13 19:54:59.013314736 (940h25m46.710883052s) [noise=true , address=185.167.204.206:4068 , piece_id=4ZLWAHB37KTGYARVB2DYWQXQBUOKT6ZEEAIABEZN2NLUM7O4XYRQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: write tcp 5.161.89.252:25924->185.167.204.206:4068: use of closed network connection; write tcp 5.161.89.252:25924->185.167.204.206:4068: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:25924->185.167.204.206:4068: use of closed network connection
Jan 13 19:54:59.013331217 (940h25m46.710899523s) [noise=true , address=185.167.204.205:4018 , piece_id=KHCXAC7XYSUZRCG5IMNZWF4YUUAW7BEXKJWMX3IGN4RH2LXH5JTQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: expected piece hash; context deadline exceeded; EOF
Jan 13 19:54:59.013350463 (940h25m46.710918769s) [seg_pos={0 0}, upload=827407]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Jan 13 19:54:59.121040217 (940h25m46.818608524s) [upload=827407]: Done uploading segments...
Jan 13 19:54:59.121073530 (940h25m46.818641836s) [upload=827407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.61094729s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
221.752219ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:36:38 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 221.798194ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.741389501s trace:
https://jaeger.dev.storj.io/trace/4844502e2a926458
FAIL (2026-01-13 20:36:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
15775452 (940h24m47.113343758s) [noise=true , address=185.167.204.206:4071 , piece_id=CCQWEOUKVUJWP6HCOVP3CVJHNCMBJOI37LYG7UT7V5PB2UICRYTA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416056437 (940h24m47.113624753s) [noise=true , address=81.171.14.70:4036 , piece_id=KKG4BOL5GERDMMQGYDMBUSTWSFBJRDYCHGEUBXNH3USYUM3NEWHA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416296104 (940h24m47.11386441s) [noise=true , address=81.171.14.70:4034 , piece_id=OMXZFG7QTJI5FENUZEJEJH26JVHU2NRFJ5WKOEVBBTD372MTHTLA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416532666 (940h24m47.114100983s) [noise=true , address=185.167.204.206:4041 , piece_id=I66YBRAVI3RRZWGTS5TATOXGG4RLVPEMUIOH7ZFWEIEU7A4NWLSQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416781050 (940h24m47.114349366s) [noise=true , address=81.171.14.70:4035 , piece_id=DAQQ2TB2GQ7FX4GASMUDTAXBQSJVJOPUZSTPST6HEINE2P4EMZPQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416940859 (940h24m47.114509175s) [noise=true , address=185.167.204.206:4066 , piece_id=4ZE5QZNLZYOZBFNP5ZPKYFPIDJ23TJ5OIED2LDELYAAM4H6LP7FQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.417316110 (940h24m47.114884426s) [noise=true , address=185.167.204.206:4061 , piece_id=V75RDU4ZULOTZ3UWCFKIC6CP37QJJ5MVMMMETOES5WNWX5RYI2GA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.417683546 (940h24m47.115251852s) [noise=true , address=185.167.204.206:4068 , piece_id=4ZLWAHB37KTGYARVB2DYWQXQBUOKT6ZEEAIABEZN2NLUM7O4XYRQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.417905471 (940h24m47.115473787s) [noise=true , address=89.149.201.147:4009 , piece_id=SB5MGTDT7ZYWRJHAT7DXEXVPRUOYQHOE26ZPSMIAYDBKXKSMC4GQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.418182899 (940h24m47.115751205s) [noise=true , address=185.167.204.206:4044 , piece_id=AGHSAM6TTOCAV6DQ4CNQYL7Z2JCW5WBR3ZFHA54NBQ4KKUNFR3DA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.906863790 (940h24m47.604432106s) [upload=827407]: Next returned nil segment
Jan 13 19:53:59.906879790 (940h24m47.604448116s) [upload=827407]: Waiting for error group managing segments...
Jan 13 19:54:00.101800919 (940h24m47.799369225s) [noise=true , address=185.167.204.206:4040 , piece_id=7LJIR5IYSOOVDMBBDCSOWKKSVDVNBVPSBE56MSFSXFAAIBNOHRPQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.111306073 (940h24m47.808874389s) [noise=true , address=185.167.204.206:4050 , piece_id=JD3FGI65CTBJ5JNU46MEEDUUPCZOAZEPAWY7IX6I65T7NOSWNSIA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.125302258 (940h24m47.822870574s) [noise=true , address=89.149.201.147:4002 , piece_id=WU4GGUI4MAN3ZAOSAESKGIXPGGFVLZNDZZAKX6WFFEW7SLURVCJQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.136910571 (940h24m47.834478887s) [noise=true , address=185.167.204.205:4002 , piece_id=BMBVB5UTH3J64ILAURAZLELVKVYHBKW5AOO43B4ZUFBGPRHOHWCA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.137705626 (940h24m47.835273942s) [noise=true , address=185.167.204.206:4066 , piece_id=4ZE5QZNLZYOZBFNP5ZPKYFPIDJ23TJ5OIED2LDELYAAM4H6LP7FQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.140468797 (940h24m47.838037113s) [noise=true , address=185.167.204.206:4061 , piece_id=V75RDU4ZULOTZ3UWCFKIC6CP37QJJ5MVMMMETOES5WNWX5RYI2GA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.142415674 (940h24m47.83998398s) [noise=true , address=185.167.204.205:4027 , piece_id=2N25T6ZYMTW2UQK77VD2KUYPVSCLFQO4NU2HQTNQ3PB3YTPTTRHQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.144376346 (940h24m47.841944662s) [noise=true , address=81.171.14.70:4043 , piece_id=W5V5K6S23EYEEACDEK3GBYBMLUUE3NVST6TI3WX67TLNW7BH3VCA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.145056828 (940h24m47.842625144s) [noise=true , address=185.167.204.206:4047 , piece_id=KXFGOO7M73EJOOPV2LHA6TSZO3OWOPQMAGTY2OOLG2WWOTKDWK4Q, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.152514547 (940h24m47.850082863s) [noise=true , address=81.171.14.70:4036 , piece_id=KKG4BOL5GERDMMQGYDMBUSTWSFBJRDYCHGEUBXNH3USYUM3NEWHA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.153860011 (940h24m47.851428328s) [noise=true , address=81.171.14.70:4037 , piece_id=YJBSCGS72RCQFYP36LOTW47KEQN3EZZP7RZJ7EQZLZYAZLZARGDA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.163119087 (940h24m47.860687392s) [noise=true , address=81.171.14.70:4039 , piece_id=GHTSYJLRNW7SO5EKTLWNBPV5UV4VQFYCPEV62QIKLNWJNRELQUHQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:11.009492969 (940h24m58.707061275s) [noise=true , address=185.167.204.206:4053 , piece_id=COIFRESLRMMEZWJWZBRXRKWIWYQTTX2HNMQ2HZEU4W2HOEYN2BAQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:14.848602514 (940h25m2.54617086s) [noise=true , address=81.171.14.70:4034 , piece_id=OMXZFG7QTJI5FENUZEJEJH26JVHU2NRFJ5WKOEVBBTD372MTHTLA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:18.923171710 (940h25m6.620740016s) [noise=true , address=185.167.204.206:4044 , piece_id=AGHSAM6TTOCAV6DQ4CNQYL7Z2JCW5WBR3ZFHA54NBQ4KKUNFR3DA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:24.178084820 (940h25m11.875653156s) [noise=true , address=81.171.14.70:4048 , piece_id=H2JISB6CIB6GXDOJGRFZGT3PTO6CXWTMIP35HP4EJ6UFDR6VAFHA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:24.345580139 (940h25m12.043148476s) [noise=true , address=185.167.204.206:4043 , piece_id=XVR5SSKXFBJQ6IJYRZWVYMP7U7QX4DI573IJLNIQDMGLWUURJ5BA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:30.650190383 (940h25m18.34775873s) [noise=true , address=89.149.201.147:4009 , piece_id=SB5MGTDT7ZYWRJHAT7DXEXVPRUOYQHOE26ZPSMIAYDBKXKSMC4GQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:33.145653670 (940h25m20.843221986s) [noise=true , address=185.167.204.205:4024 , piece_id=S4ZQSSK5NC67YCB77KNFJ2N3HIKKNSLAVEKYLE7RNJHVB4QNKDJA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:52.229080657 (940h25m39.926648994s) [noise=true , address=185.167.204.206:4041 , piece_id=I66YBRAVI3RRZWGTS5TATOXGG4RLVPEMUIOH7ZFWEIEU7A4NWLSQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:54.705198722 (940h25m42.402767067s) [noise=true , address=81.171.14.70:4035 , piece_id=DAQQ2TB2GQ7FX4GASMUDTAXBQSJVJOPUZSTPST6HEINE2P4EMZPQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:57.788015936 (940h25m45.485584252s) [noise=true , address=81.171.14.70:4047 , piece_id=UEWDA7RSKDB3HBRGXVFTLGURRCNPUCGQXYPVISAYRAFJD6FBCVZQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:58.342240486 (940h25m46.039808792s) [noise=true , address=185.167.204.206:4057 , piece_id=3WC4CODN7WMVGWXMNRCOPOMGOOQCAHYIK5WI5SC2CN5A2SIHBI2Q, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:59.013162301 (940h25m46.710730617s) [noise=true , address=185.167.204.205:4014 , piece_id=AX672A773Q3HALY4B5DG5UAU5KXNGTTO2MM3V5F23LIS2DVRODUQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: expected piece hash; context deadline exceeded; EOF
Jan 13 19:54:59.013255815 (940h25m46.710824131s) [noise=true , address=185.167.204.206:4071 , piece_id=CCQWEOUKVUJWP6HCOVP3CVJHNCMBJOI37LYG7UT7V5PB2UICRYTA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: expected piece hash; context deadline exceeded; EOF
Jan 13 19:54:59.013267066 (940h25m46.710835373s) [noise=true , address=81.171.14.70:4033 , piece_id=OF3EGAEVGTG7JFHZC66SO6UPJJ6H3CZNWS3LXRIUFBJDJ6BC3WAQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 5.161.89.252:31528->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 13 19:54:59.013314736 (940h25m46.710883052s) [noise=true , address=185.167.204.206:4068 , piece_id=4ZLWAHB37KTGYARVB2DYWQXQBUOKT6ZEEAIABEZN2NLUM7O4XYRQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: write tcp 5.161.89.252:25924->185.167.204.206:4068: use of closed network connection; write tcp 5.161.89.252:25924->185.167.204.206:4068: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:25924->185.167.204.206:4068: use of closed network connection
Jan 13 19:54:59.013331217 (940h25m46.710899523s) [noise=true , address=185.167.204.205:4018 , piece_id=KHCXAC7XYSUZRCG5IMNZWF4YUUAW7BEXKJWMX3IGN4RH2LXH5JTQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: expected piece hash; context deadline exceeded; EOF
Jan 13 19:54:59.013350463 (940h25m46.710918769s) [seg_pos={0 0}, upload=827407]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Jan 13 19:54:59.121040217 (940h25m46.818608524s) [upload=827407]: Done uploading segments...
Jan 13 19:54:59.121073530 (940h25m46.818641836s) [upload=827407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.741416061s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
196.468149ms trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:35:32 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 196.494929ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000899141s trace:
https://jaeger.dev.storj.io/trace/4164af31a2c1e3ba
FAIL (2026-01-13 20:35:13 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 30.000913557s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.723570608s trace:
https://jaeger.dev.storj.io/trace/4844502e2a926458
FAIL (2026-01-13 20:35:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
15775452 (940h24m47.113343758s) [noise=true , address=185.167.204.206:4071 , piece_id=CCQWEOUKVUJWP6HCOVP3CVJHNCMBJOI37LYG7UT7V5PB2UICRYTA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416056437 (940h24m47.113624753s) [noise=true , address=81.171.14.70:4036 , piece_id=KKG4BOL5GERDMMQGYDMBUSTWSFBJRDYCHGEUBXNH3USYUM3NEWHA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416296104 (940h24m47.11386441s) [noise=true , address=81.171.14.70:4034 , piece_id=OMXZFG7QTJI5FENUZEJEJH26JVHU2NRFJ5WKOEVBBTD372MTHTLA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416532666 (940h24m47.114100983s) [noise=true , address=185.167.204.206:4041 , piece_id=I66YBRAVI3RRZWGTS5TATOXGG4RLVPEMUIOH7ZFWEIEU7A4NWLSQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416781050 (940h24m47.114349366s) [noise=true , address=81.171.14.70:4035 , piece_id=DAQQ2TB2GQ7FX4GASMUDTAXBQSJVJOPUZSTPST6HEINE2P4EMZPQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416940859 (940h24m47.114509175s) [noise=true , address=185.167.204.206:4066 , piece_id=4ZE5QZNLZYOZBFNP5ZPKYFPIDJ23TJ5OIED2LDELYAAM4H6LP7FQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.417316110 (940h24m47.114884426s) [noise=true , address=185.167.204.206:4061 , piece_id=V75RDU4ZULOTZ3UWCFKIC6CP37QJJ5MVMMMETOES5WNWX5RYI2GA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.417683546 (940h24m47.115251852s) [noise=true , address=185.167.204.206:4068 , piece_id=4ZLWAHB37KTGYARVB2DYWQXQBUOKT6ZEEAIABEZN2NLUM7O4XYRQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.417905471 (940h24m47.115473787s) [noise=true , address=89.149.201.147:4009 , piece_id=SB5MGTDT7ZYWRJHAT7DXEXVPRUOYQHOE26ZPSMIAYDBKXKSMC4GQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.418182899 (940h24m47.115751205s) [noise=true , address=185.167.204.206:4044 , piece_id=AGHSAM6TTOCAV6DQ4CNQYL7Z2JCW5WBR3ZFHA54NBQ4KKUNFR3DA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.906863790 (940h24m47.604432106s) [upload=827407]: Next returned nil segment
Jan 13 19:53:59.906879790 (940h24m47.604448116s) [upload=827407]: Waiting for error group managing segments...
Jan 13 19:54:00.101800919 (940h24m47.799369225s) [noise=true , address=185.167.204.206:4040 , piece_id=7LJIR5IYSOOVDMBBDCSOWKKSVDVNBVPSBE56MSFSXFAAIBNOHRPQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.111306073 (940h24m47.808874389s) [noise=true , address=185.167.204.206:4050 , piece_id=JD3FGI65CTBJ5JNU46MEEDUUPCZOAZEPAWY7IX6I65T7NOSWNSIA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.125302258 (940h24m47.822870574s) [noise=true , address=89.149.201.147:4002 , piece_id=WU4GGUI4MAN3ZAOSAESKGIXPGGFVLZNDZZAKX6WFFEW7SLURVCJQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.136910571 (940h24m47.834478887s) [noise=true , address=185.167.204.205:4002 , piece_id=BMBVB5UTH3J64ILAURAZLELVKVYHBKW5AOO43B4ZUFBGPRHOHWCA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.137705626 (940h24m47.835273942s) [noise=true , address=185.167.204.206:4066 , piece_id=4ZE5QZNLZYOZBFNP5ZPKYFPIDJ23TJ5OIED2LDELYAAM4H6LP7FQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.140468797 (940h24m47.838037113s) [noise=true , address=185.167.204.206:4061 , piece_id=V75RDU4ZULOTZ3UWCFKIC6CP37QJJ5MVMMMETOES5WNWX5RYI2GA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.142415674 (940h24m47.83998398s) [noise=true , address=185.167.204.205:4027 , piece_id=2N25T6ZYMTW2UQK77VD2KUYPVSCLFQO4NU2HQTNQ3PB3YTPTTRHQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.144376346 (940h24m47.841944662s) [noise=true , address=81.171.14.70:4043 , piece_id=W5V5K6S23EYEEACDEK3GBYBMLUUE3NVST6TI3WX67TLNW7BH3VCA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.145056828 (940h24m47.842625144s) [noise=true , address=185.167.204.206:4047 , piece_id=KXFGOO7M73EJOOPV2LHA6TSZO3OWOPQMAGTY2OOLG2WWOTKDWK4Q, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.152514547 (940h24m47.850082863s) [noise=true , address=81.171.14.70:4036 , piece_id=KKG4BOL5GERDMMQGYDMBUSTWSFBJRDYCHGEUBXNH3USYUM3NEWHA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.153860011 (940h24m47.851428328s) [noise=true , address=81.171.14.70:4037 , piece_id=YJBSCGS72RCQFYP36LOTW47KEQN3EZZP7RZJ7EQZLZYAZLZARGDA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.163119087 (940h24m47.860687392s) [noise=true , address=81.171.14.70:4039 , piece_id=GHTSYJLRNW7SO5EKTLWNBPV5UV4VQFYCPEV62QIKLNWJNRELQUHQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:11.009492969 (940h24m58.707061275s) [noise=true , address=185.167.204.206:4053 , piece_id=COIFRESLRMMEZWJWZBRXRKWIWYQTTX2HNMQ2HZEU4W2HOEYN2BAQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:14.848602514 (940h25m2.54617086s) [noise=true , address=81.171.14.70:4034 , piece_id=OMXZFG7QTJI5FENUZEJEJH26JVHU2NRFJ5WKOEVBBTD372MTHTLA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:18.923171710 (940h25m6.620740016s) [noise=true , address=185.167.204.206:4044 , piece_id=AGHSAM6TTOCAV6DQ4CNQYL7Z2JCW5WBR3ZFHA54NBQ4KKUNFR3DA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:24.178084820 (940h25m11.875653156s) [noise=true , address=81.171.14.70:4048 , piece_id=H2JISB6CIB6GXDOJGRFZGT3PTO6CXWTMIP35HP4EJ6UFDR6VAFHA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:24.345580139 (940h25m12.043148476s) [noise=true , address=185.167.204.206:4043 , piece_id=XVR5SSKXFBJQ6IJYRZWVYMP7U7QX4DI573IJLNIQDMGLWUURJ5BA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:30.650190383 (940h25m18.34775873s) [noise=true , address=89.149.201.147:4009 , piece_id=SB5MGTDT7ZYWRJHAT7DXEXVPRUOYQHOE26ZPSMIAYDBKXKSMC4GQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:33.145653670 (940h25m20.843221986s) [noise=true , address=185.167.204.205:4024 , piece_id=S4ZQSSK5NC67YCB77KNFJ2N3HIKKNSLAVEKYLE7RNJHVB4QNKDJA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:52.229080657 (940h25m39.926648994s) [noise=true , address=185.167.204.206:4041 , piece_id=I66YBRAVI3RRZWGTS5TATOXGG4RLVPEMUIOH7ZFWEIEU7A4NWLSQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:54.705198722 (940h25m42.402767067s) [noise=true , address=81.171.14.70:4035 , piece_id=DAQQ2TB2GQ7FX4GASMUDTAXBQSJVJOPUZSTPST6HEINE2P4EMZPQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:57.788015936 (940h25m45.485584252s) [noise=true , address=81.171.14.70:4047 , piece_id=UEWDA7RSKDB3HBRGXVFTLGURRCNPUCGQXYPVISAYRAFJD6FBCVZQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:58.342240486 (940h25m46.039808792s) [noise=true , address=185.167.204.206:4057 , piece_id=3WC4CODN7WMVGWXMNRCOPOMGOOQCAHYIK5WI5SC2CN5A2SIHBI2Q, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:59.013162301 (940h25m46.710730617s) [noise=true , address=185.167.204.205:4014 , piece_id=AX672A773Q3HALY4B5DG5UAU5KXNGTTO2MM3V5F23LIS2DVRODUQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: expected piece hash; context deadline exceeded; EOF
Jan 13 19:54:59.013255815 (940h25m46.710824131s) [noise=true , address=185.167.204.206:4071 , piece_id=CCQWEOUKVUJWP6HCOVP3CVJHNCMBJOI37LYG7UT7V5PB2UICRYTA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: expected piece hash; context deadline exceeded; EOF
Jan 13 19:54:59.013267066 (940h25m46.710835373s) [noise=true , address=81.171.14.70:4033 , piece_id=OF3EGAEVGTG7JFHZC66SO6UPJJ6H3CZNWS3LXRIUFBJDJ6BC3WAQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 5.161.89.252:31528->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 13 19:54:59.013314736 (940h25m46.710883052s) [noise=true , address=185.167.204.206:4068 , piece_id=4ZLWAHB37KTGYARVB2DYWQXQBUOKT6ZEEAIABEZN2NLUM7O4XYRQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: write tcp 5.161.89.252:25924->185.167.204.206:4068: use of closed network connection; write tcp 5.161.89.252:25924->185.167.204.206:4068: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:25924->185.167.204.206:4068: use of closed network connection
Jan 13 19:54:59.013331217 (940h25m46.710899523s) [noise=true , address=185.167.204.205:4018 , piece_id=KHCXAC7XYSUZRCG5IMNZWF4YUUAW7BEXKJWMX3IGN4RH2LXH5JTQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: expected piece hash; context deadline exceeded; EOF
Jan 13 19:54:59.013350463 (940h25m46.710918769s) [seg_pos={0 0}, upload=827407]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Jan 13 19:54:59.121040217 (940h25m46.818608524s) [upload=827407]: Done uploading segments...
Jan 13 19:54:59.121073530 (940h25m46.818641836s) [upload=827407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.723588962s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.344864225s trace:
https://jaeger.dev.storj.io/trace/4844502e2a926458
FAIL (2026-01-13 20:33:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
15775452 (940h24m47.113343758s) [noise=true , address=185.167.204.206:4071 , piece_id=CCQWEOUKVUJWP6HCOVP3CVJHNCMBJOI37LYG7UT7V5PB2UICRYTA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416056437 (940h24m47.113624753s) [noise=true , address=81.171.14.70:4036 , piece_id=KKG4BOL5GERDMMQGYDMBUSTWSFBJRDYCHGEUBXNH3USYUM3NEWHA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416296104 (940h24m47.11386441s) [noise=true , address=81.171.14.70:4034 , piece_id=OMXZFG7QTJI5FENUZEJEJH26JVHU2NRFJ5WKOEVBBTD372MTHTLA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416532666 (940h24m47.114100983s) [noise=true , address=185.167.204.206:4041 , piece_id=I66YBRAVI3RRZWGTS5TATOXGG4RLVPEMUIOH7ZFWEIEU7A4NWLSQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416781050 (940h24m47.114349366s) [noise=true , address=81.171.14.70:4035 , piece_id=DAQQ2TB2GQ7FX4GASMUDTAXBQSJVJOPUZSTPST6HEINE2P4EMZPQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.416940859 (940h24m47.114509175s) [noise=true , address=185.167.204.206:4066 , piece_id=4ZE5QZNLZYOZBFNP5ZPKYFPIDJ23TJ5OIED2LDELYAAM4H6LP7FQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.417316110 (940h24m47.114884426s) [noise=true , address=185.167.204.206:4061 , piece_id=V75RDU4ZULOTZ3UWCFKIC6CP37QJJ5MVMMMETOES5WNWX5RYI2GA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.417683546 (940h24m47.115251852s) [noise=true , address=185.167.204.206:4068 , piece_id=4ZLWAHB37KTGYARVB2DYWQXQBUOKT6ZEEAIABEZN2NLUM7O4XYRQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.417905471 (940h24m47.115473787s) [noise=true , address=89.149.201.147:4009 , piece_id=SB5MGTDT7ZYWRJHAT7DXEXVPRUOYQHOE26ZPSMIAYDBKXKSMC4GQ, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.418182899 (940h24m47.115751205s) [noise=true , address=185.167.204.206:4044 , piece_id=AGHSAM6TTOCAV6DQ4CNQYL7Z2JCW5WBR3ZFHA54NBQ4KKUNFR3DA, seg_pos={0 0}, upload=827407]: Uploading piece...
Jan 13 19:53:59.906863790 (940h24m47.604432106s) [upload=827407]: Next returned nil segment
Jan 13 19:53:59.906879790 (940h24m47.604448116s) [upload=827407]: Waiting for error group managing segments...
Jan 13 19:54:00.101800919 (940h24m47.799369225s) [noise=true , address=185.167.204.206:4040 , piece_id=7LJIR5IYSOOVDMBBDCSOWKKSVDVNBVPSBE56MSFSXFAAIBNOHRPQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.111306073 (940h24m47.808874389s) [noise=true , address=185.167.204.206:4050 , piece_id=JD3FGI65CTBJ5JNU46MEEDUUPCZOAZEPAWY7IX6I65T7NOSWNSIA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.125302258 (940h24m47.822870574s) [noise=true , address=89.149.201.147:4002 , piece_id=WU4GGUI4MAN3ZAOSAESKGIXPGGFVLZNDZZAKX6WFFEW7SLURVCJQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.136910571 (940h24m47.834478887s) [noise=true , address=185.167.204.205:4002 , piece_id=BMBVB5UTH3J64ILAURAZLELVKVYHBKW5AOO43B4ZUFBGPRHOHWCA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.137705626 (940h24m47.835273942s) [noise=true , address=185.167.204.206:4066 , piece_id=4ZE5QZNLZYOZBFNP5ZPKYFPIDJ23TJ5OIED2LDELYAAM4H6LP7FQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.140468797 (940h24m47.838037113s) [noise=true , address=185.167.204.206:4061 , piece_id=V75RDU4ZULOTZ3UWCFKIC6CP37QJJ5MVMMMETOES5WNWX5RYI2GA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.142415674 (940h24m47.83998398s) [noise=true , address=185.167.204.205:4027 , piece_id=2N25T6ZYMTW2UQK77VD2KUYPVSCLFQO4NU2HQTNQ3PB3YTPTTRHQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.144376346 (940h24m47.841944662s) [noise=true , address=81.171.14.70:4043 , piece_id=W5V5K6S23EYEEACDEK3GBYBMLUUE3NVST6TI3WX67TLNW7BH3VCA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.145056828 (940h24m47.842625144s) [noise=true , address=185.167.204.206:4047 , piece_id=KXFGOO7M73EJOOPV2LHA6TSZO3OWOPQMAGTY2OOLG2WWOTKDWK4Q, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.152514547 (940h24m47.850082863s) [noise=true , address=81.171.14.70:4036 , piece_id=KKG4BOL5GERDMMQGYDMBUSTWSFBJRDYCHGEUBXNH3USYUM3NEWHA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.153860011 (940h24m47.851428328s) [noise=true , address=81.171.14.70:4037 , piece_id=YJBSCGS72RCQFYP36LOTW47KEQN3EZZP7RZJ7EQZLZYAZLZARGDA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:00.163119087 (940h24m47.860687392s) [noise=true , address=81.171.14.70:4039 , piece_id=GHTSYJLRNW7SO5EKTLWNBPV5UV4VQFYCPEV62QIKLNWJNRELQUHQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:11.009492969 (940h24m58.707061275s) [noise=true , address=185.167.204.206:4053 , piece_id=COIFRESLRMMEZWJWZBRXRKWIWYQTTX2HNMQ2HZEU4W2HOEYN2BAQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:14.848602514 (940h25m2.54617086s) [noise=true , address=81.171.14.70:4034 , piece_id=OMXZFG7QTJI5FENUZEJEJH26JVHU2NRFJ5WKOEVBBTD372MTHTLA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:18.923171710 (940h25m6.620740016s) [noise=true , address=185.167.204.206:4044 , piece_id=AGHSAM6TTOCAV6DQ4CNQYL7Z2JCW5WBR3ZFHA54NBQ4KKUNFR3DA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:24.178084820 (940h25m11.875653156s) [noise=true , address=81.171.14.70:4048 , piece_id=H2JISB6CIB6GXDOJGRFZGT3PTO6CXWTMIP35HP4EJ6UFDR6VAFHA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:24.345580139 (940h25m12.043148476s) [noise=true , address=185.167.204.206:4043 , piece_id=XVR5SSKXFBJQ6IJYRZWVYMP7U7QX4DI573IJLNIQDMGLWUURJ5BA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:30.650190383 (940h25m18.34775873s) [noise=true , address=89.149.201.147:4009 , piece_id=SB5MGTDT7ZYWRJHAT7DXEXVPRUOYQHOE26ZPSMIAYDBKXKSMC4GQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:33.145653670 (940h25m20.843221986s) [noise=true , address=185.167.204.205:4024 , piece_id=S4ZQSSK5NC67YCB77KNFJ2N3HIKKNSLAVEKYLE7RNJHVB4QNKDJA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:52.229080657 (940h25m39.926648994s) [noise=true , address=185.167.204.206:4041 , piece_id=I66YBRAVI3RRZWGTS5TATOXGG4RLVPEMUIOH7ZFWEIEU7A4NWLSQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:54.705198722 (940h25m42.402767067s) [noise=true , address=81.171.14.70:4035 , piece_id=DAQQ2TB2GQ7FX4GASMUDTAXBQSJVJOPUZSTPST6HEINE2P4EMZPQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:57.788015936 (940h25m45.485584252s) [noise=true , address=81.171.14.70:4047 , piece_id=UEWDA7RSKDB3HBRGXVFTLGURRCNPUCGQXYPVISAYRAFJD6FBCVZQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:58.342240486 (940h25m46.039808792s) [noise=true , address=185.167.204.206:4057 , piece_id=3WC4CODN7WMVGWXMNRCOPOMGOOQCAHYIK5WI5SC2CN5A2SIHBI2Q, seg_pos={0 0}, upload=827407]: Done uploading piece. err: <nil>
Jan 13 19:54:59.013162301 (940h25m46.710730617s) [noise=true , address=185.167.204.205:4014 , piece_id=AX672A773Q3HALY4B5DG5UAU5KXNGTTO2MM3V5F23LIS2DVRODUQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: expected piece hash; context deadline exceeded; EOF
Jan 13 19:54:59.013255815 (940h25m46.710824131s) [noise=true , address=185.167.204.206:4071 , piece_id=CCQWEOUKVUJWP6HCOVP3CVJHNCMBJOI37LYG7UT7V5PB2UICRYTA, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:1D11dtZNczougJ1KxaPqpiKAREiUZW6P7UenqMkLZzqDEEvjK8, address:185.167.204.206:4071): protocol: expected piece hash; context deadline exceeded; EOF
Jan 13 19:54:59.013267066 (940h25m46.710835373s) [noise=true , address=81.171.14.70:4033 , piece_id=OF3EGAEVGTG7JFHZC66SO6UPJJ6H3CZNWS3LXRIUFBJDJ6BC3WAQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 5.161.89.252:31528->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 13 19:54:59.013314736 (940h25m46.710883052s) [noise=true , address=185.167.204.206:4068 , piece_id=4ZLWAHB37KTGYARVB2DYWQXQBUOKT6ZEEAIABEZN2NLUM7O4XYRQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: write tcp 5.161.89.252:25924->185.167.204.206:4068: use of closed network connection; write tcp 5.161.89.252:25924->185.167.204.206:4068: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:25924->185.167.204.206:4068: use of closed network connection
Jan 13 19:54:59.013331217 (940h25m46.710899523s) [noise=true , address=185.167.204.205:4018 , piece_id=KHCXAC7XYSUZRCG5IMNZWF4YUUAW7BEXKJWMX3IGN4RH2LXH5JTQ, seg_pos={0 0}, upload=827407]: Done uploading piece. err: ecclient: upload failed (node:12w2LyfAtY3ihjJgkBtord4fMMfbEvz73nExjTNZhLQXurdA3iS, address:185.167.204.205:4018): protocol: expected piece hash; context deadline exceeded; EOF
Jan 13 19:54:59.013350463 (940h25m46.710918769s) [seg_pos={0 0}, upload=827407]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Jan 13 19:54:59.121040217 (940h25m46.818608524s) [upload=827407]: Done uploading segments...
Jan 13 19:54:59.121073530 (940h25m46.818641836s) [upload=827407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.344884102s
core
uplink
eu-select-1
eu1-placement-15
|