Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 111016 reports (Page 186 of 2221)
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................]
duration:
383.753337ms
FAIL (2025-12-04 10:21:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 383.767694ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration:
333.765326ms
FAIL (2025-12-04 10:20:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 333.796715ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration:
365.576294ms
FAIL (2025-12-04 10:19:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 365.591172ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................]
duration:
327.667471ms
FAIL (2025-12-04 10:19:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 327.687559ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................]
duration:
372.117538ms
FAIL (2025-12-04 10:18:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 372.129861ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................]
duration:
342.488218ms
FAIL (2025-12-04 10:17:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 342.502433ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................]
duration:
334.270429ms
FAIL (2025-12-04 10:16:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 334.288333ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................]
duration:
333.681351ms
FAIL (2025-12-04 10:16:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 333.700467ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................]
duration:
346.832793ms
FAIL (2025-12-04 10:15:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 346.859221ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................]
duration:
350.245435ms
FAIL (2025-12-04 10:15:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 350.266275ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................]
duration:
362.564802ms
FAIL (2025-12-04 10:13:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 362.577907ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration:
322.42009ms
FAIL (2025-12-04 10:13:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 322.443243ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................]
duration:
353.875384ms
FAIL (2025-12-04 10:12:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 353.898186ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................]
duration:
355.91022ms
FAIL (2025-12-04 10:11:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 355.932793ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................]
duration:
343.721692ms
FAIL (2025-12-04 10:11:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 343.738875ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................]
duration:
341.539937ms
FAIL (2025-12-04 10:10:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 341.57411ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................]
duration:
394.957257ms
FAIL (2025-12-04 10:09:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 394.977365ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration:
323.982262ms
FAIL (2025-12-04 10:08:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 324.020883ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration:
386.301694ms
FAIL (2025-12-04 10:08:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 386.319957ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................]
duration:
325.057572ms
FAIL (2025-12-04 10:07:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 325.076709ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................]
duration:
349.580261ms
FAIL (2025-12-04 10:06:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 349.614424ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................]
duration:
352.400014ms
FAIL (2025-12-04 10:05:03 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 352.533964ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration:
369.794743ms
FAIL (2025-12-04 10:03:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 369.818819ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
343.694604ms
FAIL (2025-12-04 10:02:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 343.712518ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
361.604336ms
FAIL (2025-12-04 10:01:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 361.626658ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
316.037715ms
FAIL (2025-12-04 10:01:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 316.056762ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
387.686023ms
FAIL (2025-12-04 10:01:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 387.707484ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
312.564951ms
FAIL (2025-12-04 10:00:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 312.583806ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
364.091037ms
FAIL (2025-12-04 09:59:37 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 364.115533ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
368.482618ms
FAIL (2025-12-04 09:59:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 368.501335ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
337.516713ms
FAIL (2025-12-04 09:58:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 337.533655ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
349.273889ms
FAIL (2025-12-04 09:57:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 349.316389ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
322.109497ms
FAIL (2025-12-04 09:56:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 322.125937ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
302.694762ms
FAIL (2025-12-04 09:55:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 302.834352ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
361.474394ms
FAIL (2025-12-04 09:54:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 361.49427ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
332.096236ms
FAIL (2025-12-04 09:54:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 332.114049ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
403.718638ms
FAIL (2025-12-04 09:53:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 403.744636ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
365.326588ms
FAIL (2025-12-04 09:52:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 365.346937ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
349.000379ms
FAIL (2025-12-04 09:51:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 349.020977ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
383.201935ms
FAIL (2025-12-04 09:50:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 383.216343ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
967.708083ms
FAIL (2025-12-03 03:51:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 967.720305ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
331.064245ms
FAIL (2025-12-03 03:50:53 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
ZAEK5CH7A4CLFLSQZHE3FQLXGOUIAL6P2LJRNYQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.080302860 (879h51m26.781247775s) [noise=true , address=145.79.227.31:4812   , piece_id=6XBCHYA3OQJU5HLGA6MXPCKRU53ZS3T7NMQUQIDEPEADZICY2CDA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.080400042 (879h51m26.781344947s) [noise=true , address=77.90.31.13:4657     , piece_id=XOOB4JBYVH64ZTWXC4WL53VHYV5H6D5VJSYY2EQZMMYZLBDESLBQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.080935558 (879h51m26.781880473s) [noise=true , address=77.90.31.14:4676     , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.081500607 (879h51m26.782445523s) [noise=true , address=145.79.227.18:4025   , piece_id=7NACG5YCV33VISNW4JX6AHLMZHLI456NQY4EVO6YTQ32MHI46TTA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.082102287 (879h51m26.783047202s) [noise=true , address=45.91.116.5:4319     , piece_id=7V3JWIGKHHVQRHBQ5VZFSHQ6ACAKRXLKRA7QPXXLDG2QSHP5ET7Q, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.082736237 (879h51m26.783681152s) [noise=true , address=77.90.31.19:4860     , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.083237186 (879h51m26.784182102s) [noise=true , address=45.91.116.9:4288     , piece_id=5PXKYPZY7PN2TU6IXOPASYSV7YOOX7AMVRELMFN25T2XSHPX2C7Q, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.083737716 (879h51m26.784682621s) [noise=true , address=45.91.116.6:4997     , piece_id=XYO3QD6DOBNHMUYYUNO2VKRPL7OMCCIA4DNLOFOMGZDDZAQLYNDQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.084351898 (879h51m26.785296783s) [noise=true , address=45.91.116.14:4218    , piece_id=KDXUEVSB4UCJQQD4QLHOXD3RLKS2KW237S44S43K7AHHC3KV6DQQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.084701986 (879h51m26.78564687s) [noise=true , address=145.79.227.15:4891   , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.085026945 (879h51m26.78597183s) [noise=true , address=45.91.116.13:4165    , piece_id=H36AJQ6TM42ZWYJ5NQPSSIOC6XYWDCACCYIPPYBRAVYBZACCYIVA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.085353417 (879h51m26.786298303s) [noise=true , address=77.90.31.15:4705     , piece_id=3PAE3AI74Y2URW5FWQLHVWS3GHAZRNXS5QXVEPLYEWRIZPXVRWWQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.085650906 (879h51m26.786595801s) [noise=true , address=45.91.116.7:4039     , piece_id=HXDSSB5O467DEMIMCXZ4OWGIV5OKB4TTDZSXSD7PZYWMYDYORVPA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.085949286 (879h51m26.786894181s) [noise=true , address=77.90.31.11:4582     , piece_id=7NGIKVWARZJ32OLOHJNZ4L7XDV564CDJUWMWENT7XQM43BUHV4BA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.086195117 (879h51m26.787140012s) [noise=true , address=45.91.116.11:4148    , piece_id=QE6B7FVHLWTJ6XJFXAKIGWAIZATSHPOW4CA4E5UPJBSDJAJSPSJA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.086467669 (879h51m26.787412564s) [noise=true , address=64.49.13.154:4932    , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.164815383 (879h51m26.865760268s) [upload=774178]: Next returned nil segment
Dec  3 03:05:00.164840239 (879h51m26.865785125s) [upload=774178]: Waiting for error group managing segments...
Dec  3 03:05:00.174108452 (879h51m26.875053357s) [noise=true , address=77.90.31.15:4705     , piece_id=3PAE3AI74Y2URW5FWQLHVWS3GHAZRNXS5QXVEPLYEWRIZPXVRWWQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.174142326 (879h51m26.87508723s) [noise=true , address=45.91.116.13:4165    , piece_id=H36AJQ6TM42ZWYJ5NQPSSIOC6XYWDCACCYIPPYBRAVYBZACCYIVA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.175189781 (879h51m26.876134687s) [noise=true , address=77.90.31.12:4618     , piece_id=TUIE7COH6746VZAEK5CH7A4CLFLSQZHE3FQLXGOUIAL6P2LJRNYQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.178871150 (879h51m26.879816035s) [noise=true , address=145.79.227.18:4025   , piece_id=7NACG5YCV33VISNW4JX6AHLMZHLI456NQY4EVO6YTQ32MHI46TTA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.182466616 (879h51m26.883411501s) [noise=true , address=45.91.116.11:4148    , piece_id=QE6B7FVHLWTJ6XJFXAKIGWAIZATSHPOW4CA4E5UPJBSDJAJSPSJA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.184850901 (879h51m26.885795796s) [noise=true , address=45.91.116.14:4218    , piece_id=KDXUEVSB4UCJQQD4QLHOXD3RLKS2KW237S44S43K7AHHC3KV6DQQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.186313426 (879h51m26.887258321s) [noise=true , address=45.91.116.7:4039     , piece_id=HXDSSB5O467DEMIMCXZ4OWGIV5OKB4TTDZSXSD7PZYWMYDYORVPA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.187108287 (879h51m26.888053172s) [noise=true , address=45.91.116.6:4997     , piece_id=XYO3QD6DOBNHMUYYUNO2VKRPL7OMCCIA4DNLOFOMGZDDZAQLYNDQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.188257253 (879h51m26.889202148s) [noise=true , address=45.91.116.9:4288     , piece_id=5PXKYPZY7PN2TU6IXOPASYSV7YOOX7AMVRELMFN25T2XSHPX2C7Q, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.191179818 (879h51m26.892124703s) [noise=true , address=77.90.31.18:4837     , piece_id=XQGP57SUAR7DNHY6UYF6TPCPN7MM6WMUX4WMJJCCF5BBBEJYIQ7A, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.193701038 (879h51m26.894645933s) [noise=true , address=45.91.116.5:4319     , piece_id=7V3JWIGKHHVQRHBQ5VZFSHQ6ACAKRXLKRA7QPXXLDG2QSHP5ET7Q, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.194005079 (879h51m26.894949984s) [noise=true , address=145.79.227.31:4812   , piece_id=6XBCHYA3OQJU5HLGA6MXPCKRU53ZS3T7NMQUQIDEPEADZICY2CDA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.199219063 (879h51m26.900163958s) [noise=true , address=77.90.31.13:4657     , piece_id=XOOB4JBYVH64ZTWXC4WL53VHYV5H6D5VJSYY2EQZMMYZLBDESLBQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.208591191 (879h51m26.909536076s) [noise=true , address=77.90.31.11:4582     , piece_id=7NGIKVWARZJ32OLOHJNZ4L7XDV564CDJUWMWENT7XQM43BUHV4BA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.208619464 (879h51m26.909564349s) [seg_pos={0 0}, upload=774178]: Segment reached optimal threshold of 14 pieces.
Dec  3 03:05:00.208754597 (879h51m26.909699482s) [noise=true , address=145.79.227.15:4891   , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Newezba9KBtr5PcBVDypYdAxRFdsMtVMUTMcPWLWPLziaJhyK): protocol: expected piece hash; context canceled; EOF
Dec  3 03:05:00.208763324 (879h51m26.909708209s) [noise=true , address=145.79.227.15:4891   , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec  3 03:05:00.208776869 (879h51m26.909721754s) [noise=true , address=77.90.31.19:4860     , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17ddUMj4ZejcjjWGzkGEM63vbCoEPnu7ePznzAPyzQofW8Q4gd): protocol: expected piece hash; context canceled; EOF
Dec  3 03:05:00.208784383 (879h51m26.909729268s) [noise=true , address=77.90.31.19:4860     , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec  3 03:05:00.208884902 (879h51m26.909829797s) [noise=true , address=77.90.31.14:4676     , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tpRh8Xvyxe72LDgR9rkUFx9qV88axb9DUYDhRnrzST2cQuHqC): protocol: expected piece hash; context canceled; EOF
Dec  3 03:05:00.208890072 (879h51m26.909834967s) [noise=true , address=77.90.31.14:4676     , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec  3 03:05:00.208952639 (879h51m26.909897524s) [noise=true , address=64.49.13.154:4932    , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UhZuvUKofduRzgCWi3WQcfZVuekxBJUXydn3H1ktQ7AmRRvcx): protocol: read tcp 5.161.89.252:62308->64.49.13.154:4932: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec  3 03:05:00.208961976 (879h51m26.909906891s) [noise=true , address=64.49.13.154:4932    , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec  3 03:05:00.208979329 (879h51m26.909924214s) [seg_pos={0 0}, upload=774178]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec  3 03:05:00.209054830 (879h51m26.909999705s) [upload=774178]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  3 03:05:00.209061283 (879h51m26.910006168s) [upload=774178]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  3 03:05:00.243054974 (879h51m26.943999869s) [upload=774178]: Done uploading segments...
Dec  3 03:05:00.243070513 (879h51m26.944015398s) [upload=774178]: Upload finished. err: <nil>
Duration: 331.089081ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
595.042824ms
FAIL (2025-12-03 03:50:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 595.282456ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=3) [X.X.........................................................]
duration:
530.703623ms
FAIL (2025-12-03 03:50:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 530.726677ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
346.321595ms
FAIL (2025-12-03 03:49:59 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
ZAEK5CH7A4CLFLSQZHE3FQLXGOUIAL6P2LJRNYQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.080302860 (879h51m26.781247775s) [noise=true , address=145.79.227.31:4812   , piece_id=6XBCHYA3OQJU5HLGA6MXPCKRU53ZS3T7NMQUQIDEPEADZICY2CDA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.080400042 (879h51m26.781344947s) [noise=true , address=77.90.31.13:4657     , piece_id=XOOB4JBYVH64ZTWXC4WL53VHYV5H6D5VJSYY2EQZMMYZLBDESLBQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.080935558 (879h51m26.781880473s) [noise=true , address=77.90.31.14:4676     , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.081500607 (879h51m26.782445523s) [noise=true , address=145.79.227.18:4025   , piece_id=7NACG5YCV33VISNW4JX6AHLMZHLI456NQY4EVO6YTQ32MHI46TTA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.082102287 (879h51m26.783047202s) [noise=true , address=45.91.116.5:4319     , piece_id=7V3JWIGKHHVQRHBQ5VZFSHQ6ACAKRXLKRA7QPXXLDG2QSHP5ET7Q, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.082736237 (879h51m26.783681152s) [noise=true , address=77.90.31.19:4860     , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.083237186 (879h51m26.784182102s) [noise=true , address=45.91.116.9:4288     , piece_id=5PXKYPZY7PN2TU6IXOPASYSV7YOOX7AMVRELMFN25T2XSHPX2C7Q, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.083737716 (879h51m26.784682621s) [noise=true , address=45.91.116.6:4997     , piece_id=XYO3QD6DOBNHMUYYUNO2VKRPL7OMCCIA4DNLOFOMGZDDZAQLYNDQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.084351898 (879h51m26.785296783s) [noise=true , address=45.91.116.14:4218    , piece_id=KDXUEVSB4UCJQQD4QLHOXD3RLKS2KW237S44S43K7AHHC3KV6DQQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.084701986 (879h51m26.78564687s) [noise=true , address=145.79.227.15:4891   , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.085026945 (879h51m26.78597183s) [noise=true , address=45.91.116.13:4165    , piece_id=H36AJQ6TM42ZWYJ5NQPSSIOC6XYWDCACCYIPPYBRAVYBZACCYIVA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.085353417 (879h51m26.786298303s) [noise=true , address=77.90.31.15:4705     , piece_id=3PAE3AI74Y2URW5FWQLHVWS3GHAZRNXS5QXVEPLYEWRIZPXVRWWQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.085650906 (879h51m26.786595801s) [noise=true , address=45.91.116.7:4039     , piece_id=HXDSSB5O467DEMIMCXZ4OWGIV5OKB4TTDZSXSD7PZYWMYDYORVPA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.085949286 (879h51m26.786894181s) [noise=true , address=77.90.31.11:4582     , piece_id=7NGIKVWARZJ32OLOHJNZ4L7XDV564CDJUWMWENT7XQM43BUHV4BA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.086195117 (879h51m26.787140012s) [noise=true , address=45.91.116.11:4148    , piece_id=QE6B7FVHLWTJ6XJFXAKIGWAIZATSHPOW4CA4E5UPJBSDJAJSPSJA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.086467669 (879h51m26.787412564s) [noise=true , address=64.49.13.154:4932    , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.164815383 (879h51m26.865760268s) [upload=774178]: Next returned nil segment
Dec  3 03:05:00.164840239 (879h51m26.865785125s) [upload=774178]: Waiting for error group managing segments...
Dec  3 03:05:00.174108452 (879h51m26.875053357s) [noise=true , address=77.90.31.15:4705     , piece_id=3PAE3AI74Y2URW5FWQLHVWS3GHAZRNXS5QXVEPLYEWRIZPXVRWWQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.174142326 (879h51m26.87508723s) [noise=true , address=45.91.116.13:4165    , piece_id=H36AJQ6TM42ZWYJ5NQPSSIOC6XYWDCACCYIPPYBRAVYBZACCYIVA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.175189781 (879h51m26.876134687s) [noise=true , address=77.90.31.12:4618     , piece_id=TUIE7COH6746VZAEK5CH7A4CLFLSQZHE3FQLXGOUIAL6P2LJRNYQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.178871150 (879h51m26.879816035s) [noise=true , address=145.79.227.18:4025   , piece_id=7NACG5YCV33VISNW4JX6AHLMZHLI456NQY4EVO6YTQ32MHI46TTA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.182466616 (879h51m26.883411501s) [noise=true , address=45.91.116.11:4148    , piece_id=QE6B7FVHLWTJ6XJFXAKIGWAIZATSHPOW4CA4E5UPJBSDJAJSPSJA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.184850901 (879h51m26.885795796s) [noise=true , address=45.91.116.14:4218    , piece_id=KDXUEVSB4UCJQQD4QLHOXD3RLKS2KW237S44S43K7AHHC3KV6DQQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.186313426 (879h51m26.887258321s) [noise=true , address=45.91.116.7:4039     , piece_id=HXDSSB5O467DEMIMCXZ4OWGIV5OKB4TTDZSXSD7PZYWMYDYORVPA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.187108287 (879h51m26.888053172s) [noise=true , address=45.91.116.6:4997     , piece_id=XYO3QD6DOBNHMUYYUNO2VKRPL7OMCCIA4DNLOFOMGZDDZAQLYNDQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.188257253 (879h51m26.889202148s) [noise=true , address=45.91.116.9:4288     , piece_id=5PXKYPZY7PN2TU6IXOPASYSV7YOOX7AMVRELMFN25T2XSHPX2C7Q, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.191179818 (879h51m26.892124703s) [noise=true , address=77.90.31.18:4837     , piece_id=XQGP57SUAR7DNHY6UYF6TPCPN7MM6WMUX4WMJJCCF5BBBEJYIQ7A, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.193701038 (879h51m26.894645933s) [noise=true , address=45.91.116.5:4319     , piece_id=7V3JWIGKHHVQRHBQ5VZFSHQ6ACAKRXLKRA7QPXXLDG2QSHP5ET7Q, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.194005079 (879h51m26.894949984s) [noise=true , address=145.79.227.31:4812   , piece_id=6XBCHYA3OQJU5HLGA6MXPCKRU53ZS3T7NMQUQIDEPEADZICY2CDA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.199219063 (879h51m26.900163958s) [noise=true , address=77.90.31.13:4657     , piece_id=XOOB4JBYVH64ZTWXC4WL53VHYV5H6D5VJSYY2EQZMMYZLBDESLBQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.208591191 (879h51m26.909536076s) [noise=true , address=77.90.31.11:4582     , piece_id=7NGIKVWARZJ32OLOHJNZ4L7XDV564CDJUWMWENT7XQM43BUHV4BA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.208619464 (879h51m26.909564349s) [seg_pos={0 0}, upload=774178]: Segment reached optimal threshold of 14 pieces.
Dec  3 03:05:00.208754597 (879h51m26.909699482s) [noise=true , address=145.79.227.15:4891   , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Newezba9KBtr5PcBVDypYdAxRFdsMtVMUTMcPWLWPLziaJhyK): protocol: expected piece hash; context canceled; EOF
Dec  3 03:05:00.208763324 (879h51m26.909708209s) [noise=true , address=145.79.227.15:4891   , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec  3 03:05:00.208776869 (879h51m26.909721754s) [noise=true , address=77.90.31.19:4860     , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17ddUMj4ZejcjjWGzkGEM63vbCoEPnu7ePznzAPyzQofW8Q4gd): protocol: expected piece hash; context canceled; EOF
Dec  3 03:05:00.208784383 (879h51m26.909729268s) [noise=true , address=77.90.31.19:4860     , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec  3 03:05:00.208884902 (879h51m26.909829797s) [noise=true , address=77.90.31.14:4676     , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tpRh8Xvyxe72LDgR9rkUFx9qV88axb9DUYDhRnrzST2cQuHqC): protocol: expected piece hash; context canceled; EOF
Dec  3 03:05:00.208890072 (879h51m26.909834967s) [noise=true , address=77.90.31.14:4676     , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec  3 03:05:00.208952639 (879h51m26.909897524s) [noise=true , address=64.49.13.154:4932    , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UhZuvUKofduRzgCWi3WQcfZVuekxBJUXydn3H1ktQ7AmRRvcx): protocol: read tcp 5.161.89.252:62308->64.49.13.154:4932: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec  3 03:05:00.208961976 (879h51m26.909906891s) [noise=true , address=64.49.13.154:4932    , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec  3 03:05:00.208979329 (879h51m26.909924214s) [seg_pos={0 0}, upload=774178]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec  3 03:05:00.209054830 (879h51m26.909999705s) [upload=774178]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  3 03:05:00.209061283 (879h51m26.910006168s) [upload=774178]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  3 03:05:00.243054974 (879h51m26.943999869s) [upload=774178]: Done uploading segments...
Dec  3 03:05:00.243070513 (879h51m26.944015398s) [upload=774178]: Upload finished. err: <nil>
Duration: 346.340411ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=3) [.X.X........................................................]
duration:
540.127376ms
FAIL (2025-12-03 03:49:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 540.144218ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration:
432.850956ms
FAIL (2025-12-03 03:49:10 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
ZAEK5CH7A4CLFLSQZHE3FQLXGOUIAL6P2LJRNYQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.080302860 (879h51m26.781247775s) [noise=true , address=145.79.227.31:4812   , piece_id=6XBCHYA3OQJU5HLGA6MXPCKRU53ZS3T7NMQUQIDEPEADZICY2CDA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.080400042 (879h51m26.781344947s) [noise=true , address=77.90.31.13:4657     , piece_id=XOOB4JBYVH64ZTWXC4WL53VHYV5H6D5VJSYY2EQZMMYZLBDESLBQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.080935558 (879h51m26.781880473s) [noise=true , address=77.90.31.14:4676     , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.081500607 (879h51m26.782445523s) [noise=true , address=145.79.227.18:4025   , piece_id=7NACG5YCV33VISNW4JX6AHLMZHLI456NQY4EVO6YTQ32MHI46TTA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.082102287 (879h51m26.783047202s) [noise=true , address=45.91.116.5:4319     , piece_id=7V3JWIGKHHVQRHBQ5VZFSHQ6ACAKRXLKRA7QPXXLDG2QSHP5ET7Q, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.082736237 (879h51m26.783681152s) [noise=true , address=77.90.31.19:4860     , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.083237186 (879h51m26.784182102s) [noise=true , address=45.91.116.9:4288     , piece_id=5PXKYPZY7PN2TU6IXOPASYSV7YOOX7AMVRELMFN25T2XSHPX2C7Q, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.083737716 (879h51m26.784682621s) [noise=true , address=45.91.116.6:4997     , piece_id=XYO3QD6DOBNHMUYYUNO2VKRPL7OMCCIA4DNLOFOMGZDDZAQLYNDQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.084351898 (879h51m26.785296783s) [noise=true , address=45.91.116.14:4218    , piece_id=KDXUEVSB4UCJQQD4QLHOXD3RLKS2KW237S44S43K7AHHC3KV6DQQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.084701986 (879h51m26.78564687s) [noise=true , address=145.79.227.15:4891   , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.085026945 (879h51m26.78597183s) [noise=true , address=45.91.116.13:4165    , piece_id=H36AJQ6TM42ZWYJ5NQPSSIOC6XYWDCACCYIPPYBRAVYBZACCYIVA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.085353417 (879h51m26.786298303s) [noise=true , address=77.90.31.15:4705     , piece_id=3PAE3AI74Y2URW5FWQLHVWS3GHAZRNXS5QXVEPLYEWRIZPXVRWWQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.085650906 (879h51m26.786595801s) [noise=true , address=45.91.116.7:4039     , piece_id=HXDSSB5O467DEMIMCXZ4OWGIV5OKB4TTDZSXSD7PZYWMYDYORVPA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.085949286 (879h51m26.786894181s) [noise=true , address=77.90.31.11:4582     , piece_id=7NGIKVWARZJ32OLOHJNZ4L7XDV564CDJUWMWENT7XQM43BUHV4BA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.086195117 (879h51m26.787140012s) [noise=true , address=45.91.116.11:4148    , piece_id=QE6B7FVHLWTJ6XJFXAKIGWAIZATSHPOW4CA4E5UPJBSDJAJSPSJA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.086467669 (879h51m26.787412564s) [noise=true , address=64.49.13.154:4932    , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.164815383 (879h51m26.865760268s) [upload=774178]: Next returned nil segment
Dec  3 03:05:00.164840239 (879h51m26.865785125s) [upload=774178]: Waiting for error group managing segments...
Dec  3 03:05:00.174108452 (879h51m26.875053357s) [noise=true , address=77.90.31.15:4705     , piece_id=3PAE3AI74Y2URW5FWQLHVWS3GHAZRNXS5QXVEPLYEWRIZPXVRWWQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.174142326 (879h51m26.87508723s) [noise=true , address=45.91.116.13:4165    , piece_id=H36AJQ6TM42ZWYJ5NQPSSIOC6XYWDCACCYIPPYBRAVYBZACCYIVA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.175189781 (879h51m26.876134687s) [noise=true , address=77.90.31.12:4618     , piece_id=TUIE7COH6746VZAEK5CH7A4CLFLSQZHE3FQLXGOUIAL6P2LJRNYQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.178871150 (879h51m26.879816035s) [noise=true , address=145.79.227.18:4025   , piece_id=7NACG5YCV33VISNW4JX6AHLMZHLI456NQY4EVO6YTQ32MHI46TTA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.182466616 (879h51m26.883411501s) [noise=true , address=45.91.116.11:4148    , piece_id=QE6B7FVHLWTJ6XJFXAKIGWAIZATSHPOW4CA4E5UPJBSDJAJSPSJA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.184850901 (879h51m26.885795796s) [noise=true , address=45.91.116.14:4218    , piece_id=KDXUEVSB4UCJQQD4QLHOXD3RLKS2KW237S44S43K7AHHC3KV6DQQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.186313426 (879h51m26.887258321s) [noise=true , address=45.91.116.7:4039     , piece_id=HXDSSB5O467DEMIMCXZ4OWGIV5OKB4TTDZSXSD7PZYWMYDYORVPA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.187108287 (879h51m26.888053172s) [noise=true , address=45.91.116.6:4997     , piece_id=XYO3QD6DOBNHMUYYUNO2VKRPL7OMCCIA4DNLOFOMGZDDZAQLYNDQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.188257253 (879h51m26.889202148s) [noise=true , address=45.91.116.9:4288     , piece_id=5PXKYPZY7PN2TU6IXOPASYSV7YOOX7AMVRELMFN25T2XSHPX2C7Q, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.191179818 (879h51m26.892124703s) [noise=true , address=77.90.31.18:4837     , piece_id=XQGP57SUAR7DNHY6UYF6TPCPN7MM6WMUX4WMJJCCF5BBBEJYIQ7A, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.193701038 (879h51m26.894645933s) [noise=true , address=45.91.116.5:4319     , piece_id=7V3JWIGKHHVQRHBQ5VZFSHQ6ACAKRXLKRA7QPXXLDG2QSHP5ET7Q, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.194005079 (879h51m26.894949984s) [noise=true , address=145.79.227.31:4812   , piece_id=6XBCHYA3OQJU5HLGA6MXPCKRU53ZS3T7NMQUQIDEPEADZICY2CDA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.199219063 (879h51m26.900163958s) [noise=true , address=77.90.31.13:4657     , piece_id=XOOB4JBYVH64ZTWXC4WL53VHYV5H6D5VJSYY2EQZMMYZLBDESLBQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.208591191 (879h51m26.909536076s) [noise=true , address=77.90.31.11:4582     , piece_id=7NGIKVWARZJ32OLOHJNZ4L7XDV564CDJUWMWENT7XQM43BUHV4BA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.208619464 (879h51m26.909564349s) [seg_pos={0 0}, upload=774178]: Segment reached optimal threshold of 14 pieces.
Dec  3 03:05:00.208754597 (879h51m26.909699482s) [noise=true , address=145.79.227.15:4891   , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Newezba9KBtr5PcBVDypYdAxRFdsMtVMUTMcPWLWPLziaJhyK): protocol: expected piece hash; context canceled; EOF
Dec  3 03:05:00.208763324 (879h51m26.909708209s) [noise=true , address=145.79.227.15:4891   , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec  3 03:05:00.208776869 (879h51m26.909721754s) [noise=true , address=77.90.31.19:4860     , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17ddUMj4ZejcjjWGzkGEM63vbCoEPnu7ePznzAPyzQofW8Q4gd): protocol: expected piece hash; context canceled; EOF
Dec  3 03:05:00.208784383 (879h51m26.909729268s) [noise=true , address=77.90.31.19:4860     , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec  3 03:05:00.208884902 (879h51m26.909829797s) [noise=true , address=77.90.31.14:4676     , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tpRh8Xvyxe72LDgR9rkUFx9qV88axb9DUYDhRnrzST2cQuHqC): protocol: expected piece hash; context canceled; EOF
Dec  3 03:05:00.208890072 (879h51m26.909834967s) [noise=true , address=77.90.31.14:4676     , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec  3 03:05:00.208952639 (879h51m26.909897524s) [noise=true , address=64.49.13.154:4932    , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UhZuvUKofduRzgCWi3WQcfZVuekxBJUXydn3H1ktQ7AmRRvcx): protocol: read tcp 5.161.89.252:62308->64.49.13.154:4932: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec  3 03:05:00.208961976 (879h51m26.909906891s) [noise=true , address=64.49.13.154:4932    , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec  3 03:05:00.208979329 (879h51m26.909924214s) [seg_pos={0 0}, upload=774178]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec  3 03:05:00.209054830 (879h51m26.909999705s) [upload=774178]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  3 03:05:00.209061283 (879h51m26.910006168s) [upload=774178]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  3 03:05:00.243054974 (879h51m26.943999869s) [upload=774178]: Done uploading segments...
Dec  3 03:05:00.243070513 (879h51m26.944015398s) [upload=774178]: Upload finished. err: <nil>
Duration: 432.872145ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails)
antiblip:
2 out of 60 is failed (threshold=3) [..X.X.......................................................]
duration:
485.481803ms
FAIL (2025-12-03 03:48:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 485.498555ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................]
duration:
445.086511ms
FAIL (2025-12-03 03:48:30 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
ZAEK5CH7A4CLFLSQZHE3FQLXGOUIAL6P2LJRNYQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.080302860 (879h51m26.781247775s) [noise=true , address=145.79.227.31:4812   , piece_id=6XBCHYA3OQJU5HLGA6MXPCKRU53ZS3T7NMQUQIDEPEADZICY2CDA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.080400042 (879h51m26.781344947s) [noise=true , address=77.90.31.13:4657     , piece_id=XOOB4JBYVH64ZTWXC4WL53VHYV5H6D5VJSYY2EQZMMYZLBDESLBQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.080935558 (879h51m26.781880473s) [noise=true , address=77.90.31.14:4676     , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.081500607 (879h51m26.782445523s) [noise=true , address=145.79.227.18:4025   , piece_id=7NACG5YCV33VISNW4JX6AHLMZHLI456NQY4EVO6YTQ32MHI46TTA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.082102287 (879h51m26.783047202s) [noise=true , address=45.91.116.5:4319     , piece_id=7V3JWIGKHHVQRHBQ5VZFSHQ6ACAKRXLKRA7QPXXLDG2QSHP5ET7Q, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.082736237 (879h51m26.783681152s) [noise=true , address=77.90.31.19:4860     , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.083237186 (879h51m26.784182102s) [noise=true , address=45.91.116.9:4288     , piece_id=5PXKYPZY7PN2TU6IXOPASYSV7YOOX7AMVRELMFN25T2XSHPX2C7Q, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.083737716 (879h51m26.784682621s) [noise=true , address=45.91.116.6:4997     , piece_id=XYO3QD6DOBNHMUYYUNO2VKRPL7OMCCIA4DNLOFOMGZDDZAQLYNDQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.084351898 (879h51m26.785296783s) [noise=true , address=45.91.116.14:4218    , piece_id=KDXUEVSB4UCJQQD4QLHOXD3RLKS2KW237S44S43K7AHHC3KV6DQQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.084701986 (879h51m26.78564687s) [noise=true , address=145.79.227.15:4891   , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.085026945 (879h51m26.78597183s) [noise=true , address=45.91.116.13:4165    , piece_id=H36AJQ6TM42ZWYJ5NQPSSIOC6XYWDCACCYIPPYBRAVYBZACCYIVA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.085353417 (879h51m26.786298303s) [noise=true , address=77.90.31.15:4705     , piece_id=3PAE3AI74Y2URW5FWQLHVWS3GHAZRNXS5QXVEPLYEWRIZPXVRWWQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.085650906 (879h51m26.786595801s) [noise=true , address=45.91.116.7:4039     , piece_id=HXDSSB5O467DEMIMCXZ4OWGIV5OKB4TTDZSXSD7PZYWMYDYORVPA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.085949286 (879h51m26.786894181s) [noise=true , address=77.90.31.11:4582     , piece_id=7NGIKVWARZJ32OLOHJNZ4L7XDV564CDJUWMWENT7XQM43BUHV4BA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.086195117 (879h51m26.787140012s) [noise=true , address=45.91.116.11:4148    , piece_id=QE6B7FVHLWTJ6XJFXAKIGWAIZATSHPOW4CA4E5UPJBSDJAJSPSJA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.086467669 (879h51m26.787412564s) [noise=true , address=64.49.13.154:4932    , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.164815383 (879h51m26.865760268s) [upload=774178]: Next returned nil segment
Dec  3 03:05:00.164840239 (879h51m26.865785125s) [upload=774178]: Waiting for error group managing segments...
Dec  3 03:05:00.174108452 (879h51m26.875053357s) [noise=true , address=77.90.31.15:4705     , piece_id=3PAE3AI74Y2URW5FWQLHVWS3GHAZRNXS5QXVEPLYEWRIZPXVRWWQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.174142326 (879h51m26.87508723s) [noise=true , address=45.91.116.13:4165    , piece_id=H36AJQ6TM42ZWYJ5NQPSSIOC6XYWDCACCYIPPYBRAVYBZACCYIVA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.175189781 (879h51m26.876134687s) [noise=true , address=77.90.31.12:4618     , piece_id=TUIE7COH6746VZAEK5CH7A4CLFLSQZHE3FQLXGOUIAL6P2LJRNYQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.178871150 (879h51m26.879816035s) [noise=true , address=145.79.227.18:4025   , piece_id=7NACG5YCV33VISNW4JX6AHLMZHLI456NQY4EVO6YTQ32MHI46TTA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.182466616 (879h51m26.883411501s) [noise=true , address=45.91.116.11:4148    , piece_id=QE6B7FVHLWTJ6XJFXAKIGWAIZATSHPOW4CA4E5UPJBSDJAJSPSJA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.184850901 (879h51m26.885795796s) [noise=true , address=45.91.116.14:4218    , piece_id=KDXUEVSB4UCJQQD4QLHOXD3RLKS2KW237S44S43K7AHHC3KV6DQQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.186313426 (879h51m26.887258321s) [noise=true , address=45.91.116.7:4039     , piece_id=HXDSSB5O467DEMIMCXZ4OWGIV5OKB4TTDZSXSD7PZYWMYDYORVPA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.187108287 (879h51m26.888053172s) [noise=true , address=45.91.116.6:4997     , piece_id=XYO3QD6DOBNHMUYYUNO2VKRPL7OMCCIA4DNLOFOMGZDDZAQLYNDQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.188257253 (879h51m26.889202148s) [noise=true , address=45.91.116.9:4288     , piece_id=5PXKYPZY7PN2TU6IXOPASYSV7YOOX7AMVRELMFN25T2XSHPX2C7Q, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.191179818 (879h51m26.892124703s) [noise=true , address=77.90.31.18:4837     , piece_id=XQGP57SUAR7DNHY6UYF6TPCPN7MM6WMUX4WMJJCCF5BBBEJYIQ7A, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.193701038 (879h51m26.894645933s) [noise=true , address=45.91.116.5:4319     , piece_id=7V3JWIGKHHVQRHBQ5VZFSHQ6ACAKRXLKRA7QPXXLDG2QSHP5ET7Q, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.194005079 (879h51m26.894949984s) [noise=true , address=145.79.227.31:4812   , piece_id=6XBCHYA3OQJU5HLGA6MXPCKRU53ZS3T7NMQUQIDEPEADZICY2CDA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.199219063 (879h51m26.900163958s) [noise=true , address=77.90.31.13:4657     , piece_id=XOOB4JBYVH64ZTWXC4WL53VHYV5H6D5VJSYY2EQZMMYZLBDESLBQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.208591191 (879h51m26.909536076s) [noise=true , address=77.90.31.11:4582     , piece_id=7NGIKVWARZJ32OLOHJNZ4L7XDV564CDJUWMWENT7XQM43BUHV4BA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.208619464 (879h51m26.909564349s) [seg_pos={0 0}, upload=774178]: Segment reached optimal threshold of 14 pieces.
Dec  3 03:05:00.208754597 (879h51m26.909699482s) [noise=true , address=145.79.227.15:4891   , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Newezba9KBtr5PcBVDypYdAxRFdsMtVMUTMcPWLWPLziaJhyK): protocol: expected piece hash; context canceled; EOF
Dec  3 03:05:00.208763324 (879h51m26.909708209s) [noise=true , address=145.79.227.15:4891   , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec  3 03:05:00.208776869 (879h51m26.909721754s) [noise=true , address=77.90.31.19:4860     , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17ddUMj4ZejcjjWGzkGEM63vbCoEPnu7ePznzAPyzQofW8Q4gd): protocol: expected piece hash; context canceled; EOF
Dec  3 03:05:00.208784383 (879h51m26.909729268s) [noise=true , address=77.90.31.19:4860     , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec  3 03:05:00.208884902 (879h51m26.909829797s) [noise=true , address=77.90.31.14:4676     , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tpRh8Xvyxe72LDgR9rkUFx9qV88axb9DUYDhRnrzST2cQuHqC): protocol: expected piece hash; context canceled; EOF
Dec  3 03:05:00.208890072 (879h51m26.909834967s) [noise=true , address=77.90.31.14:4676     , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec  3 03:05:00.208952639 (879h51m26.909897524s) [noise=true , address=64.49.13.154:4932    , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UhZuvUKofduRzgCWi3WQcfZVuekxBJUXydn3H1ktQ7AmRRvcx): protocol: read tcp 5.161.89.252:62308->64.49.13.154:4932: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec  3 03:05:00.208961976 (879h51m26.909906891s) [noise=true , address=64.49.13.154:4932    , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec  3 03:05:00.208979329 (879h51m26.909924214s) [seg_pos={0 0}, upload=774178]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec  3 03:05:00.209054830 (879h51m26.909999705s) [upload=774178]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  3 03:05:00.209061283 (879h51m26.910006168s) [upload=774178]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  3 03:05:00.243054974 (879h51m26.943999869s) [upload=774178]: Done uploading segments...
Dec  3 03:05:00.243070513 (879h51m26.944015398s) [upload=774178]: Upload finished. err: <nil>
Duration: 445.109184ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration:
481.056291ms
FAIL (2025-12-03 03:48:00 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
ZAEK5CH7A4CLFLSQZHE3FQLXGOUIAL6P2LJRNYQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.080302860 (879h51m26.781247775s) [noise=true , address=145.79.227.31:4812   , piece_id=6XBCHYA3OQJU5HLGA6MXPCKRU53ZS3T7NMQUQIDEPEADZICY2CDA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.080400042 (879h51m26.781344947s) [noise=true , address=77.90.31.13:4657     , piece_id=XOOB4JBYVH64ZTWXC4WL53VHYV5H6D5VJSYY2EQZMMYZLBDESLBQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.080935558 (879h51m26.781880473s) [noise=true , address=77.90.31.14:4676     , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.081500607 (879h51m26.782445523s) [noise=true , address=145.79.227.18:4025   , piece_id=7NACG5YCV33VISNW4JX6AHLMZHLI456NQY4EVO6YTQ32MHI46TTA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.082102287 (879h51m26.783047202s) [noise=true , address=45.91.116.5:4319     , piece_id=7V3JWIGKHHVQRHBQ5VZFSHQ6ACAKRXLKRA7QPXXLDG2QSHP5ET7Q, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.082736237 (879h51m26.783681152s) [noise=true , address=77.90.31.19:4860     , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.083237186 (879h51m26.784182102s) [noise=true , address=45.91.116.9:4288     , piece_id=5PXKYPZY7PN2TU6IXOPASYSV7YOOX7AMVRELMFN25T2XSHPX2C7Q, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.083737716 (879h51m26.784682621s) [noise=true , address=45.91.116.6:4997     , piece_id=XYO3QD6DOBNHMUYYUNO2VKRPL7OMCCIA4DNLOFOMGZDDZAQLYNDQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.084351898 (879h51m26.785296783s) [noise=true , address=45.91.116.14:4218    , piece_id=KDXUEVSB4UCJQQD4QLHOXD3RLKS2KW237S44S43K7AHHC3KV6DQQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.084701986 (879h51m26.78564687s) [noise=true , address=145.79.227.15:4891   , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.085026945 (879h51m26.78597183s) [noise=true , address=45.91.116.13:4165    , piece_id=H36AJQ6TM42ZWYJ5NQPSSIOC6XYWDCACCYIPPYBRAVYBZACCYIVA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.085353417 (879h51m26.786298303s) [noise=true , address=77.90.31.15:4705     , piece_id=3PAE3AI74Y2URW5FWQLHVWS3GHAZRNXS5QXVEPLYEWRIZPXVRWWQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.085650906 (879h51m26.786595801s) [noise=true , address=45.91.116.7:4039     , piece_id=HXDSSB5O467DEMIMCXZ4OWGIV5OKB4TTDZSXSD7PZYWMYDYORVPA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.085949286 (879h51m26.786894181s) [noise=true , address=77.90.31.11:4582     , piece_id=7NGIKVWARZJ32OLOHJNZ4L7XDV564CDJUWMWENT7XQM43BUHV4BA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.086195117 (879h51m26.787140012s) [noise=true , address=45.91.116.11:4148    , piece_id=QE6B7FVHLWTJ6XJFXAKIGWAIZATSHPOW4CA4E5UPJBSDJAJSPSJA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.086467669 (879h51m26.787412564s) [noise=true , address=64.49.13.154:4932    , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec  3 03:05:00.164815383 (879h51m26.865760268s) [upload=774178]: Next returned nil segment
Dec  3 03:05:00.164840239 (879h51m26.865785125s) [upload=774178]: Waiting for error group managing segments...
Dec  3 03:05:00.174108452 (879h51m26.875053357s) [noise=true , address=77.90.31.15:4705     , piece_id=3PAE3AI74Y2URW5FWQLHVWS3GHAZRNXS5QXVEPLYEWRIZPXVRWWQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.174142326 (879h51m26.87508723s) [noise=true , address=45.91.116.13:4165    , piece_id=H36AJQ6TM42ZWYJ5NQPSSIOC6XYWDCACCYIPPYBRAVYBZACCYIVA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.175189781 (879h51m26.876134687s) [noise=true , address=77.90.31.12:4618     , piece_id=TUIE7COH6746VZAEK5CH7A4CLFLSQZHE3FQLXGOUIAL6P2LJRNYQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.178871150 (879h51m26.879816035s) [noise=true , address=145.79.227.18:4025   , piece_id=7NACG5YCV33VISNW4JX6AHLMZHLI456NQY4EVO6YTQ32MHI46TTA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.182466616 (879h51m26.883411501s) [noise=true , address=45.91.116.11:4148    , piece_id=QE6B7FVHLWTJ6XJFXAKIGWAIZATSHPOW4CA4E5UPJBSDJAJSPSJA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.184850901 (879h51m26.885795796s) [noise=true , address=45.91.116.14:4218    , piece_id=KDXUEVSB4UCJQQD4QLHOXD3RLKS2KW237S44S43K7AHHC3KV6DQQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.186313426 (879h51m26.887258321s) [noise=true , address=45.91.116.7:4039     , piece_id=HXDSSB5O467DEMIMCXZ4OWGIV5OKB4TTDZSXSD7PZYWMYDYORVPA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.187108287 (879h51m26.888053172s) [noise=true , address=45.91.116.6:4997     , piece_id=XYO3QD6DOBNHMUYYUNO2VKRPL7OMCCIA4DNLOFOMGZDDZAQLYNDQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.188257253 (879h51m26.889202148s) [noise=true , address=45.91.116.9:4288     , piece_id=5PXKYPZY7PN2TU6IXOPASYSV7YOOX7AMVRELMFN25T2XSHPX2C7Q, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.191179818 (879h51m26.892124703s) [noise=true , address=77.90.31.18:4837     , piece_id=XQGP57SUAR7DNHY6UYF6TPCPN7MM6WMUX4WMJJCCF5BBBEJYIQ7A, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.193701038 (879h51m26.894645933s) [noise=true , address=45.91.116.5:4319     , piece_id=7V3JWIGKHHVQRHBQ5VZFSHQ6ACAKRXLKRA7QPXXLDG2QSHP5ET7Q, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.194005079 (879h51m26.894949984s) [noise=true , address=145.79.227.31:4812   , piece_id=6XBCHYA3OQJU5HLGA6MXPCKRU53ZS3T7NMQUQIDEPEADZICY2CDA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.199219063 (879h51m26.900163958s) [noise=true , address=77.90.31.13:4657     , piece_id=XOOB4JBYVH64ZTWXC4WL53VHYV5H6D5VJSYY2EQZMMYZLBDESLBQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.208591191 (879h51m26.909536076s) [noise=true , address=77.90.31.11:4582     , piece_id=7NGIKVWARZJ32OLOHJNZ4L7XDV564CDJUWMWENT7XQM43BUHV4BA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec  3 03:05:00.208619464 (879h51m26.909564349s) [seg_pos={0 0}, upload=774178]: Segment reached optimal threshold of 14 pieces.
Dec  3 03:05:00.208754597 (879h51m26.909699482s) [noise=true , address=145.79.227.15:4891   , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Newezba9KBtr5PcBVDypYdAxRFdsMtVMUTMcPWLWPLziaJhyK): protocol: expected piece hash; context canceled; EOF
Dec  3 03:05:00.208763324 (879h51m26.909708209s) [noise=true , address=145.79.227.15:4891   , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec  3 03:05:00.208776869 (879h51m26.909721754s) [noise=true , address=77.90.31.19:4860     , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17ddUMj4ZejcjjWGzkGEM63vbCoEPnu7ePznzAPyzQofW8Q4gd): protocol: expected piece hash; context canceled; EOF
Dec  3 03:05:00.208784383 (879h51m26.909729268s) [noise=true , address=77.90.31.19:4860     , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec  3 03:05:00.208884902 (879h51m26.909829797s) [noise=true , address=77.90.31.14:4676     , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tpRh8Xvyxe72LDgR9rkUFx9qV88axb9DUYDhRnrzST2cQuHqC): protocol: expected piece hash; context canceled; EOF
Dec  3 03:05:00.208890072 (879h51m26.909834967s) [noise=true , address=77.90.31.14:4676     , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec  3 03:05:00.208952639 (879h51m26.909897524s) [noise=true , address=64.49.13.154:4932    , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UhZuvUKofduRzgCWi3WQcfZVuekxBJUXydn3H1ktQ7AmRRvcx): protocol: read tcp 5.161.89.252:62308->64.49.13.154:4932: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec  3 03:05:00.208961976 (879h51m26.909906891s) [noise=true , address=64.49.13.154:4932    , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec  3 03:05:00.208979329 (879h51m26.909924214s) [seg_pos={0 0}, upload=774178]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec  3 03:05:00.209054830 (879h51m26.909999705s) [upload=774178]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec  3 03:05:00.209061283 (879h51m26.910006168s) [upload=774178]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec  3 03:05:00.243054974 (879h51m26.943999869s) [upload=774178]: Done uploading segments...
Dec  3 03:05:00.243070513 (879h51m26.944015398s) [upload=774178]: Upload finished. err: <nil>
Duration: 481.080567ms core uplink us-select-1 us1-placement-20