Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
411.333271ms
FAIL (2025-10-07 08:23:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 411.357095ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
419.573867ms
FAIL (2025-10-07 08:23:28 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 419.606257ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
389.269938ms
FAIL (2025-10-07 08:22:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 389.289614ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
502.34092ms
FAIL (2025-10-07 08:22:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 502.357502ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
401.61817ms
FAIL (2025-10-07 08:21:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 401.642185ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
382.377189ms
FAIL (2025-10-07 08:21:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 382.386937ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
753.538371ms
FAIL (2025-10-07 08:20:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 753.61749ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
364.17036ms
FAIL (2025-10-07 08:19:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 364.188926ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
405.545299ms
FAIL (2025-10-07 08:19:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 405.561909ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
366.258853ms
FAIL (2025-10-07 08:18:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 366.277136ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
387.729726ms
FAIL (2025-10-07 08:17:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 387.920534ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
738.809871ms
FAIL (2025-10-07 08:17:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 738.885372ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
402.192387ms
FAIL (2025-10-07 08:16:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 402.212466ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
379.058963ms
FAIL (2025-10-07 08:15:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 379.077087ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
385.549761ms
FAIL (2025-10-07 08:14:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 385.571752ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
15.482693303s
FAIL (2025-10-07 08:13:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 15.482710826s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001456913s
FAIL (2025-10-07 08:13:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001478254s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
468.09935ms
FAIL (2025-10-07 00:05:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
27420042 (921h10m47.58020515s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227624987 (921h10m47.580410085s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227650294 (921h10m47.580435392s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227876188 (921h10m47.580661287s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227943646 (921h10m47.580728743s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228144602 (921h10m47.58092971s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228179508 (921h10m47.580964616s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228374473 (921h10m47.581159581s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228432042 (921h10m47.581217139s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228581452 (921h10m47.58136656s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228676600 (921h10m47.581461698s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228792097 (921h10m47.581577206s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228974810 (921h10m47.581759918s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228999326 (921h10m47.581784434s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229204211 (921h10m47.581989319s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229215272 (921h10m47.58200038s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.299081179 (921h10m47.651866277s) [upload=810691]: Next returned nil segment
Oct 6 23:19:12.299097009 (921h10m47.651882117s) [upload=810691]: Waiting for error group managing segments...
Oct 6 23:19:12.306034258 (921h10m47.658819356s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.307622568 (921h10m47.660407677s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.308054209 (921h10m47.660839317s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.316367240 (921h10m47.669152338s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.353623418 (921h10m47.706408517s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.798268805 (921h10m48.151053913s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.819297331 (921h10m48.172082429s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:06.839967999 (921h11m42.192753127s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:08.034348426 (921h11m43.387133564s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:12.173936997 (921h11m47.526722105s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:126w8AaZrrF8Y4uMP5yrGGadnMCCEiuP1s2CKg4XwkA7kPMvvS5, address:45.91.116.10:4103): protocol: rpc: dial tcp 45.91.116.10:4103: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174003862 (921h11m47.52678897s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA, address:77.90.31.18:4831): protocol: rpc: dial tcp 77.90.31.18:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174067181 (921h11m47.526852289s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12H6EaBk5vQxDeccjDtyoJmuANkspKuRPCyS7qHuDn16GQPa8o6, address:77.90.31.11:4588): protocol: rpc: dial tcp 77.90.31.11:4588: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174147411 (921h11m47.526932519s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1vQJmv9n2yWXZtCCaABrxkB3NN6vDwLdiBkRibDN3t6YNmcmGP, address:45.91.116.6:4001): protocol: rpc: dial tcp 45.91.116.6:4001: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174295850 (921h11m47.527080958s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12d12pAMGhxjtLBE1tp9yEE7NMdfh8kcvsA8abhTnM8nbBB5LEK, address:45.91.116.14:4206): protocol: rpc: dial tcp 45.91.116.14:4206: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174441473 (921h11m47.527226581s) [noise=true , address=77.90.31.14:4669 , piece_id=YZUXVZYTK76CPUTVGTN6V63SIHTIHIAKPCSXLCROPELODS4TXNOA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12wgv8uy7FaviWBw3H8ZS2NfJNnZ5F5PYyxxJrYaJsfGVv55Q8T, address:77.90.31.14:4669): protocol: read tcp 5.161.89.252:59908->77.90.31.14:4669: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174480827 (921h11m47.527265935s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW, address:45.91.116.7:4016): protocol: read tcp 5.161.89.252:21556->45.91.116.7:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174537793 (921h11m47.527322901s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1KER2FucoaWotduZNiFAnbFz7gotJYFofKnyQNCRvWQ8rjVDwY, address:77.90.31.11:4559): protocol: read tcp 5.161.89.252:27818->77.90.31.11:4559: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174593429 (921h11m47.527378537s) [noise=true , address=77.90.31.16:4755 , piece_id=XVJRVIFXDLQF2PKNLAOS2YWWNC52CCJCBLRYN7WAMR3DHZAEDCMQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV, address:77.90.31.16:4755): protocol: read tcp 5.161.89.252:25238->77.90.31.16:4755: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174612024 (921h11m47.527397132s) [seg_pos={0 0}, upload=810691]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Oct 6 23:20:12.191155500 (921h11m47.543940619s) [upload=810691]: Done uploading segments...
Oct 6 23:20:12.191171450 (921h11m47.543956569s) [upload=810691]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 468.128154ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
488.639879ms
FAIL (2025-10-07 00:04:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
27420042 (921h10m47.58020515s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227624987 (921h10m47.580410085s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227650294 (921h10m47.580435392s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227876188 (921h10m47.580661287s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227943646 (921h10m47.580728743s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228144602 (921h10m47.58092971s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228179508 (921h10m47.580964616s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228374473 (921h10m47.581159581s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228432042 (921h10m47.581217139s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228581452 (921h10m47.58136656s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228676600 (921h10m47.581461698s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228792097 (921h10m47.581577206s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228974810 (921h10m47.581759918s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228999326 (921h10m47.581784434s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229204211 (921h10m47.581989319s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229215272 (921h10m47.58200038s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.299081179 (921h10m47.651866277s) [upload=810691]: Next returned nil segment
Oct 6 23:19:12.299097009 (921h10m47.651882117s) [upload=810691]: Waiting for error group managing segments...
Oct 6 23:19:12.306034258 (921h10m47.658819356s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.307622568 (921h10m47.660407677s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.308054209 (921h10m47.660839317s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.316367240 (921h10m47.669152338s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.353623418 (921h10m47.706408517s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.798268805 (921h10m48.151053913s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.819297331 (921h10m48.172082429s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:06.839967999 (921h11m42.192753127s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:08.034348426 (921h11m43.387133564s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:12.173936997 (921h11m47.526722105s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:126w8AaZrrF8Y4uMP5yrGGadnMCCEiuP1s2CKg4XwkA7kPMvvS5, address:45.91.116.10:4103): protocol: rpc: dial tcp 45.91.116.10:4103: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174003862 (921h11m47.52678897s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA, address:77.90.31.18:4831): protocol: rpc: dial tcp 77.90.31.18:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174067181 (921h11m47.526852289s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12H6EaBk5vQxDeccjDtyoJmuANkspKuRPCyS7qHuDn16GQPa8o6, address:77.90.31.11:4588): protocol: rpc: dial tcp 77.90.31.11:4588: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174147411 (921h11m47.526932519s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1vQJmv9n2yWXZtCCaABrxkB3NN6vDwLdiBkRibDN3t6YNmcmGP, address:45.91.116.6:4001): protocol: rpc: dial tcp 45.91.116.6:4001: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174295850 (921h11m47.527080958s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12d12pAMGhxjtLBE1tp9yEE7NMdfh8kcvsA8abhTnM8nbBB5LEK, address:45.91.116.14:4206): protocol: rpc: dial tcp 45.91.116.14:4206: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174441473 (921h11m47.527226581s) [noise=true , address=77.90.31.14:4669 , piece_id=YZUXVZYTK76CPUTVGTN6V63SIHTIHIAKPCSXLCROPELODS4TXNOA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12wgv8uy7FaviWBw3H8ZS2NfJNnZ5F5PYyxxJrYaJsfGVv55Q8T, address:77.90.31.14:4669): protocol: read tcp 5.161.89.252:59908->77.90.31.14:4669: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174480827 (921h11m47.527265935s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW, address:45.91.116.7:4016): protocol: read tcp 5.161.89.252:21556->45.91.116.7:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174537793 (921h11m47.527322901s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1KER2FucoaWotduZNiFAnbFz7gotJYFofKnyQNCRvWQ8rjVDwY, address:77.90.31.11:4559): protocol: read tcp 5.161.89.252:27818->77.90.31.11:4559: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174593429 (921h11m47.527378537s) [noise=true , address=77.90.31.16:4755 , piece_id=XVJRVIFXDLQF2PKNLAOS2YWWNC52CCJCBLRYN7WAMR3DHZAEDCMQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV, address:77.90.31.16:4755): protocol: read tcp 5.161.89.252:25238->77.90.31.16:4755: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174612024 (921h11m47.527397132s) [seg_pos={0 0}, upload=810691]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Oct 6 23:20:12.191155500 (921h11m47.543940619s) [upload=810691]: Done uploading segments...
Oct 6 23:20:12.191171450 (921h11m47.543956569s) [upload=810691]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 488.672881ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
397.437262ms
FAIL (2025-10-07 00:03:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
27420042 (921h10m47.58020515s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227624987 (921h10m47.580410085s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227650294 (921h10m47.580435392s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227876188 (921h10m47.580661287s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227943646 (921h10m47.580728743s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228144602 (921h10m47.58092971s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228179508 (921h10m47.580964616s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228374473 (921h10m47.581159581s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228432042 (921h10m47.581217139s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228581452 (921h10m47.58136656s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228676600 (921h10m47.581461698s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228792097 (921h10m47.581577206s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228974810 (921h10m47.581759918s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228999326 (921h10m47.581784434s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229204211 (921h10m47.581989319s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229215272 (921h10m47.58200038s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.299081179 (921h10m47.651866277s) [upload=810691]: Next returned nil segment
Oct 6 23:19:12.299097009 (921h10m47.651882117s) [upload=810691]: Waiting for error group managing segments...
Oct 6 23:19:12.306034258 (921h10m47.658819356s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.307622568 (921h10m47.660407677s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.308054209 (921h10m47.660839317s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.316367240 (921h10m47.669152338s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.353623418 (921h10m47.706408517s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.798268805 (921h10m48.151053913s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.819297331 (921h10m48.172082429s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:06.839967999 (921h11m42.192753127s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:08.034348426 (921h11m43.387133564s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:12.173936997 (921h11m47.526722105s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:126w8AaZrrF8Y4uMP5yrGGadnMCCEiuP1s2CKg4XwkA7kPMvvS5, address:45.91.116.10:4103): protocol: rpc: dial tcp 45.91.116.10:4103: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174003862 (921h11m47.52678897s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA, address:77.90.31.18:4831): protocol: rpc: dial tcp 77.90.31.18:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174067181 (921h11m47.526852289s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12H6EaBk5vQxDeccjDtyoJmuANkspKuRPCyS7qHuDn16GQPa8o6, address:77.90.31.11:4588): protocol: rpc: dial tcp 77.90.31.11:4588: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174147411 (921h11m47.526932519s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1vQJmv9n2yWXZtCCaABrxkB3NN6vDwLdiBkRibDN3t6YNmcmGP, address:45.91.116.6:4001): protocol: rpc: dial tcp 45.91.116.6:4001: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174295850 (921h11m47.527080958s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12d12pAMGhxjtLBE1tp9yEE7NMdfh8kcvsA8abhTnM8nbBB5LEK, address:45.91.116.14:4206): protocol: rpc: dial tcp 45.91.116.14:4206: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174441473 (921h11m47.527226581s) [noise=true , address=77.90.31.14:4669 , piece_id=YZUXVZYTK76CPUTVGTN6V63SIHTIHIAKPCSXLCROPELODS4TXNOA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12wgv8uy7FaviWBw3H8ZS2NfJNnZ5F5PYyxxJrYaJsfGVv55Q8T, address:77.90.31.14:4669): protocol: read tcp 5.161.89.252:59908->77.90.31.14:4669: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174480827 (921h11m47.527265935s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW, address:45.91.116.7:4016): protocol: read tcp 5.161.89.252:21556->45.91.116.7:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174537793 (921h11m47.527322901s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1KER2FucoaWotduZNiFAnbFz7gotJYFofKnyQNCRvWQ8rjVDwY, address:77.90.31.11:4559): protocol: read tcp 5.161.89.252:27818->77.90.31.11:4559: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174593429 (921h11m47.527378537s) [noise=true , address=77.90.31.16:4755 , piece_id=XVJRVIFXDLQF2PKNLAOS2YWWNC52CCJCBLRYN7WAMR3DHZAEDCMQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV, address:77.90.31.16:4755): protocol: read tcp 5.161.89.252:25238->77.90.31.16:4755: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174612024 (921h11m47.527397132s) [seg_pos={0 0}, upload=810691]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Oct 6 23:20:12.191155500 (921h11m47.543940619s) [upload=810691]: Done uploading segments...
Oct 6 23:20:12.191171450 (921h11m47.543956569s) [upload=810691]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 397.461689ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
440.971612ms
FAIL (2025-10-07 00:03:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
27420042 (921h10m47.58020515s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227624987 (921h10m47.580410085s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227650294 (921h10m47.580435392s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227876188 (921h10m47.580661287s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227943646 (921h10m47.580728743s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228144602 (921h10m47.58092971s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228179508 (921h10m47.580964616s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228374473 (921h10m47.581159581s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228432042 (921h10m47.581217139s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228581452 (921h10m47.58136656s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228676600 (921h10m47.581461698s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228792097 (921h10m47.581577206s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228974810 (921h10m47.581759918s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228999326 (921h10m47.581784434s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229204211 (921h10m47.581989319s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229215272 (921h10m47.58200038s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.299081179 (921h10m47.651866277s) [upload=810691]: Next returned nil segment
Oct 6 23:19:12.299097009 (921h10m47.651882117s) [upload=810691]: Waiting for error group managing segments...
Oct 6 23:19:12.306034258 (921h10m47.658819356s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.307622568 (921h10m47.660407677s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.308054209 (921h10m47.660839317s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.316367240 (921h10m47.669152338s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.353623418 (921h10m47.706408517s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.798268805 (921h10m48.151053913s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.819297331 (921h10m48.172082429s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:06.839967999 (921h11m42.192753127s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:08.034348426 (921h11m43.387133564s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:12.173936997 (921h11m47.526722105s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:126w8AaZrrF8Y4uMP5yrGGadnMCCEiuP1s2CKg4XwkA7kPMvvS5, address:45.91.116.10:4103): protocol: rpc: dial tcp 45.91.116.10:4103: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174003862 (921h11m47.52678897s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA, address:77.90.31.18:4831): protocol: rpc: dial tcp 77.90.31.18:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174067181 (921h11m47.526852289s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12H6EaBk5vQxDeccjDtyoJmuANkspKuRPCyS7qHuDn16GQPa8o6, address:77.90.31.11:4588): protocol: rpc: dial tcp 77.90.31.11:4588: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174147411 (921h11m47.526932519s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1vQJmv9n2yWXZtCCaABrxkB3NN6vDwLdiBkRibDN3t6YNmcmGP, address:45.91.116.6:4001): protocol: rpc: dial tcp 45.91.116.6:4001: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174295850 (921h11m47.527080958s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12d12pAMGhxjtLBE1tp9yEE7NMdfh8kcvsA8abhTnM8nbBB5LEK, address:45.91.116.14:4206): protocol: rpc: dial tcp 45.91.116.14:4206: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174441473 (921h11m47.527226581s) [noise=true , address=77.90.31.14:4669 , piece_id=YZUXVZYTK76CPUTVGTN6V63SIHTIHIAKPCSXLCROPELODS4TXNOA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12wgv8uy7FaviWBw3H8ZS2NfJNnZ5F5PYyxxJrYaJsfGVv55Q8T, address:77.90.31.14:4669): protocol: read tcp 5.161.89.252:59908->77.90.31.14:4669: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174480827 (921h11m47.527265935s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW, address:45.91.116.7:4016): protocol: read tcp 5.161.89.252:21556->45.91.116.7:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174537793 (921h11m47.527322901s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1KER2FucoaWotduZNiFAnbFz7gotJYFofKnyQNCRvWQ8rjVDwY, address:77.90.31.11:4559): protocol: read tcp 5.161.89.252:27818->77.90.31.11:4559: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174593429 (921h11m47.527378537s) [noise=true , address=77.90.31.16:4755 , piece_id=XVJRVIFXDLQF2PKNLAOS2YWWNC52CCJCBLRYN7WAMR3DHZAEDCMQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV, address:77.90.31.16:4755): protocol: read tcp 5.161.89.252:25238->77.90.31.16:4755: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174612024 (921h11m47.527397132s) [seg_pos={0 0}, upload=810691]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Oct 6 23:20:12.191155500 (921h11m47.543940619s) [upload=810691]: Done uploading segments...
Oct 6 23:20:12.191171450 (921h11m47.543956569s) [upload=810691]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 440.993633ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
660.285407ms
FAIL (2025-10-07 00:02:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 660.30761ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
676.666449ms
FAIL (2025-10-07 00:02:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 676.682408ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
677.000217ms
FAIL (2025-10-07 00:02:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
27420042 (921h10m47.58020515s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227624987 (921h10m47.580410085s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227650294 (921h10m47.580435392s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227876188 (921h10m47.580661287s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227943646 (921h10m47.580728743s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228144602 (921h10m47.58092971s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228179508 (921h10m47.580964616s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228374473 (921h10m47.581159581s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228432042 (921h10m47.581217139s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228581452 (921h10m47.58136656s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228676600 (921h10m47.581461698s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228792097 (921h10m47.581577206s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228974810 (921h10m47.581759918s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228999326 (921h10m47.581784434s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229204211 (921h10m47.581989319s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229215272 (921h10m47.58200038s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.299081179 (921h10m47.651866277s) [upload=810691]: Next returned nil segment
Oct 6 23:19:12.299097009 (921h10m47.651882117s) [upload=810691]: Waiting for error group managing segments...
Oct 6 23:19:12.306034258 (921h10m47.658819356s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.307622568 (921h10m47.660407677s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.308054209 (921h10m47.660839317s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.316367240 (921h10m47.669152338s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.353623418 (921h10m47.706408517s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.798268805 (921h10m48.151053913s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.819297331 (921h10m48.172082429s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:06.839967999 (921h11m42.192753127s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:08.034348426 (921h11m43.387133564s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:12.173936997 (921h11m47.526722105s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:126w8AaZrrF8Y4uMP5yrGGadnMCCEiuP1s2CKg4XwkA7kPMvvS5, address:45.91.116.10:4103): protocol: rpc: dial tcp 45.91.116.10:4103: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174003862 (921h11m47.52678897s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA, address:77.90.31.18:4831): protocol: rpc: dial tcp 77.90.31.18:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174067181 (921h11m47.526852289s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12H6EaBk5vQxDeccjDtyoJmuANkspKuRPCyS7qHuDn16GQPa8o6, address:77.90.31.11:4588): protocol: rpc: dial tcp 77.90.31.11:4588: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174147411 (921h11m47.526932519s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1vQJmv9n2yWXZtCCaABrxkB3NN6vDwLdiBkRibDN3t6YNmcmGP, address:45.91.116.6:4001): protocol: rpc: dial tcp 45.91.116.6:4001: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174295850 (921h11m47.527080958s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12d12pAMGhxjtLBE1tp9yEE7NMdfh8kcvsA8abhTnM8nbBB5LEK, address:45.91.116.14:4206): protocol: rpc: dial tcp 45.91.116.14:4206: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174441473 (921h11m47.527226581s) [noise=true , address=77.90.31.14:4669 , piece_id=YZUXVZYTK76CPUTVGTN6V63SIHTIHIAKPCSXLCROPELODS4TXNOA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12wgv8uy7FaviWBw3H8ZS2NfJNnZ5F5PYyxxJrYaJsfGVv55Q8T, address:77.90.31.14:4669): protocol: read tcp 5.161.89.252:59908->77.90.31.14:4669: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174480827 (921h11m47.527265935s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW, address:45.91.116.7:4016): protocol: read tcp 5.161.89.252:21556->45.91.116.7:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174537793 (921h11m47.527322901s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1KER2FucoaWotduZNiFAnbFz7gotJYFofKnyQNCRvWQ8rjVDwY, address:77.90.31.11:4559): protocol: read tcp 5.161.89.252:27818->77.90.31.11:4559: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174593429 (921h11m47.527378537s) [noise=true , address=77.90.31.16:4755 , piece_id=XVJRVIFXDLQF2PKNLAOS2YWWNC52CCJCBLRYN7WAMR3DHZAEDCMQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV, address:77.90.31.16:4755): protocol: read tcp 5.161.89.252:25238->77.90.31.16:4755: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174612024 (921h11m47.527397132s) [seg_pos={0 0}, upload=810691]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Oct 6 23:20:12.191155500 (921h11m47.543940619s) [upload=810691]: Done uploading segments...
Oct 6 23:20:12.191171450 (921h11m47.543956569s) [upload=810691]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 677.026567ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
454.604076ms
FAIL (2025-10-07 00:01:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
27420042 (921h10m47.58020515s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227624987 (921h10m47.580410085s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227650294 (921h10m47.580435392s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227876188 (921h10m47.580661287s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227943646 (921h10m47.580728743s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228144602 (921h10m47.58092971s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228179508 (921h10m47.580964616s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228374473 (921h10m47.581159581s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228432042 (921h10m47.581217139s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228581452 (921h10m47.58136656s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228676600 (921h10m47.581461698s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228792097 (921h10m47.581577206s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228974810 (921h10m47.581759918s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228999326 (921h10m47.581784434s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229204211 (921h10m47.581989319s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229215272 (921h10m47.58200038s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.299081179 (921h10m47.651866277s) [upload=810691]: Next returned nil segment
Oct 6 23:19:12.299097009 (921h10m47.651882117s) [upload=810691]: Waiting for error group managing segments...
Oct 6 23:19:12.306034258 (921h10m47.658819356s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.307622568 (921h10m47.660407677s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.308054209 (921h10m47.660839317s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.316367240 (921h10m47.669152338s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.353623418 (921h10m47.706408517s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.798268805 (921h10m48.151053913s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.819297331 (921h10m48.172082429s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:06.839967999 (921h11m42.192753127s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:08.034348426 (921h11m43.387133564s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:12.173936997 (921h11m47.526722105s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:126w8AaZrrF8Y4uMP5yrGGadnMCCEiuP1s2CKg4XwkA7kPMvvS5, address:45.91.116.10:4103): protocol: rpc: dial tcp 45.91.116.10:4103: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174003862 (921h11m47.52678897s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA, address:77.90.31.18:4831): protocol: rpc: dial tcp 77.90.31.18:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174067181 (921h11m47.526852289s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12H6EaBk5vQxDeccjDtyoJmuANkspKuRPCyS7qHuDn16GQPa8o6, address:77.90.31.11:4588): protocol: rpc: dial tcp 77.90.31.11:4588: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174147411 (921h11m47.526932519s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1vQJmv9n2yWXZtCCaABrxkB3NN6vDwLdiBkRibDN3t6YNmcmGP, address:45.91.116.6:4001): protocol: rpc: dial tcp 45.91.116.6:4001: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174295850 (921h11m47.527080958s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12d12pAMGhxjtLBE1tp9yEE7NMdfh8kcvsA8abhTnM8nbBB5LEK, address:45.91.116.14:4206): protocol: rpc: dial tcp 45.91.116.14:4206: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174441473 (921h11m47.527226581s) [noise=true , address=77.90.31.14:4669 , piece_id=YZUXVZYTK76CPUTVGTN6V63SIHTIHIAKPCSXLCROPELODS4TXNOA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12wgv8uy7FaviWBw3H8ZS2NfJNnZ5F5PYyxxJrYaJsfGVv55Q8T, address:77.90.31.14:4669): protocol: read tcp 5.161.89.252:59908->77.90.31.14:4669: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174480827 (921h11m47.527265935s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW, address:45.91.116.7:4016): protocol: read tcp 5.161.89.252:21556->45.91.116.7:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174537793 (921h11m47.527322901s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1KER2FucoaWotduZNiFAnbFz7gotJYFofKnyQNCRvWQ8rjVDwY, address:77.90.31.11:4559): protocol: read tcp 5.161.89.252:27818->77.90.31.11:4559: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174593429 (921h11m47.527378537s) [noise=true , address=77.90.31.16:4755 , piece_id=XVJRVIFXDLQF2PKNLAOS2YWWNC52CCJCBLRYN7WAMR3DHZAEDCMQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV, address:77.90.31.16:4755): protocol: read tcp 5.161.89.252:25238->77.90.31.16:4755: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174612024 (921h11m47.527397132s) [seg_pos={0 0}, upload=810691]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Oct 6 23:20:12.191155500 (921h11m47.543940619s) [upload=810691]: Done uploading segments...
Oct 6 23:20:12.191171450 (921h11m47.543956569s) [upload=810691]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 454.625557ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
645.777533ms
FAIL (2025-10-07 00:01:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 645.797792ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
402.640208ms
FAIL (2025-10-07 00:01:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 402.672518ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
408.385238ms
FAIL (2025-10-07 00:00:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
27420042 (921h10m47.58020515s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227624987 (921h10m47.580410085s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227650294 (921h10m47.580435392s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227876188 (921h10m47.580661287s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227943646 (921h10m47.580728743s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228144602 (921h10m47.58092971s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228179508 (921h10m47.580964616s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228374473 (921h10m47.581159581s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228432042 (921h10m47.581217139s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228581452 (921h10m47.58136656s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228676600 (921h10m47.581461698s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228792097 (921h10m47.581577206s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228974810 (921h10m47.581759918s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228999326 (921h10m47.581784434s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229204211 (921h10m47.581989319s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229215272 (921h10m47.58200038s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.299081179 (921h10m47.651866277s) [upload=810691]: Next returned nil segment
Oct 6 23:19:12.299097009 (921h10m47.651882117s) [upload=810691]: Waiting for error group managing segments...
Oct 6 23:19:12.306034258 (921h10m47.658819356s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.307622568 (921h10m47.660407677s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.308054209 (921h10m47.660839317s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.316367240 (921h10m47.669152338s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.353623418 (921h10m47.706408517s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.798268805 (921h10m48.151053913s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.819297331 (921h10m48.172082429s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:06.839967999 (921h11m42.192753127s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:08.034348426 (921h11m43.387133564s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:12.173936997 (921h11m47.526722105s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:126w8AaZrrF8Y4uMP5yrGGadnMCCEiuP1s2CKg4XwkA7kPMvvS5, address:45.91.116.10:4103): protocol: rpc: dial tcp 45.91.116.10:4103: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174003862 (921h11m47.52678897s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA, address:77.90.31.18:4831): protocol: rpc: dial tcp 77.90.31.18:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174067181 (921h11m47.526852289s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12H6EaBk5vQxDeccjDtyoJmuANkspKuRPCyS7qHuDn16GQPa8o6, address:77.90.31.11:4588): protocol: rpc: dial tcp 77.90.31.11:4588: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174147411 (921h11m47.526932519s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1vQJmv9n2yWXZtCCaABrxkB3NN6vDwLdiBkRibDN3t6YNmcmGP, address:45.91.116.6:4001): protocol: rpc: dial tcp 45.91.116.6:4001: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174295850 (921h11m47.527080958s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12d12pAMGhxjtLBE1tp9yEE7NMdfh8kcvsA8abhTnM8nbBB5LEK, address:45.91.116.14:4206): protocol: rpc: dial tcp 45.91.116.14:4206: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174441473 (921h11m47.527226581s) [noise=true , address=77.90.31.14:4669 , piece_id=YZUXVZYTK76CPUTVGTN6V63SIHTIHIAKPCSXLCROPELODS4TXNOA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12wgv8uy7FaviWBw3H8ZS2NfJNnZ5F5PYyxxJrYaJsfGVv55Q8T, address:77.90.31.14:4669): protocol: read tcp 5.161.89.252:59908->77.90.31.14:4669: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174480827 (921h11m47.527265935s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW, address:45.91.116.7:4016): protocol: read tcp 5.161.89.252:21556->45.91.116.7:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174537793 (921h11m47.527322901s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1KER2FucoaWotduZNiFAnbFz7gotJYFofKnyQNCRvWQ8rjVDwY, address:77.90.31.11:4559): protocol: read tcp 5.161.89.252:27818->77.90.31.11:4559: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174593429 (921h11m47.527378537s) [noise=true , address=77.90.31.16:4755 , piece_id=XVJRVIFXDLQF2PKNLAOS2YWWNC52CCJCBLRYN7WAMR3DHZAEDCMQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV, address:77.90.31.16:4755): protocol: read tcp 5.161.89.252:25238->77.90.31.16:4755: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174612024 (921h11m47.527397132s) [seg_pos={0 0}, upload=810691]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Oct 6 23:20:12.191155500 (921h11m47.543940619s) [upload=810691]: Done uploading segments...
Oct 6 23:20:12.191171450 (921h11m47.543956569s) [upload=810691]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 408.410285ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
755.65941ms
FAIL (2025-10-07 00:00:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 755.68109ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
427.124219ms
FAIL (2025-10-07 00:00:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 427.148013ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
757.781985ms
FAIL (2025-10-07 00:00:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 757.815347ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
551.025333ms
FAIL (2025-10-06 23:59:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
27420042 (921h10m47.58020515s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227624987 (921h10m47.580410085s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227650294 (921h10m47.580435392s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227876188 (921h10m47.580661287s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227943646 (921h10m47.580728743s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228144602 (921h10m47.58092971s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228179508 (921h10m47.580964616s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228374473 (921h10m47.581159581s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228432042 (921h10m47.581217139s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228581452 (921h10m47.58136656s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228676600 (921h10m47.581461698s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228792097 (921h10m47.581577206s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228974810 (921h10m47.581759918s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228999326 (921h10m47.581784434s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229204211 (921h10m47.581989319s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229215272 (921h10m47.58200038s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.299081179 (921h10m47.651866277s) [upload=810691]: Next returned nil segment
Oct 6 23:19:12.299097009 (921h10m47.651882117s) [upload=810691]: Waiting for error group managing segments...
Oct 6 23:19:12.306034258 (921h10m47.658819356s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.307622568 (921h10m47.660407677s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.308054209 (921h10m47.660839317s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.316367240 (921h10m47.669152338s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.353623418 (921h10m47.706408517s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.798268805 (921h10m48.151053913s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.819297331 (921h10m48.172082429s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:06.839967999 (921h11m42.192753127s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:08.034348426 (921h11m43.387133564s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:12.173936997 (921h11m47.526722105s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:126w8AaZrrF8Y4uMP5yrGGadnMCCEiuP1s2CKg4XwkA7kPMvvS5, address:45.91.116.10:4103): protocol: rpc: dial tcp 45.91.116.10:4103: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174003862 (921h11m47.52678897s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA, address:77.90.31.18:4831): protocol: rpc: dial tcp 77.90.31.18:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174067181 (921h11m47.526852289s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12H6EaBk5vQxDeccjDtyoJmuANkspKuRPCyS7qHuDn16GQPa8o6, address:77.90.31.11:4588): protocol: rpc: dial tcp 77.90.31.11:4588: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174147411 (921h11m47.526932519s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1vQJmv9n2yWXZtCCaABrxkB3NN6vDwLdiBkRibDN3t6YNmcmGP, address:45.91.116.6:4001): protocol: rpc: dial tcp 45.91.116.6:4001: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174295850 (921h11m47.527080958s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12d12pAMGhxjtLBE1tp9yEE7NMdfh8kcvsA8abhTnM8nbBB5LEK, address:45.91.116.14:4206): protocol: rpc: dial tcp 45.91.116.14:4206: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174441473 (921h11m47.527226581s) [noise=true , address=77.90.31.14:4669 , piece_id=YZUXVZYTK76CPUTVGTN6V63SIHTIHIAKPCSXLCROPELODS4TXNOA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12wgv8uy7FaviWBw3H8ZS2NfJNnZ5F5PYyxxJrYaJsfGVv55Q8T, address:77.90.31.14:4669): protocol: read tcp 5.161.89.252:59908->77.90.31.14:4669: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174480827 (921h11m47.527265935s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW, address:45.91.116.7:4016): protocol: read tcp 5.161.89.252:21556->45.91.116.7:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174537793 (921h11m47.527322901s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1KER2FucoaWotduZNiFAnbFz7gotJYFofKnyQNCRvWQ8rjVDwY, address:77.90.31.11:4559): protocol: read tcp 5.161.89.252:27818->77.90.31.11:4559: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174593429 (921h11m47.527378537s) [noise=true , address=77.90.31.16:4755 , piece_id=XVJRVIFXDLQF2PKNLAOS2YWWNC52CCJCBLRYN7WAMR3DHZAEDCMQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV, address:77.90.31.16:4755): protocol: read tcp 5.161.89.252:25238->77.90.31.16:4755: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174612024 (921h11m47.527397132s) [seg_pos={0 0}, upload=810691]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Oct 6 23:20:12.191155500 (921h11m47.543940619s) [upload=810691]: Done uploading segments...
Oct 6 23:20:12.191171450 (921h11m47.543956569s) [upload=810691]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 551.053044ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
442.120907ms
FAIL (2025-10-06 23:59:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 442.145143ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
376.455397ms
FAIL (2025-10-06 23:59:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
27420042 (921h10m47.58020515s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227624987 (921h10m47.580410085s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227650294 (921h10m47.580435392s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227876188 (921h10m47.580661287s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227943646 (921h10m47.580728743s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228144602 (921h10m47.58092971s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228179508 (921h10m47.580964616s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228374473 (921h10m47.581159581s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228432042 (921h10m47.581217139s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228581452 (921h10m47.58136656s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228676600 (921h10m47.581461698s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228792097 (921h10m47.581577206s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228974810 (921h10m47.581759918s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228999326 (921h10m47.581784434s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229204211 (921h10m47.581989319s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229215272 (921h10m47.58200038s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.299081179 (921h10m47.651866277s) [upload=810691]: Next returned nil segment
Oct 6 23:19:12.299097009 (921h10m47.651882117s) [upload=810691]: Waiting for error group managing segments...
Oct 6 23:19:12.306034258 (921h10m47.658819356s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.307622568 (921h10m47.660407677s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.308054209 (921h10m47.660839317s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.316367240 (921h10m47.669152338s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.353623418 (921h10m47.706408517s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.798268805 (921h10m48.151053913s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.819297331 (921h10m48.172082429s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:06.839967999 (921h11m42.192753127s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:08.034348426 (921h11m43.387133564s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:12.173936997 (921h11m47.526722105s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:126w8AaZrrF8Y4uMP5yrGGadnMCCEiuP1s2CKg4XwkA7kPMvvS5, address:45.91.116.10:4103): protocol: rpc: dial tcp 45.91.116.10:4103: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174003862 (921h11m47.52678897s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA, address:77.90.31.18:4831): protocol: rpc: dial tcp 77.90.31.18:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174067181 (921h11m47.526852289s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12H6EaBk5vQxDeccjDtyoJmuANkspKuRPCyS7qHuDn16GQPa8o6, address:77.90.31.11:4588): protocol: rpc: dial tcp 77.90.31.11:4588: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174147411 (921h11m47.526932519s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1vQJmv9n2yWXZtCCaABrxkB3NN6vDwLdiBkRibDN3t6YNmcmGP, address:45.91.116.6:4001): protocol: rpc: dial tcp 45.91.116.6:4001: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174295850 (921h11m47.527080958s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12d12pAMGhxjtLBE1tp9yEE7NMdfh8kcvsA8abhTnM8nbBB5LEK, address:45.91.116.14:4206): protocol: rpc: dial tcp 45.91.116.14:4206: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174441473 (921h11m47.527226581s) [noise=true , address=77.90.31.14:4669 , piece_id=YZUXVZYTK76CPUTVGTN6V63SIHTIHIAKPCSXLCROPELODS4TXNOA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12wgv8uy7FaviWBw3H8ZS2NfJNnZ5F5PYyxxJrYaJsfGVv55Q8T, address:77.90.31.14:4669): protocol: read tcp 5.161.89.252:59908->77.90.31.14:4669: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174480827 (921h11m47.527265935s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW, address:45.91.116.7:4016): protocol: read tcp 5.161.89.252:21556->45.91.116.7:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174537793 (921h11m47.527322901s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1KER2FucoaWotduZNiFAnbFz7gotJYFofKnyQNCRvWQ8rjVDwY, address:77.90.31.11:4559): protocol: read tcp 5.161.89.252:27818->77.90.31.11:4559: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174593429 (921h11m47.527378537s) [noise=true , address=77.90.31.16:4755 , piece_id=XVJRVIFXDLQF2PKNLAOS2YWWNC52CCJCBLRYN7WAMR3DHZAEDCMQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV, address:77.90.31.16:4755): protocol: read tcp 5.161.89.252:25238->77.90.31.16:4755: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174612024 (921h11m47.527397132s) [seg_pos={0 0}, upload=810691]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Oct 6 23:20:12.191155500 (921h11m47.543940619s) [upload=810691]: Done uploading segments...
Oct 6 23:20:12.191171450 (921h11m47.543956569s) [upload=810691]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 376.475605ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
710.163092ms
FAIL (2025-10-06 23:59:03 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 710.180746ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [X...X.......................................................] duration:
428.212387ms
FAIL (2025-10-06 23:58:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 428.239298ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
612.869284ms
FAIL (2025-10-06 23:58:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 612.895365ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
500.440894ms
FAIL (2025-10-06 23:58:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 6)
======LOGS======
8s) [seg_pos={0 0}, upload=810623]: Begin upload segment...
Oct 6 23:14:35.231159887 (921h6m10.583944995s) [seg_pos={0 0}, upload=810623]: Done begin upload segment.
Oct 6 23:14:35.231177129 (921h6m10.583962237s) [noise=true , address=145.79.227.14:4839 , piece_id=YGAV5O7IBCW654XHKAKGKQRQ4PIHOQYNPRKNNSI4LBZ3N2I24HDQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231202467 (921h6m10.583987575s) [noise=true , address=145.79.227.13:4802 , piece_id=U6QBCPLFOT7FKZER4GTZHZONSLGI32ZFKQ6YMHLMXBVT6Q3G3Q5A, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231445945 (921h6m10.584231042s) [noise=true , address=77.90.31.21:4879 , piece_id=YMGHKTOSRW6HQSEGA5Z74727YX5PI3LMGNJEU7JQDYL5UGJ2AHMQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231464639 (921h6m10.584249747s) [noise=true , address=45.91.116.9:4262 , piece_id=LZITJ3U4QUE4VQM2NUAZMPJ5SBEBSVEQW427LRKG4NTRU7KKQUQQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231662370 (921h6m10.584447468s) [noise=true , address=45.91.116.12:4225 , piece_id=WXDK5FN4PP4LPW3UF6ZLBXWLIZAXLP64BWNGY2DFIKGIFNESOFLQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231680665 (921h6m10.584465773s) [noise=true , address=145.79.227.17:4970 , piece_id=EQDZAIB72F2JRHKJD444PCM4AG225NFL4BFT6L74E7QSFVHDH7QQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231888995 (921h6m10.584674093s) [noise=true , address=145.79.227.3:4150 , piece_id=5JCRCAVAZMPJWDWBPIMMTXYESJQYHCBYZV2D5CGCAWDMD73HC26Q, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231977101 (921h6m10.584762198s) [noise=true , address=145.79.227.5:4221 , piece_id=GX5MVSFGABSJDQLNPQUNBDCKRUGHPPTRJ2Y4KTSJM3GBHDVMWSUQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232134006 (921h6m10.584919114s) [noise=true , address=145.79.227.2:4113 , piece_id=3B4UQO3A2V5SDEQTEPLDVFD2GFGIIDZI3GTOC4Q7B3MRMSUTFVUQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232215128 (921h6m10.585000236s) [noise=true , address=77.90.31.21:4877 , piece_id=EUY5Q64A7NBYOTT4I5MTH3SZBEDXYJTI42W6VYOTNL4B5NMTDKNQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232343719 (921h6m10.585128817s) [noise=true , address=77.90.31.10:4517 , piece_id=73CMBGB7TGVXWGQC6IUNB54POXYMSHWYRRRV7GTXXZDF76LIAQVQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232451020 (921h6m10.585236118s) [noise=true , address=77.90.31.11:4554 , piece_id=BBSDAQ52W6Z26QH3XXEPJVW34ZSZCSFLREX44Q4TDSGOPXKA6ANA, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232590893 (921h6m10.585376001s) [noise=true , address=77.90.31.16:4735 , piece_id=VARS5MVTAXS2Y7C2IDCX7XW4Y72G574Y5SK3JN4LFDBDAJYEBU3Q, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232671273 (921h6m10.585456381s) [noise=true , address=77.90.31.18:4805 , piece_id=2B2PP4HY4ILPNQYUCJH3AZCLM2KQJHYV4QYN43OM5BJQFHM2SI4Q, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232794845 (921h6m10.585579953s) [noise=true , address=77.90.31.13:4626 , piece_id=ANQSEX2GFRGK5AHO5IFQYKXB5ABZDICBTKNY4OKOP5DUZCQYS4QA, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.233021411 (921h6m10.585806519s) [noise=true , address=77.90.31.12:4592 , piece_id=IXYLGHN3BS4KSQVM7MJDL5JBR2NGXB3HBQPS62DGJKFEMJ5EUCYQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.301739905 (921h6m10.654525013s) [upload=810623]: Next returned nil segment
Oct 6 23:14:35.301751626 (921h6m10.654536734s) [upload=810623]: Waiting for error group managing segments...
Oct 6 23:14:35.308525018 (921h6m10.661310126s) [noise=true , address=145.79.227.5:4221 , piece_id=GX5MVSFGABSJDQLNPQUNBDCKRUGHPPTRJ2Y4KTSJM3GBHDVMWSUQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.309028252 (921h6m10.66181336s) [noise=true , address=145.79.227.13:4802 , piece_id=U6QBCPLFOT7FKZER4GTZHZONSLGI32ZFKQ6YMHLMXBVT6Q3G3Q5A, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.309677310 (921h6m10.662462408s) [noise=true , address=145.79.227.14:4839 , piece_id=YGAV5O7IBCW654XHKAKGKQRQ4PIHOQYNPRKNNSI4LBZ3N2I24HDQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.309896092 (921h6m10.6626812s) [noise=true , address=145.79.227.3:4150 , piece_id=5JCRCAVAZMPJWDWBPIMMTXYESJQYHCBYZV2D5CGCAWDMD73HC26Q, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.310034271 (921h6m10.662819379s) [noise=true , address=145.79.227.17:4970 , piece_id=EQDZAIB72F2JRHKJD444PCM4AG225NFL4BFT6L74E7QSFVHDH7QQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.310195242 (921h6m10.66298034s) [noise=true , address=145.79.227.2:4113 , piece_id=3B4UQO3A2V5SDEQTEPLDVFD2GFGIIDZI3GTOC4Q7B3MRMSUTFVUQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:15:05.199595893 (921h6m40.552381001s) [noise=true , address=77.90.31.10:4517 , piece_id=73CMBGB7TGVXWGQC6IUNB54POXYMSHWYRRRV7GTXXZDF76LIAQVQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.199636880 (921h6m40.552421988s) [noise=true , address=45.91.116.12:4225 , piece_id=WXDK5FN4PP4LPW3UF6ZLBXWLIZAXLP64BWNGY2DFIKGIFNESOFLQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.199832757 (921h6m40.552617885s) [noise=true , address=77.90.31.21:4877 , piece_id=EUY5Q64A7NBYOTT4I5MTH3SZBEDXYJTI42W6VYOTNL4B5NMTDKNQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: read tcp 5.161.89.252:53308->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.199933757 (921h6m40.552718865s) [noise=true , address=77.90.31.18:4805 , piece_id=2B2PP4HY4ILPNQYUCJH3AZCLM2KQJHYV4QYN43OM5BJQFHM2SI4Q, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: read tcp 5.161.89.252:52568->77.90.31.18:4805: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.199996945 (921h6m40.552782053s) [noise=true , address=77.90.31.21:4879 , piece_id=YMGHKTOSRW6HQSEGA5Z74727YX5PI3LMGNJEU7JQDYL5UGJ2AHMQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: read tcp 5.161.89.252:8812->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200046488 (921h6m40.552831617s) [noise=true , address=77.90.31.12:4592 , piece_id=IXYLGHN3BS4KSQVM7MJDL5JBR2NGXB3HBQPS62DGJKFEMJ5EUCYQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200054824 (921h6m40.552839922s) [noise=true , address=45.91.116.9:4262 , piece_id=LZITJ3U4QUE4VQM2NUAZMPJ5SBEBSVEQW427LRKG4NTRU7KKQUQQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: read tcp 5.161.89.252:12616->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200091874 (921h6m40.552877001s) [noise=true , address=77.90.31.16:4735 , piece_id=VARS5MVTAXS2Y7C2IDCX7XW4Y72G574Y5SK3JN4LFDBDAJYEBU3Q, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:39316->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200106040 (921h6m40.552891148s) [noise=true , address=77.90.31.11:4554 , piece_id=BBSDAQ52W6Z26QH3XXEPJVW34ZSZCSFLREX44Q4TDSGOPXKA6ANA, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: rpc: dial tcp 77.90.31.11:4554: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200139673 (921h6m40.552924771s) [noise=true , address=77.90.31.13:4626 , piece_id=ANQSEX2GFRGK5AHO5IFQYKXB5ABZDICBTKNY4OKOP5DUZCQYS4QA, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: read tcp 5.161.89.252:18720->77.90.31.13:4626: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200164760 (921h6m40.552949858s) [seg_pos={0 0}, upload=810623]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil>
Oct 6 23:15:05.216712375 (921h6m40.569497483s) [upload=810623]: Done uploading segments...
Oct 6 23:15:05.216730419 (921h6m40.569515517s) [upload=810623]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6)
Duration: 500.464728ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
618.689839ms
FAIL (2025-10-06 23:57:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 618.712211ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
2 out of 60 is failed (threshold=3) [X........X..................................................] duration:
411.587779ms
FAIL (2025-10-06 23:57:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
27420042 (921h10m47.58020515s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227624987 (921h10m47.580410085s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227650294 (921h10m47.580435392s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227876188 (921h10m47.580661287s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227943646 (921h10m47.580728743s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228144602 (921h10m47.58092971s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228179508 (921h10m47.580964616s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228374473 (921h10m47.581159581s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228432042 (921h10m47.581217139s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228581452 (921h10m47.58136656s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228676600 (921h10m47.581461698s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228792097 (921h10m47.581577206s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228974810 (921h10m47.581759918s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228999326 (921h10m47.581784434s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229204211 (921h10m47.581989319s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229215272 (921h10m47.58200038s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.299081179 (921h10m47.651866277s) [upload=810691]: Next returned nil segment
Oct 6 23:19:12.299097009 (921h10m47.651882117s) [upload=810691]: Waiting for error group managing segments...
Oct 6 23:19:12.306034258 (921h10m47.658819356s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.307622568 (921h10m47.660407677s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.308054209 (921h10m47.660839317s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.316367240 (921h10m47.669152338s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.353623418 (921h10m47.706408517s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.798268805 (921h10m48.151053913s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.819297331 (921h10m48.172082429s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:06.839967999 (921h11m42.192753127s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:08.034348426 (921h11m43.387133564s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:12.173936997 (921h11m47.526722105s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:126w8AaZrrF8Y4uMP5yrGGadnMCCEiuP1s2CKg4XwkA7kPMvvS5, address:45.91.116.10:4103): protocol: rpc: dial tcp 45.91.116.10:4103: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174003862 (921h11m47.52678897s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA, address:77.90.31.18:4831): protocol: rpc: dial tcp 77.90.31.18:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174067181 (921h11m47.526852289s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12H6EaBk5vQxDeccjDtyoJmuANkspKuRPCyS7qHuDn16GQPa8o6, address:77.90.31.11:4588): protocol: rpc: dial tcp 77.90.31.11:4588: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174147411 (921h11m47.526932519s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1vQJmv9n2yWXZtCCaABrxkB3NN6vDwLdiBkRibDN3t6YNmcmGP, address:45.91.116.6:4001): protocol: rpc: dial tcp 45.91.116.6:4001: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174295850 (921h11m47.527080958s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12d12pAMGhxjtLBE1tp9yEE7NMdfh8kcvsA8abhTnM8nbBB5LEK, address:45.91.116.14:4206): protocol: rpc: dial tcp 45.91.116.14:4206: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174441473 (921h11m47.527226581s) [noise=true , address=77.90.31.14:4669 , piece_id=YZUXVZYTK76CPUTVGTN6V63SIHTIHIAKPCSXLCROPELODS4TXNOA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12wgv8uy7FaviWBw3H8ZS2NfJNnZ5F5PYyxxJrYaJsfGVv55Q8T, address:77.90.31.14:4669): protocol: read tcp 5.161.89.252:59908->77.90.31.14:4669: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174480827 (921h11m47.527265935s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW, address:45.91.116.7:4016): protocol: read tcp 5.161.89.252:21556->45.91.116.7:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174537793 (921h11m47.527322901s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1KER2FucoaWotduZNiFAnbFz7gotJYFofKnyQNCRvWQ8rjVDwY, address:77.90.31.11:4559): protocol: read tcp 5.161.89.252:27818->77.90.31.11:4559: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174593429 (921h11m47.527378537s) [noise=true , address=77.90.31.16:4755 , piece_id=XVJRVIFXDLQF2PKNLAOS2YWWNC52CCJCBLRYN7WAMR3DHZAEDCMQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV, address:77.90.31.16:4755): protocol: read tcp 5.161.89.252:25238->77.90.31.16:4755: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174612024 (921h11m47.527397132s) [seg_pos={0 0}, upload=810691]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Oct 6 23:20:12.191155500 (921h11m47.543940619s) [upload=810691]: Done uploading segments...
Oct 6 23:20:12.191171450 (921h11m47.543956569s) [upload=810691]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 411.614039ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
416.719098ms
FAIL (2025-10-06 23:57:49 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 6)
======LOGS======
8s) [seg_pos={0 0}, upload=810623]: Begin upload segment...
Oct 6 23:14:35.231159887 (921h6m10.583944995s) [seg_pos={0 0}, upload=810623]: Done begin upload segment.
Oct 6 23:14:35.231177129 (921h6m10.583962237s) [noise=true , address=145.79.227.14:4839 , piece_id=YGAV5O7IBCW654XHKAKGKQRQ4PIHOQYNPRKNNSI4LBZ3N2I24HDQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231202467 (921h6m10.583987575s) [noise=true , address=145.79.227.13:4802 , piece_id=U6QBCPLFOT7FKZER4GTZHZONSLGI32ZFKQ6YMHLMXBVT6Q3G3Q5A, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231445945 (921h6m10.584231042s) [noise=true , address=77.90.31.21:4879 , piece_id=YMGHKTOSRW6HQSEGA5Z74727YX5PI3LMGNJEU7JQDYL5UGJ2AHMQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231464639 (921h6m10.584249747s) [noise=true , address=45.91.116.9:4262 , piece_id=LZITJ3U4QUE4VQM2NUAZMPJ5SBEBSVEQW427LRKG4NTRU7KKQUQQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231662370 (921h6m10.584447468s) [noise=true , address=45.91.116.12:4225 , piece_id=WXDK5FN4PP4LPW3UF6ZLBXWLIZAXLP64BWNGY2DFIKGIFNESOFLQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231680665 (921h6m10.584465773s) [noise=true , address=145.79.227.17:4970 , piece_id=EQDZAIB72F2JRHKJD444PCM4AG225NFL4BFT6L74E7QSFVHDH7QQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231888995 (921h6m10.584674093s) [noise=true , address=145.79.227.3:4150 , piece_id=5JCRCAVAZMPJWDWBPIMMTXYESJQYHCBYZV2D5CGCAWDMD73HC26Q, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231977101 (921h6m10.584762198s) [noise=true , address=145.79.227.5:4221 , piece_id=GX5MVSFGABSJDQLNPQUNBDCKRUGHPPTRJ2Y4KTSJM3GBHDVMWSUQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232134006 (921h6m10.584919114s) [noise=true , address=145.79.227.2:4113 , piece_id=3B4UQO3A2V5SDEQTEPLDVFD2GFGIIDZI3GTOC4Q7B3MRMSUTFVUQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232215128 (921h6m10.585000236s) [noise=true , address=77.90.31.21:4877 , piece_id=EUY5Q64A7NBYOTT4I5MTH3SZBEDXYJTI42W6VYOTNL4B5NMTDKNQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232343719 (921h6m10.585128817s) [noise=true , address=77.90.31.10:4517 , piece_id=73CMBGB7TGVXWGQC6IUNB54POXYMSHWYRRRV7GTXXZDF76LIAQVQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232451020 (921h6m10.585236118s) [noise=true , address=77.90.31.11:4554 , piece_id=BBSDAQ52W6Z26QH3XXEPJVW34ZSZCSFLREX44Q4TDSGOPXKA6ANA, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232590893 (921h6m10.585376001s) [noise=true , address=77.90.31.16:4735 , piece_id=VARS5MVTAXS2Y7C2IDCX7XW4Y72G574Y5SK3JN4LFDBDAJYEBU3Q, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232671273 (921h6m10.585456381s) [noise=true , address=77.90.31.18:4805 , piece_id=2B2PP4HY4ILPNQYUCJH3AZCLM2KQJHYV4QYN43OM5BJQFHM2SI4Q, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232794845 (921h6m10.585579953s) [noise=true , address=77.90.31.13:4626 , piece_id=ANQSEX2GFRGK5AHO5IFQYKXB5ABZDICBTKNY4OKOP5DUZCQYS4QA, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.233021411 (921h6m10.585806519s) [noise=true , address=77.90.31.12:4592 , piece_id=IXYLGHN3BS4KSQVM7MJDL5JBR2NGXB3HBQPS62DGJKFEMJ5EUCYQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.301739905 (921h6m10.654525013s) [upload=810623]: Next returned nil segment
Oct 6 23:14:35.301751626 (921h6m10.654536734s) [upload=810623]: Waiting for error group managing segments...
Oct 6 23:14:35.308525018 (921h6m10.661310126s) [noise=true , address=145.79.227.5:4221 , piece_id=GX5MVSFGABSJDQLNPQUNBDCKRUGHPPTRJ2Y4KTSJM3GBHDVMWSUQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.309028252 (921h6m10.66181336s) [noise=true , address=145.79.227.13:4802 , piece_id=U6QBCPLFOT7FKZER4GTZHZONSLGI32ZFKQ6YMHLMXBVT6Q3G3Q5A, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.309677310 (921h6m10.662462408s) [noise=true , address=145.79.227.14:4839 , piece_id=YGAV5O7IBCW654XHKAKGKQRQ4PIHOQYNPRKNNSI4LBZ3N2I24HDQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.309896092 (921h6m10.6626812s) [noise=true , address=145.79.227.3:4150 , piece_id=5JCRCAVAZMPJWDWBPIMMTXYESJQYHCBYZV2D5CGCAWDMD73HC26Q, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.310034271 (921h6m10.662819379s) [noise=true , address=145.79.227.17:4970 , piece_id=EQDZAIB72F2JRHKJD444PCM4AG225NFL4BFT6L74E7QSFVHDH7QQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.310195242 (921h6m10.66298034s) [noise=true , address=145.79.227.2:4113 , piece_id=3B4UQO3A2V5SDEQTEPLDVFD2GFGIIDZI3GTOC4Q7B3MRMSUTFVUQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:15:05.199595893 (921h6m40.552381001s) [noise=true , address=77.90.31.10:4517 , piece_id=73CMBGB7TGVXWGQC6IUNB54POXYMSHWYRRRV7GTXXZDF76LIAQVQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.199636880 (921h6m40.552421988s) [noise=true , address=45.91.116.12:4225 , piece_id=WXDK5FN4PP4LPW3UF6ZLBXWLIZAXLP64BWNGY2DFIKGIFNESOFLQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.199832757 (921h6m40.552617885s) [noise=true , address=77.90.31.21:4877 , piece_id=EUY5Q64A7NBYOTT4I5MTH3SZBEDXYJTI42W6VYOTNL4B5NMTDKNQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: read tcp 5.161.89.252:53308->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.199933757 (921h6m40.552718865s) [noise=true , address=77.90.31.18:4805 , piece_id=2B2PP4HY4ILPNQYUCJH3AZCLM2KQJHYV4QYN43OM5BJQFHM2SI4Q, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: read tcp 5.161.89.252:52568->77.90.31.18:4805: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.199996945 (921h6m40.552782053s) [noise=true , address=77.90.31.21:4879 , piece_id=YMGHKTOSRW6HQSEGA5Z74727YX5PI3LMGNJEU7JQDYL5UGJ2AHMQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: read tcp 5.161.89.252:8812->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200046488 (921h6m40.552831617s) [noise=true , address=77.90.31.12:4592 , piece_id=IXYLGHN3BS4KSQVM7MJDL5JBR2NGXB3HBQPS62DGJKFEMJ5EUCYQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200054824 (921h6m40.552839922s) [noise=true , address=45.91.116.9:4262 , piece_id=LZITJ3U4QUE4VQM2NUAZMPJ5SBEBSVEQW427LRKG4NTRU7KKQUQQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: read tcp 5.161.89.252:12616->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200091874 (921h6m40.552877001s) [noise=true , address=77.90.31.16:4735 , piece_id=VARS5MVTAXS2Y7C2IDCX7XW4Y72G574Y5SK3JN4LFDBDAJYEBU3Q, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:39316->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200106040 (921h6m40.552891148s) [noise=true , address=77.90.31.11:4554 , piece_id=BBSDAQ52W6Z26QH3XXEPJVW34ZSZCSFLREX44Q4TDSGOPXKA6ANA, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: rpc: dial tcp 77.90.31.11:4554: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200139673 (921h6m40.552924771s) [noise=true , address=77.90.31.13:4626 , piece_id=ANQSEX2GFRGK5AHO5IFQYKXB5ABZDICBTKNY4OKOP5DUZCQYS4QA, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: read tcp 5.161.89.252:18720->77.90.31.13:4626: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200164760 (921h6m40.552949858s) [seg_pos={0 0}, upload=810623]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil>
Oct 6 23:15:05.216712375 (921h6m40.569497483s) [upload=810623]: Done uploading segments...
Oct 6 23:15:05.216730419 (921h6m40.569515517s) [upload=810623]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6)
Duration: 416.749315ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X........X.................................................] duration:
453.202455ms
FAIL (2025-10-06 23:57:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
27420042 (921h10m47.58020515s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227624987 (921h10m47.580410085s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227650294 (921h10m47.580435392s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227876188 (921h10m47.580661287s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227943646 (921h10m47.580728743s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228144602 (921h10m47.58092971s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228179508 (921h10m47.580964616s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228374473 (921h10m47.581159581s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228432042 (921h10m47.581217139s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228581452 (921h10m47.58136656s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228676600 (921h10m47.581461698s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228792097 (921h10m47.581577206s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228974810 (921h10m47.581759918s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228999326 (921h10m47.581784434s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229204211 (921h10m47.581989319s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229215272 (921h10m47.58200038s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.299081179 (921h10m47.651866277s) [upload=810691]: Next returned nil segment
Oct 6 23:19:12.299097009 (921h10m47.651882117s) [upload=810691]: Waiting for error group managing segments...
Oct 6 23:19:12.306034258 (921h10m47.658819356s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.307622568 (921h10m47.660407677s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.308054209 (921h10m47.660839317s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.316367240 (921h10m47.669152338s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.353623418 (921h10m47.706408517s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.798268805 (921h10m48.151053913s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.819297331 (921h10m48.172082429s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:06.839967999 (921h11m42.192753127s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:08.034348426 (921h11m43.387133564s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:12.173936997 (921h11m47.526722105s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:126w8AaZrrF8Y4uMP5yrGGadnMCCEiuP1s2CKg4XwkA7kPMvvS5, address:45.91.116.10:4103): protocol: rpc: dial tcp 45.91.116.10:4103: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174003862 (921h11m47.52678897s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA, address:77.90.31.18:4831): protocol: rpc: dial tcp 77.90.31.18:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174067181 (921h11m47.526852289s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12H6EaBk5vQxDeccjDtyoJmuANkspKuRPCyS7qHuDn16GQPa8o6, address:77.90.31.11:4588): protocol: rpc: dial tcp 77.90.31.11:4588: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174147411 (921h11m47.526932519s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1vQJmv9n2yWXZtCCaABrxkB3NN6vDwLdiBkRibDN3t6YNmcmGP, address:45.91.116.6:4001): protocol: rpc: dial tcp 45.91.116.6:4001: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174295850 (921h11m47.527080958s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12d12pAMGhxjtLBE1tp9yEE7NMdfh8kcvsA8abhTnM8nbBB5LEK, address:45.91.116.14:4206): protocol: rpc: dial tcp 45.91.116.14:4206: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174441473 (921h11m47.527226581s) [noise=true , address=77.90.31.14:4669 , piece_id=YZUXVZYTK76CPUTVGTN6V63SIHTIHIAKPCSXLCROPELODS4TXNOA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12wgv8uy7FaviWBw3H8ZS2NfJNnZ5F5PYyxxJrYaJsfGVv55Q8T, address:77.90.31.14:4669): protocol: read tcp 5.161.89.252:59908->77.90.31.14:4669: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174480827 (921h11m47.527265935s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW, address:45.91.116.7:4016): protocol: read tcp 5.161.89.252:21556->45.91.116.7:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174537793 (921h11m47.527322901s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1KER2FucoaWotduZNiFAnbFz7gotJYFofKnyQNCRvWQ8rjVDwY, address:77.90.31.11:4559): protocol: read tcp 5.161.89.252:27818->77.90.31.11:4559: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174593429 (921h11m47.527378537s) [noise=true , address=77.90.31.16:4755 , piece_id=XVJRVIFXDLQF2PKNLAOS2YWWNC52CCJCBLRYN7WAMR3DHZAEDCMQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV, address:77.90.31.16:4755): protocol: read tcp 5.161.89.252:25238->77.90.31.16:4755: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174612024 (921h11m47.527397132s) [seg_pos={0 0}, upload=810691]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Oct 6 23:20:12.191155500 (921h11m47.543940619s) [upload=810691]: Done uploading segments...
Oct 6 23:20:12.191171450 (921h11m47.543956569s) [upload=810691]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 453.22612ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X...X......................................................] duration:
566.772508ms
FAIL (2025-10-06 23:57:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 566.797684ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X........X................................................] duration:
403.141294ms
FAIL (2025-10-06 23:57:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
27420042 (921h10m47.58020515s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227624987 (921h10m47.580410085s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227650294 (921h10m47.580435392s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227876188 (921h10m47.580661287s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227943646 (921h10m47.580728743s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228144602 (921h10m47.58092971s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228179508 (921h10m47.580964616s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228374473 (921h10m47.581159581s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228432042 (921h10m47.581217139s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228581452 (921h10m47.58136656s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228676600 (921h10m47.581461698s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228792097 (921h10m47.581577206s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228974810 (921h10m47.581759918s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228999326 (921h10m47.581784434s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229204211 (921h10m47.581989319s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229215272 (921h10m47.58200038s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.299081179 (921h10m47.651866277s) [upload=810691]: Next returned nil segment
Oct 6 23:19:12.299097009 (921h10m47.651882117s) [upload=810691]: Waiting for error group managing segments...
Oct 6 23:19:12.306034258 (921h10m47.658819356s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.307622568 (921h10m47.660407677s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.308054209 (921h10m47.660839317s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.316367240 (921h10m47.669152338s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.353623418 (921h10m47.706408517s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.798268805 (921h10m48.151053913s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.819297331 (921h10m48.172082429s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:06.839967999 (921h11m42.192753127s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:08.034348426 (921h11m43.387133564s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:12.173936997 (921h11m47.526722105s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:126w8AaZrrF8Y4uMP5yrGGadnMCCEiuP1s2CKg4XwkA7kPMvvS5, address:45.91.116.10:4103): protocol: rpc: dial tcp 45.91.116.10:4103: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174003862 (921h11m47.52678897s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA, address:77.90.31.18:4831): protocol: rpc: dial tcp 77.90.31.18:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174067181 (921h11m47.526852289s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12H6EaBk5vQxDeccjDtyoJmuANkspKuRPCyS7qHuDn16GQPa8o6, address:77.90.31.11:4588): protocol: rpc: dial tcp 77.90.31.11:4588: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174147411 (921h11m47.526932519s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1vQJmv9n2yWXZtCCaABrxkB3NN6vDwLdiBkRibDN3t6YNmcmGP, address:45.91.116.6:4001): protocol: rpc: dial tcp 45.91.116.6:4001: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174295850 (921h11m47.527080958s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12d12pAMGhxjtLBE1tp9yEE7NMdfh8kcvsA8abhTnM8nbBB5LEK, address:45.91.116.14:4206): protocol: rpc: dial tcp 45.91.116.14:4206: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174441473 (921h11m47.527226581s) [noise=true , address=77.90.31.14:4669 , piece_id=YZUXVZYTK76CPUTVGTN6V63SIHTIHIAKPCSXLCROPELODS4TXNOA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12wgv8uy7FaviWBw3H8ZS2NfJNnZ5F5PYyxxJrYaJsfGVv55Q8T, address:77.90.31.14:4669): protocol: read tcp 5.161.89.252:59908->77.90.31.14:4669: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174480827 (921h11m47.527265935s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW, address:45.91.116.7:4016): protocol: read tcp 5.161.89.252:21556->45.91.116.7:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174537793 (921h11m47.527322901s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1KER2FucoaWotduZNiFAnbFz7gotJYFofKnyQNCRvWQ8rjVDwY, address:77.90.31.11:4559): protocol: read tcp 5.161.89.252:27818->77.90.31.11:4559: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174593429 (921h11m47.527378537s) [noise=true , address=77.90.31.16:4755 , piece_id=XVJRVIFXDLQF2PKNLAOS2YWWNC52CCJCBLRYN7WAMR3DHZAEDCMQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV, address:77.90.31.16:4755): protocol: read tcp 5.161.89.252:25238->77.90.31.16:4755: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174612024 (921h11m47.527397132s) [seg_pos={0 0}, upload=810691]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Oct 6 23:20:12.191155500 (921h11m47.543940619s) [upload=810691]: Done uploading segments...
Oct 6 23:20:12.191171450 (921h11m47.543956569s) [upload=810691]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 403.163506ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
450.329705ms
FAIL (2025-10-06 23:56:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 6)
======LOGS======
8s) [seg_pos={0 0}, upload=810623]: Begin upload segment...
Oct 6 23:14:35.231159887 (921h6m10.583944995s) [seg_pos={0 0}, upload=810623]: Done begin upload segment.
Oct 6 23:14:35.231177129 (921h6m10.583962237s) [noise=true , address=145.79.227.14:4839 , piece_id=YGAV5O7IBCW654XHKAKGKQRQ4PIHOQYNPRKNNSI4LBZ3N2I24HDQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231202467 (921h6m10.583987575s) [noise=true , address=145.79.227.13:4802 , piece_id=U6QBCPLFOT7FKZER4GTZHZONSLGI32ZFKQ6YMHLMXBVT6Q3G3Q5A, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231445945 (921h6m10.584231042s) [noise=true , address=77.90.31.21:4879 , piece_id=YMGHKTOSRW6HQSEGA5Z74727YX5PI3LMGNJEU7JQDYL5UGJ2AHMQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231464639 (921h6m10.584249747s) [noise=true , address=45.91.116.9:4262 , piece_id=LZITJ3U4QUE4VQM2NUAZMPJ5SBEBSVEQW427LRKG4NTRU7KKQUQQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231662370 (921h6m10.584447468s) [noise=true , address=45.91.116.12:4225 , piece_id=WXDK5FN4PP4LPW3UF6ZLBXWLIZAXLP64BWNGY2DFIKGIFNESOFLQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231680665 (921h6m10.584465773s) [noise=true , address=145.79.227.17:4970 , piece_id=EQDZAIB72F2JRHKJD444PCM4AG225NFL4BFT6L74E7QSFVHDH7QQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231888995 (921h6m10.584674093s) [noise=true , address=145.79.227.3:4150 , piece_id=5JCRCAVAZMPJWDWBPIMMTXYESJQYHCBYZV2D5CGCAWDMD73HC26Q, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231977101 (921h6m10.584762198s) [noise=true , address=145.79.227.5:4221 , piece_id=GX5MVSFGABSJDQLNPQUNBDCKRUGHPPTRJ2Y4KTSJM3GBHDVMWSUQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232134006 (921h6m10.584919114s) [noise=true , address=145.79.227.2:4113 , piece_id=3B4UQO3A2V5SDEQTEPLDVFD2GFGIIDZI3GTOC4Q7B3MRMSUTFVUQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232215128 (921h6m10.585000236s) [noise=true , address=77.90.31.21:4877 , piece_id=EUY5Q64A7NBYOTT4I5MTH3SZBEDXYJTI42W6VYOTNL4B5NMTDKNQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232343719 (921h6m10.585128817s) [noise=true , address=77.90.31.10:4517 , piece_id=73CMBGB7TGVXWGQC6IUNB54POXYMSHWYRRRV7GTXXZDF76LIAQVQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232451020 (921h6m10.585236118s) [noise=true , address=77.90.31.11:4554 , piece_id=BBSDAQ52W6Z26QH3XXEPJVW34ZSZCSFLREX44Q4TDSGOPXKA6ANA, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232590893 (921h6m10.585376001s) [noise=true , address=77.90.31.16:4735 , piece_id=VARS5MVTAXS2Y7C2IDCX7XW4Y72G574Y5SK3JN4LFDBDAJYEBU3Q, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232671273 (921h6m10.585456381s) [noise=true , address=77.90.31.18:4805 , piece_id=2B2PP4HY4ILPNQYUCJH3AZCLM2KQJHYV4QYN43OM5BJQFHM2SI4Q, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232794845 (921h6m10.585579953s) [noise=true , address=77.90.31.13:4626 , piece_id=ANQSEX2GFRGK5AHO5IFQYKXB5ABZDICBTKNY4OKOP5DUZCQYS4QA, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.233021411 (921h6m10.585806519s) [noise=true , address=77.90.31.12:4592 , piece_id=IXYLGHN3BS4KSQVM7MJDL5JBR2NGXB3HBQPS62DGJKFEMJ5EUCYQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.301739905 (921h6m10.654525013s) [upload=810623]: Next returned nil segment
Oct 6 23:14:35.301751626 (921h6m10.654536734s) [upload=810623]: Waiting for error group managing segments...
Oct 6 23:14:35.308525018 (921h6m10.661310126s) [noise=true , address=145.79.227.5:4221 , piece_id=GX5MVSFGABSJDQLNPQUNBDCKRUGHPPTRJ2Y4KTSJM3GBHDVMWSUQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.309028252 (921h6m10.66181336s) [noise=true , address=145.79.227.13:4802 , piece_id=U6QBCPLFOT7FKZER4GTZHZONSLGI32ZFKQ6YMHLMXBVT6Q3G3Q5A, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.309677310 (921h6m10.662462408s) [noise=true , address=145.79.227.14:4839 , piece_id=YGAV5O7IBCW654XHKAKGKQRQ4PIHOQYNPRKNNSI4LBZ3N2I24HDQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.309896092 (921h6m10.6626812s) [noise=true , address=145.79.227.3:4150 , piece_id=5JCRCAVAZMPJWDWBPIMMTXYESJQYHCBYZV2D5CGCAWDMD73HC26Q, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.310034271 (921h6m10.662819379s) [noise=true , address=145.79.227.17:4970 , piece_id=EQDZAIB72F2JRHKJD444PCM4AG225NFL4BFT6L74E7QSFVHDH7QQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.310195242 (921h6m10.66298034s) [noise=true , address=145.79.227.2:4113 , piece_id=3B4UQO3A2V5SDEQTEPLDVFD2GFGIIDZI3GTOC4Q7B3MRMSUTFVUQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:15:05.199595893 (921h6m40.552381001s) [noise=true , address=77.90.31.10:4517 , piece_id=73CMBGB7TGVXWGQC6IUNB54POXYMSHWYRRRV7GTXXZDF76LIAQVQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.199636880 (921h6m40.552421988s) [noise=true , address=45.91.116.12:4225 , piece_id=WXDK5FN4PP4LPW3UF6ZLBXWLIZAXLP64BWNGY2DFIKGIFNESOFLQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.199832757 (921h6m40.552617885s) [noise=true , address=77.90.31.21:4877 , piece_id=EUY5Q64A7NBYOTT4I5MTH3SZBEDXYJTI42W6VYOTNL4B5NMTDKNQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: read tcp 5.161.89.252:53308->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.199933757 (921h6m40.552718865s) [noise=true , address=77.90.31.18:4805 , piece_id=2B2PP4HY4ILPNQYUCJH3AZCLM2KQJHYV4QYN43OM5BJQFHM2SI4Q, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: read tcp 5.161.89.252:52568->77.90.31.18:4805: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.199996945 (921h6m40.552782053s) [noise=true , address=77.90.31.21:4879 , piece_id=YMGHKTOSRW6HQSEGA5Z74727YX5PI3LMGNJEU7JQDYL5UGJ2AHMQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: read tcp 5.161.89.252:8812->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200046488 (921h6m40.552831617s) [noise=true , address=77.90.31.12:4592 , piece_id=IXYLGHN3BS4KSQVM7MJDL5JBR2NGXB3HBQPS62DGJKFEMJ5EUCYQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200054824 (921h6m40.552839922s) [noise=true , address=45.91.116.9:4262 , piece_id=LZITJ3U4QUE4VQM2NUAZMPJ5SBEBSVEQW427LRKG4NTRU7KKQUQQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: read tcp 5.161.89.252:12616->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200091874 (921h6m40.552877001s) [noise=true , address=77.90.31.16:4735 , piece_id=VARS5MVTAXS2Y7C2IDCX7XW4Y72G574Y5SK3JN4LFDBDAJYEBU3Q, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:39316->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200106040 (921h6m40.552891148s) [noise=true , address=77.90.31.11:4554 , piece_id=BBSDAQ52W6Z26QH3XXEPJVW34ZSZCSFLREX44Q4TDSGOPXKA6ANA, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: rpc: dial tcp 77.90.31.11:4554: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200139673 (921h6m40.552924771s) [noise=true , address=77.90.31.13:4626 , piece_id=ANQSEX2GFRGK5AHO5IFQYKXB5ABZDICBTKNY4OKOP5DUZCQYS4QA, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: read tcp 5.161.89.252:18720->77.90.31.13:4626: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200164760 (921h6m40.552949858s) [seg_pos={0 0}, upload=810623]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil>
Oct 6 23:15:05.216712375 (921h6m40.569497483s) [upload=810623]: Done uploading segments...
Oct 6 23:15:05.216730419 (921h6m40.569515517s) [upload=810623]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6)
Duration: 450.358688ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
592.586481ms
FAIL (2025-10-06 23:56:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 592.605327ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
575.782976ms
FAIL (2025-10-06 23:56:33 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 6)
======LOGS======
8s) [seg_pos={0 0}, upload=810623]: Begin upload segment...
Oct 6 23:14:35.231159887 (921h6m10.583944995s) [seg_pos={0 0}, upload=810623]: Done begin upload segment.
Oct 6 23:14:35.231177129 (921h6m10.583962237s) [noise=true , address=145.79.227.14:4839 , piece_id=YGAV5O7IBCW654XHKAKGKQRQ4PIHOQYNPRKNNSI4LBZ3N2I24HDQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231202467 (921h6m10.583987575s) [noise=true , address=145.79.227.13:4802 , piece_id=U6QBCPLFOT7FKZER4GTZHZONSLGI32ZFKQ6YMHLMXBVT6Q3G3Q5A, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231445945 (921h6m10.584231042s) [noise=true , address=77.90.31.21:4879 , piece_id=YMGHKTOSRW6HQSEGA5Z74727YX5PI3LMGNJEU7JQDYL5UGJ2AHMQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231464639 (921h6m10.584249747s) [noise=true , address=45.91.116.9:4262 , piece_id=LZITJ3U4QUE4VQM2NUAZMPJ5SBEBSVEQW427LRKG4NTRU7KKQUQQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231662370 (921h6m10.584447468s) [noise=true , address=45.91.116.12:4225 , piece_id=WXDK5FN4PP4LPW3UF6ZLBXWLIZAXLP64BWNGY2DFIKGIFNESOFLQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231680665 (921h6m10.584465773s) [noise=true , address=145.79.227.17:4970 , piece_id=EQDZAIB72F2JRHKJD444PCM4AG225NFL4BFT6L74E7QSFVHDH7QQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231888995 (921h6m10.584674093s) [noise=true , address=145.79.227.3:4150 , piece_id=5JCRCAVAZMPJWDWBPIMMTXYESJQYHCBYZV2D5CGCAWDMD73HC26Q, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231977101 (921h6m10.584762198s) [noise=true , address=145.79.227.5:4221 , piece_id=GX5MVSFGABSJDQLNPQUNBDCKRUGHPPTRJ2Y4KTSJM3GBHDVMWSUQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232134006 (921h6m10.584919114s) [noise=true , address=145.79.227.2:4113 , piece_id=3B4UQO3A2V5SDEQTEPLDVFD2GFGIIDZI3GTOC4Q7B3MRMSUTFVUQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232215128 (921h6m10.585000236s) [noise=true , address=77.90.31.21:4877 , piece_id=EUY5Q64A7NBYOTT4I5MTH3SZBEDXYJTI42W6VYOTNL4B5NMTDKNQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232343719 (921h6m10.585128817s) [noise=true , address=77.90.31.10:4517 , piece_id=73CMBGB7TGVXWGQC6IUNB54POXYMSHWYRRRV7GTXXZDF76LIAQVQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232451020 (921h6m10.585236118s) [noise=true , address=77.90.31.11:4554 , piece_id=BBSDAQ52W6Z26QH3XXEPJVW34ZSZCSFLREX44Q4TDSGOPXKA6ANA, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232590893 (921h6m10.585376001s) [noise=true , address=77.90.31.16:4735 , piece_id=VARS5MVTAXS2Y7C2IDCX7XW4Y72G574Y5SK3JN4LFDBDAJYEBU3Q, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232671273 (921h6m10.585456381s) [noise=true , address=77.90.31.18:4805 , piece_id=2B2PP4HY4ILPNQYUCJH3AZCLM2KQJHYV4QYN43OM5BJQFHM2SI4Q, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232794845 (921h6m10.585579953s) [noise=true , address=77.90.31.13:4626 , piece_id=ANQSEX2GFRGK5AHO5IFQYKXB5ABZDICBTKNY4OKOP5DUZCQYS4QA, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.233021411 (921h6m10.585806519s) [noise=true , address=77.90.31.12:4592 , piece_id=IXYLGHN3BS4KSQVM7MJDL5JBR2NGXB3HBQPS62DGJKFEMJ5EUCYQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.301739905 (921h6m10.654525013s) [upload=810623]: Next returned nil segment
Oct 6 23:14:35.301751626 (921h6m10.654536734s) [upload=810623]: Waiting for error group managing segments...
Oct 6 23:14:35.308525018 (921h6m10.661310126s) [noise=true , address=145.79.227.5:4221 , piece_id=GX5MVSFGABSJDQLNPQUNBDCKRUGHPPTRJ2Y4KTSJM3GBHDVMWSUQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.309028252 (921h6m10.66181336s) [noise=true , address=145.79.227.13:4802 , piece_id=U6QBCPLFOT7FKZER4GTZHZONSLGI32ZFKQ6YMHLMXBVT6Q3G3Q5A, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.309677310 (921h6m10.662462408s) [noise=true , address=145.79.227.14:4839 , piece_id=YGAV5O7IBCW654XHKAKGKQRQ4PIHOQYNPRKNNSI4LBZ3N2I24HDQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.309896092 (921h6m10.6626812s) [noise=true , address=145.79.227.3:4150 , piece_id=5JCRCAVAZMPJWDWBPIMMTXYESJQYHCBYZV2D5CGCAWDMD73HC26Q, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.310034271 (921h6m10.662819379s) [noise=true , address=145.79.227.17:4970 , piece_id=EQDZAIB72F2JRHKJD444PCM4AG225NFL4BFT6L74E7QSFVHDH7QQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.310195242 (921h6m10.66298034s) [noise=true , address=145.79.227.2:4113 , piece_id=3B4UQO3A2V5SDEQTEPLDVFD2GFGIIDZI3GTOC4Q7B3MRMSUTFVUQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:15:05.199595893 (921h6m40.552381001s) [noise=true , address=77.90.31.10:4517 , piece_id=73CMBGB7TGVXWGQC6IUNB54POXYMSHWYRRRV7GTXXZDF76LIAQVQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.199636880 (921h6m40.552421988s) [noise=true , address=45.91.116.12:4225 , piece_id=WXDK5FN4PP4LPW3UF6ZLBXWLIZAXLP64BWNGY2DFIKGIFNESOFLQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.199832757 (921h6m40.552617885s) [noise=true , address=77.90.31.21:4877 , piece_id=EUY5Q64A7NBYOTT4I5MTH3SZBEDXYJTI42W6VYOTNL4B5NMTDKNQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: read tcp 5.161.89.252:53308->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.199933757 (921h6m40.552718865s) [noise=true , address=77.90.31.18:4805 , piece_id=2B2PP4HY4ILPNQYUCJH3AZCLM2KQJHYV4QYN43OM5BJQFHM2SI4Q, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: read tcp 5.161.89.252:52568->77.90.31.18:4805: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.199996945 (921h6m40.552782053s) [noise=true , address=77.90.31.21:4879 , piece_id=YMGHKTOSRW6HQSEGA5Z74727YX5PI3LMGNJEU7JQDYL5UGJ2AHMQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: read tcp 5.161.89.252:8812->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200046488 (921h6m40.552831617s) [noise=true , address=77.90.31.12:4592 , piece_id=IXYLGHN3BS4KSQVM7MJDL5JBR2NGXB3HBQPS62DGJKFEMJ5EUCYQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200054824 (921h6m40.552839922s) [noise=true , address=45.91.116.9:4262 , piece_id=LZITJ3U4QUE4VQM2NUAZMPJ5SBEBSVEQW427LRKG4NTRU7KKQUQQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: read tcp 5.161.89.252:12616->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200091874 (921h6m40.552877001s) [noise=true , address=77.90.31.16:4735 , piece_id=VARS5MVTAXS2Y7C2IDCX7XW4Y72G574Y5SK3JN4LFDBDAJYEBU3Q, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:39316->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200106040 (921h6m40.552891148s) [noise=true , address=77.90.31.11:4554 , piece_id=BBSDAQ52W6Z26QH3XXEPJVW34ZSZCSFLREX44Q4TDSGOPXKA6ANA, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: rpc: dial tcp 77.90.31.11:4554: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200139673 (921h6m40.552924771s) [noise=true , address=77.90.31.13:4626 , piece_id=ANQSEX2GFRGK5AHO5IFQYKXB5ABZDICBTKNY4OKOP5DUZCQYS4QA, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: read tcp 5.161.89.252:18720->77.90.31.13:4626: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200164760 (921h6m40.552949858s) [seg_pos={0 0}, upload=810623]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil>
Oct 6 23:15:05.216712375 (921h6m40.569497483s) [upload=810623]: Done uploading segments...
Oct 6 23:15:05.216730419 (921h6m40.569515517s) [upload=810623]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6)
Duration: 575.80657ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [X...X.......................................................] duration:
388.041581ms
FAIL (2025-10-06 23:56:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 6)
======LOGS======
8s) [seg_pos={0 0}, upload=810623]: Begin upload segment...
Oct 6 23:14:35.231159887 (921h6m10.583944995s) [seg_pos={0 0}, upload=810623]: Done begin upload segment.
Oct 6 23:14:35.231177129 (921h6m10.583962237s) [noise=true , address=145.79.227.14:4839 , piece_id=YGAV5O7IBCW654XHKAKGKQRQ4PIHOQYNPRKNNSI4LBZ3N2I24HDQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231202467 (921h6m10.583987575s) [noise=true , address=145.79.227.13:4802 , piece_id=U6QBCPLFOT7FKZER4GTZHZONSLGI32ZFKQ6YMHLMXBVT6Q3G3Q5A, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231445945 (921h6m10.584231042s) [noise=true , address=77.90.31.21:4879 , piece_id=YMGHKTOSRW6HQSEGA5Z74727YX5PI3LMGNJEU7JQDYL5UGJ2AHMQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231464639 (921h6m10.584249747s) [noise=true , address=45.91.116.9:4262 , piece_id=LZITJ3U4QUE4VQM2NUAZMPJ5SBEBSVEQW427LRKG4NTRU7KKQUQQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231662370 (921h6m10.584447468s) [noise=true , address=45.91.116.12:4225 , piece_id=WXDK5FN4PP4LPW3UF6ZLBXWLIZAXLP64BWNGY2DFIKGIFNESOFLQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231680665 (921h6m10.584465773s) [noise=true , address=145.79.227.17:4970 , piece_id=EQDZAIB72F2JRHKJD444PCM4AG225NFL4BFT6L74E7QSFVHDH7QQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231888995 (921h6m10.584674093s) [noise=true , address=145.79.227.3:4150 , piece_id=5JCRCAVAZMPJWDWBPIMMTXYESJQYHCBYZV2D5CGCAWDMD73HC26Q, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.231977101 (921h6m10.584762198s) [noise=true , address=145.79.227.5:4221 , piece_id=GX5MVSFGABSJDQLNPQUNBDCKRUGHPPTRJ2Y4KTSJM3GBHDVMWSUQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232134006 (921h6m10.584919114s) [noise=true , address=145.79.227.2:4113 , piece_id=3B4UQO3A2V5SDEQTEPLDVFD2GFGIIDZI3GTOC4Q7B3MRMSUTFVUQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232215128 (921h6m10.585000236s) [noise=true , address=77.90.31.21:4877 , piece_id=EUY5Q64A7NBYOTT4I5MTH3SZBEDXYJTI42W6VYOTNL4B5NMTDKNQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232343719 (921h6m10.585128817s) [noise=true , address=77.90.31.10:4517 , piece_id=73CMBGB7TGVXWGQC6IUNB54POXYMSHWYRRRV7GTXXZDF76LIAQVQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232451020 (921h6m10.585236118s) [noise=true , address=77.90.31.11:4554 , piece_id=BBSDAQ52W6Z26QH3XXEPJVW34ZSZCSFLREX44Q4TDSGOPXKA6ANA, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232590893 (921h6m10.585376001s) [noise=true , address=77.90.31.16:4735 , piece_id=VARS5MVTAXS2Y7C2IDCX7XW4Y72G574Y5SK3JN4LFDBDAJYEBU3Q, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232671273 (921h6m10.585456381s) [noise=true , address=77.90.31.18:4805 , piece_id=2B2PP4HY4ILPNQYUCJH3AZCLM2KQJHYV4QYN43OM5BJQFHM2SI4Q, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.232794845 (921h6m10.585579953s) [noise=true , address=77.90.31.13:4626 , piece_id=ANQSEX2GFRGK5AHO5IFQYKXB5ABZDICBTKNY4OKOP5DUZCQYS4QA, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.233021411 (921h6m10.585806519s) [noise=true , address=77.90.31.12:4592 , piece_id=IXYLGHN3BS4KSQVM7MJDL5JBR2NGXB3HBQPS62DGJKFEMJ5EUCYQ, seg_pos={0 0}, upload=810623]: Uploading piece...
Oct 6 23:14:35.301739905 (921h6m10.654525013s) [upload=810623]: Next returned nil segment
Oct 6 23:14:35.301751626 (921h6m10.654536734s) [upload=810623]: Waiting for error group managing segments...
Oct 6 23:14:35.308525018 (921h6m10.661310126s) [noise=true , address=145.79.227.5:4221 , piece_id=GX5MVSFGABSJDQLNPQUNBDCKRUGHPPTRJ2Y4KTSJM3GBHDVMWSUQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.309028252 (921h6m10.66181336s) [noise=true , address=145.79.227.13:4802 , piece_id=U6QBCPLFOT7FKZER4GTZHZONSLGI32ZFKQ6YMHLMXBVT6Q3G3Q5A, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.309677310 (921h6m10.662462408s) [noise=true , address=145.79.227.14:4839 , piece_id=YGAV5O7IBCW654XHKAKGKQRQ4PIHOQYNPRKNNSI4LBZ3N2I24HDQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.309896092 (921h6m10.6626812s) [noise=true , address=145.79.227.3:4150 , piece_id=5JCRCAVAZMPJWDWBPIMMTXYESJQYHCBYZV2D5CGCAWDMD73HC26Q, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.310034271 (921h6m10.662819379s) [noise=true , address=145.79.227.17:4970 , piece_id=EQDZAIB72F2JRHKJD444PCM4AG225NFL4BFT6L74E7QSFVHDH7QQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:14:35.310195242 (921h6m10.66298034s) [noise=true , address=145.79.227.2:4113 , piece_id=3B4UQO3A2V5SDEQTEPLDVFD2GFGIIDZI3GTOC4Q7B3MRMSUTFVUQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: <nil>
Oct 6 23:15:05.199595893 (921h6m40.552381001s) [noise=true , address=77.90.31.10:4517 , piece_id=73CMBGB7TGVXWGQC6IUNB54POXYMSHWYRRRV7GTXXZDF76LIAQVQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.199636880 (921h6m40.552421988s) [noise=true , address=45.91.116.12:4225 , piece_id=WXDK5FN4PP4LPW3UF6ZLBXWLIZAXLP64BWNGY2DFIKGIFNESOFLQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.199832757 (921h6m40.552617885s) [noise=true , address=77.90.31.21:4877 , piece_id=EUY5Q64A7NBYOTT4I5MTH3SZBEDXYJTI42W6VYOTNL4B5NMTDKNQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: read tcp 5.161.89.252:53308->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.199933757 (921h6m40.552718865s) [noise=true , address=77.90.31.18:4805 , piece_id=2B2PP4HY4ILPNQYUCJH3AZCLM2KQJHYV4QYN43OM5BJQFHM2SI4Q, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: read tcp 5.161.89.252:52568->77.90.31.18:4805: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.199996945 (921h6m40.552782053s) [noise=true , address=77.90.31.21:4879 , piece_id=YMGHKTOSRW6HQSEGA5Z74727YX5PI3LMGNJEU7JQDYL5UGJ2AHMQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: read tcp 5.161.89.252:8812->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200046488 (921h6m40.552831617s) [noise=true , address=77.90.31.12:4592 , piece_id=IXYLGHN3BS4KSQVM7MJDL5JBR2NGXB3HBQPS62DGJKFEMJ5EUCYQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200054824 (921h6m40.552839922s) [noise=true , address=45.91.116.9:4262 , piece_id=LZITJ3U4QUE4VQM2NUAZMPJ5SBEBSVEQW427LRKG4NTRU7KKQUQQ, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: read tcp 5.161.89.252:12616->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200091874 (921h6m40.552877001s) [noise=true , address=77.90.31.16:4735 , piece_id=VARS5MVTAXS2Y7C2IDCX7XW4Y72G574Y5SK3JN4LFDBDAJYEBU3Q, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:39316->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200106040 (921h6m40.552891148s) [noise=true , address=77.90.31.11:4554 , piece_id=BBSDAQ52W6Z26QH3XXEPJVW34ZSZCSFLREX44Q4TDSGOPXKA6ANA, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: rpc: dial tcp 77.90.31.11:4554: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200139673 (921h6m40.552924771s) [noise=true , address=77.90.31.13:4626 , piece_id=ANQSEX2GFRGK5AHO5IFQYKXB5ABZDICBTKNY4OKOP5DUZCQYS4QA, seg_pos={0 0}, upload=810623]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: read tcp 5.161.89.252:18720->77.90.31.13:4626: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:15:05.200164760 (921h6m40.552949858s) [seg_pos={0 0}, upload=810623]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil>
Oct 6 23:15:05.216712375 (921h6m40.569497483s) [upload=810623]: Done uploading segments...
Oct 6 23:15:05.216730419 (921h6m40.569515517s) [upload=810623]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6)
Duration: 388.058643ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X...X.....................................................] duration:
386.684282ms
FAIL (2025-10-06 23:56:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 386.695564ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X........X...............................................] duration:
398.854734ms
FAIL (2025-10-06 23:56:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
27420042 (921h10m47.58020515s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227624987 (921h10m47.580410085s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227650294 (921h10m47.580435392s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227876188 (921h10m47.580661287s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.227943646 (921h10m47.580728743s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228144602 (921h10m47.58092971s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228179508 (921h10m47.580964616s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228374473 (921h10m47.581159581s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228432042 (921h10m47.581217139s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228581452 (921h10m47.58136656s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228676600 (921h10m47.581461698s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228792097 (921h10m47.581577206s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228974810 (921h10m47.581759918s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.228999326 (921h10m47.581784434s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229204211 (921h10m47.581989319s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.229215272 (921h10m47.58200038s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Uploading piece...
Oct 6 23:19:12.299081179 (921h10m47.651866277s) [upload=810691]: Next returned nil segment
Oct 6 23:19:12.299097009 (921h10m47.651882117s) [upload=810691]: Waiting for error group managing segments...
Oct 6 23:19:12.306034258 (921h10m47.658819356s) [noise=true , address=145.79.227.49:4370 , piece_id=OJGFH57JPEP3TQMZPHKZZGBXM4T5NVWLY2FASXI3HDH2NAQ42IPQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.307622568 (921h10m47.660407677s) [noise=true , address=145.79.227.23:4567 , piece_id=GYCMVSDGAVCOM4HHNZ6MV5XFXF74ROVIDBEH4T2SI6HHPGSBEKZA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.308054209 (921h10m47.660839317s) [noise=true , address=145.79.227.44:4208 , piece_id=6FULKTE3VS7CUU7XHN63GYR6DLPB2XWLCLPYYHWPONKQXQAR5PPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.316367240 (921h10m47.669152338s) [noise=true , address=145.79.227.27:4716 , piece_id=F623KX4I2W5S7L5LGBI2TKIJM5Y24FFH24BP6PUPYNRZL4TDR77A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.353623418 (921h10m47.706408517s) [noise=true , address=145.79.227.32:4840 , piece_id=5GZ3DEIWB7GZ7Y2DECGJ3PGMI6QC2QBGNJLSK7L3G2VRLQAA2GQA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.798268805 (921h10m48.151053913s) [noise=true , address=64.49.13.170:4727 , piece_id=RS5G3CGE7LP5DOW3SBBBUX3IM4HUDDLHUGXSREXVMH2ZO56UIN5A, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:19:12.819297331 (921h10m48.172082429s) [noise=true , address=64.49.13.138:4490 , piece_id=GLUHKHS4R4TOFLA42GJ6NH7L5HPLD5VIMLGGEIZOAA7D7FE3CVJQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:06.839967999 (921h11m42.192753127s) [noise=true , address=77.90.31.19:4848 , piece_id=ZX4BOHGZ6HVOBRXEYS5F6EC3N7SOB5UGH2CLI54J26TFULTTB7OQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:08.034348426 (921h11m43.387133564s) [noise=true , address=77.90.31.12:4624 , piece_id=ICL7ASYLXD4QDCT5FZ3UE5WIPBNZGGQSUAQ74MK4MERHCYIQ47MQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: <nil>
Oct 6 23:20:12.173936997 (921h11m47.526722105s) [noise=true , address=45.91.116.10:4103 , piece_id=7MWAQ2IA7FAK4NG3VZICDI4CDDLIMWWO5BRQHCCSVM3LCWQLZ5GQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:126w8AaZrrF8Y4uMP5yrGGadnMCCEiuP1s2CKg4XwkA7kPMvvS5, address:45.91.116.10:4103): protocol: rpc: dial tcp 45.91.116.10:4103: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174003862 (921h11m47.52678897s) [noise=true , address=77.90.31.18:4831 , piece_id=KHUNWJJ72OHJVVHUVGMF7FWISBJUFBJQR2WXT2TNP7EWUUPZ4XHQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA, address:77.90.31.18:4831): protocol: rpc: dial tcp 77.90.31.18:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174067181 (921h11m47.526852289s) [noise=true , address=77.90.31.11:4588 , piece_id=GWSMRI5BA67PKIIMMUB2NPBRNTVSFZEBS3SZ646NRCLCIAJ2YSPA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12H6EaBk5vQxDeccjDtyoJmuANkspKuRPCyS7qHuDn16GQPa8o6, address:77.90.31.11:4588): protocol: rpc: dial tcp 77.90.31.11:4588: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174147411 (921h11m47.526932519s) [noise=true , address=45.91.116.6:4001 , piece_id=L4LE4J4C3IXNJI4NGDPLD3M2LV72U4NO4LYRG3BZJH5TVOOFYYWA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1vQJmv9n2yWXZtCCaABrxkB3NN6vDwLdiBkRibDN3t6YNmcmGP, address:45.91.116.6:4001): protocol: rpc: dial tcp 45.91.116.6:4001: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174295850 (921h11m47.527080958s) [noise=true , address=45.91.116.14:4206 , piece_id=NAQRZQDRRPOPYPAICXJYFWESN2UYEGTMH2H4TR7JSTM3VIOHNHRQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12d12pAMGhxjtLBE1tp9yEE7NMdfh8kcvsA8abhTnM8nbBB5LEK, address:45.91.116.14:4206): protocol: rpc: dial tcp 45.91.116.14:4206: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174441473 (921h11m47.527226581s) [noise=true , address=77.90.31.14:4669 , piece_id=YZUXVZYTK76CPUTVGTN6V63SIHTIHIAKPCSXLCROPELODS4TXNOA, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:12wgv8uy7FaviWBw3H8ZS2NfJNnZ5F5PYyxxJrYaJsfGVv55Q8T, address:77.90.31.14:4669): protocol: read tcp 5.161.89.252:59908->77.90.31.14:4669: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174480827 (921h11m47.527265935s) [noise=true , address=45.91.116.7:4016 , piece_id=UHX6YREOZ7JEY54I35NIO5JQEJGJPDUKPQV6HA76LPOFME4XDVNQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1GeydXGpXPZzL65aqsaGiRQjz7NRzL9BZCUb5MEUWCAzNPMRPW, address:45.91.116.7:4016): protocol: read tcp 5.161.89.252:21556->45.91.116.7:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174537793 (921h11m47.527322901s) [noise=true , address=77.90.31.11:4559 , piece_id=R34MR6CY445YC23EWBKY2IOGJG2EUIZ62UTEMMANUPUHEZOD5M2Q, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1KER2FucoaWotduZNiFAnbFz7gotJYFofKnyQNCRvWQ8rjVDwY, address:77.90.31.11:4559): protocol: read tcp 5.161.89.252:27818->77.90.31.11:4559: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174593429 (921h11m47.527378537s) [noise=true , address=77.90.31.16:4755 , piece_id=XVJRVIFXDLQF2PKNLAOS2YWWNC52CCJCBLRYN7WAMR3DHZAEDCMQ, seg_pos={0 0}, upload=810691]: Done uploading piece. err: ecclient: upload failed (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV, address:77.90.31.16:4755): protocol: read tcp 5.161.89.252:25238->77.90.31.16:4755: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 6 23:20:12.174612024 (921h11m47.527397132s) [seg_pos={0 0}, upload=810691]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Oct 6 23:20:12.191155500 (921h11m47.543940619s) [upload=810691]: Done uploading segments...
Oct 6 23:20:12.191171450 (921h11m47.543956569s) [upload=810691]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 398.93822ms
core
uplink
us-select-1
us1-placement-20
|