Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
287.736635ms
FAIL (2025-11-05 09:49:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 287.747955ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
252.001708ms
FAIL (2025-11-05 09:48:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 252.02381ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
304.615414ms
FAIL (2025-11-05 09:47:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 304.643395ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
244.87159ms
FAIL (2025-11-05 09:46:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 244.887139ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
224.850758ms
FAIL (2025-11-05 09:45:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 224.868101ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
275.06956ms
FAIL (2025-11-05 09:45:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 275.087794ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
235.57834ms
FAIL (2025-11-05 09:44:26 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 235.741386ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
261.158084ms
FAIL (2025-11-05 09:43:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 261.188992ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
270.340324ms
FAIL (2025-11-05 09:42:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 270.353459ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
243.3369ms
FAIL (2025-11-05 09:42:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 243.357197ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
258.211282ms
FAIL (2025-11-05 09:41:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 258.24824ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
277.744177ms
FAIL (2025-11-05 09:40:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 277.774194ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
241.018812ms
FAIL (2025-11-05 09:39:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 241.034741ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
187.281708ms
FAIL (2025-11-05 09:38:26 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 187.337764ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
251.615047ms
FAIL (2025-11-05 09:37:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 251.634573ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000673471s
FAIL (2025-11-05 09:36:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.000685755s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
399.602869ms
FAIL (2025-11-05 07:53:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 399.61984ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
385.48779ms
FAIL (2025-11-05 07:53:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 385.506284ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................] duration:
393.689322ms
FAIL (2025-11-05 07:52:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 393.7096ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
428.398253ms
FAIL (2025-11-05 07:51:37 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 428.426857ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..XX........................................................] duration:
439.716364ms
FAIL (2025-11-05 07:51:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 439.737443ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
417.073302ms
FAIL (2025-11-05 07:50:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 417.15748ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...XX.......................................................] duration:
406.644624ms
FAIL (2025-11-05 07:50:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 406.666074ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....XX......................................................] duration:
349.198271ms
FAIL (2025-11-05 07:50:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 349.220583ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
402.719276ms
FAIL (2025-11-05 07:49:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 402.779851ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration:
434.050321ms
FAIL (2025-11-05 07:49:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 434.07044ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
392.72253ms
FAIL (2025-11-05 07:48:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 392.785928ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
370.791362ms
FAIL (2025-11-05 07:48:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 370.804287ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......XX....................................................] duration:
446.329895ms
FAIL (2025-11-05 07:48:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 446.343782ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......XX...................................................] duration:
373.520132ms
FAIL (2025-11-05 07:48:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 373.53996ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........XX..................................................] duration:
350.293106ms
FAIL (2025-11-05 07:47:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 350.312272ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
360.483941ms
FAIL (2025-11-05 07:47:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 360.500431ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........XX.................................................] duration:
291.456216ms
FAIL (2025-11-05 07:47:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 291.472066ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........XX................................................] duration:
362.084225ms
FAIL (2025-11-05 07:46:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 362.108852ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
384.250571ms
FAIL (2025-11-05 07:46:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 384.264136ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
457.934513ms
FAIL (2025-11-05 07:46:26 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 457.95401ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........XX...............................................] duration:
321.963565ms
FAIL (2025-11-05 07:45:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 321.988212ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
394.03918ms
FAIL (2025-11-05 07:45:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 394.057815ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [............XX..............................................] duration:
412.409945ms
FAIL (2025-11-05 07:45:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 412.433858ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
388.257ms
FAIL (2025-11-05 07:44:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 388.272549ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............XX.............................................] duration:
310.0929ms
FAIL (2025-11-05 07:44:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 310.135321ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............XX............................................] duration:
434.244698ms
FAIL (2025-11-05 07:43:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 434.261269ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
434.766478ms
FAIL (2025-11-05 07:43:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 434.784893ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............XX...........................................] duration:
370.880243ms
FAIL (2025-11-05 07:43:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 370.902333ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
427.170412ms
FAIL (2025-11-05 07:42:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 427.191221ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [................XX..........................................] duration:
299.902197ms
FAIL (2025-11-05 07:42:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 299.918847ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
383.119929ms
FAIL (2025-11-05 07:41:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 383.139536ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................XX.........................................] duration:
339.853305ms
FAIL (2025-11-05 07:41:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 339.880156ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
399.343673ms
FAIL (2025-11-05 07:40:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 399.358271ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................XX........................................] duration:
400.25205ms
FAIL (2025-11-05 07:40:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 400.269622ms
core
uplink
us-select-1
|