Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
413.368253ms
FAIL (2025-11-05 07:40:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 413.388361ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................XX.......................................] duration:
407.621066ms
FAIL (2025-11-05 07:39:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 407.635224ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................XX......................................] duration:
473.099963ms
FAIL (2025-11-05 07:39:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 473.124449ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
442.078588ms
FAIL (2025-11-05 07:39:03 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 442.095118ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................XX.....................................] duration:
325.784145ms
FAIL (2025-11-05 07:38:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 325.801467ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................XX....................................] duration:
346.728598ms
FAIL (2025-11-05 07:38:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 346.745028ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................XX...................................] duration:
405.017521ms
FAIL (2025-11-05 07:37:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 405.039664ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
476.742508ms
FAIL (2025-11-05 07:37:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 476.752405ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................XX..................................] duration:
388.502231ms
FAIL (2025-11-05 07:37:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 388.525996ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
442.459574ms
FAIL (2025-11-05 07:36:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 442.472078ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................XX.................................] duration:
310.003733ms
FAIL (2025-11-05 07:36:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 310.024181ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
371.114729ms
FAIL (2025-11-05 07:35:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 371.129006ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................XX................................] duration:
366.335282ms
FAIL (2025-11-05 07:35:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 366.355609ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................XX...............................] duration:
320.182402ms
FAIL (2025-11-05 07:34:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 320.204946ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
380.931554ms
FAIL (2025-11-05 07:34:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 380.958184ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
385.702626ms
FAIL (2025-11-05 07:34:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 385.718466ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................XX..............................] duration:
370.196388ms
FAIL (2025-11-05 07:34:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 370.213199ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
382.405992ms
FAIL (2025-11-05 07:33:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 382.454161ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
364.715052ms
FAIL (2025-11-05 07:33:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 364.749717ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................XX.............................] duration:
328.146107ms
FAIL (2025-11-05 07:32:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 328.164733ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
390.978797ms
FAIL (2025-11-05 07:32:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 391.001139ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
357.628724ms
FAIL (2025-11-05 07:32:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 357.663008ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................XX............................] duration:
318.196837ms
FAIL (2025-11-05 07:31:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 318.223628ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
419.460905ms
FAIL (2025-11-05 07:31:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 419.477305ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................XX...........................] duration:
452.392774ms
FAIL (2025-11-05 07:30:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 452.418332ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
373.096882ms
FAIL (2025-11-05 07:30:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 373.108043ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................XX..........................] duration:
410.512654ms
FAIL (2025-11-05 07:30:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 410.536278ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
394.936574ms
FAIL (2025-11-05 07:29:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 394.953115ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................XX.........................] duration:
397.634778ms
FAIL (2025-11-05 07:29:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 397.65677ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
413.881305ms
FAIL (2025-11-05 07:29:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 413.896072ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................XX........................] duration:
385.291645ms
FAIL (2025-11-05 07:28:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 385.321943ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
386.39732ms
FAIL (2025-11-05 07:28:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 386.409433ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
386.614058ms
FAIL (2025-11-05 07:28:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 386.635708ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................XX.......................] duration:
414.407784ms
FAIL (2025-11-05 07:28:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 414.430827ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
433.240415ms
FAIL (2025-11-05 07:27:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 433.257497ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................XX......................] duration:
313.909822ms
FAIL (2025-11-05 07:27:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 313.923689ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
385.96092ms
FAIL (2025-11-05 07:27:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 385.977843ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
396.751602ms
FAIL (2025-11-05 07:26:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 396.763946ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................XX.....................] duration:
406.715759ms
FAIL (2025-11-05 07:26:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 406.73722ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
401.552623ms
FAIL (2025-11-05 07:25:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 401.577558ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................XX....................] duration:
318.478477ms
FAIL (2025-11-05 07:25:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 318.498483ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................XX...................] duration:
424.630148ms
FAIL (2025-11-05 07:24:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 424.699217ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
386.439831ms
FAIL (2025-11-05 07:24:26 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 386.476238ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
410.284236ms
FAIL (2025-11-05 07:23:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 410.29732ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................XX..................] duration:
326.972686ms
FAIL (2025-11-05 07:23:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 326.99126ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
470.575157ms
FAIL (2025-11-05 07:23:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 470.593723ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
427.436524ms
FAIL (2025-11-05 07:23:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 427.466881ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................XX.................] duration:
447.607484ms
FAIL (2025-11-05 07:22:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
5427 (211h56m15.237860312s) [seg_pos={0 0}, upload=186434]: Done begin upload segment.
Nov 5 07:09:48.536938901 (211h56m15.237883796s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.536994706 (211h56m15.237939621s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537555328 (211h56m15.238500243s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.537998670 (211h56m15.238943585s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.538767713 (211h56m15.239712628s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.539289272 (211h56m15.240234187s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.541183347 (211h56m15.242128242s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542446176 (211h56m15.243391061s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.542474459 (211h56m15.243419374s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.543615290 (211h56m15.244560175s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.544960485 (211h56m15.24590538s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547371529 (211h56m15.248316433s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.547841781 (211h56m15.248786667s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551070550 (211h56m15.252015435s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.551416740 (211h56m15.252361656s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.557183172 (211h56m15.258128067s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Uploading piece...
Nov 5 07:09:48.628024220 (211h56m15.328969105s) [upload=186434]: Next returned nil segment
Nov 5 07:09:48.628048856 (211h56m15.328993751s) [upload=186434]: Waiting for error group managing segments...
Nov 5 07:09:48.636313896 (211h56m15.337258791s) [noise=true , address=45.91.116.6:4973 , piece_id=AYZWBK477BNPYXJYG4RP4ZOSUOXKATXPF4PBFOYHDUUNRDTDWLTA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637181144 (211h56m15.338126059s) [noise=true , address=77.90.31.10:4518 , piece_id=ZCG62ODQGC3BZNNYY5VVUGICPYJLJAVM3O5QMGQVRXRQCT7S3JGA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.637433547 (211h56m15.338378443s) [noise=true , address=77.90.31.14:4662 , piece_id=DU25YHTQ5VLHDOGUYB42ABLDKE5EGDDZMVJMYAW2S7ZA2DPWLNDA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639202728 (211h56m15.340147643s) [noise=true , address=77.90.31.14:4663 , piece_id=IGDYXGXIENOM52APKVFSM5VRB2XFYUV42DC5XLAKWLEEBLTKI7PQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:09:48.639284982 (211h56m15.340229877s) [noise=true , address=77.90.31.18:4807 , piece_id=KU7YQM2MHSQ4CI7OJJIEO6S7BAZKB47Y65VIXXNOQUOP2WX5BXWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: <nil>
Nov 5 07:10:18.506183890 (211h56m45.207128775s) [noise=true , address=145.79.227.11:4732 , piece_id=Z4DZS2XKT6UUWASFODPY2TH2C5AJUYKY34VQK6ZE62ALEFSH525Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506233874 (211h56m45.207178769s) [noise=true , address=145.79.227.22:4511 , piece_id=7T3A3AMYVLYAY7XMOD7KIO3EKM3ZLJNK6BUZM36BK4M3OIMTGGIQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506292805 (211h56m45.2072377s) [noise=true , address=145.79.227.8:4329 , piece_id=BMWP3ONSCE4RD6QMHBHVCXMBA7C7AUNRTXCQE3QKIIWLQVQFBQ2Q, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: rpc: dial tcp 145.79.227.8:4329: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506360001 (211h56m45.207304896s) [noise=true , address=145.79.227.16:4911 , piece_id=RCZUTBVB2MAZJLS3ABZRB2NIHFY7IHOW5PDM32RZKVW6UVEZI4OQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:145.79.227.16:4911): protocol: rpc: dial tcp 145.79.227.16:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506387172 (211h56m45.207332057s) [noise=true , address=145.79.227.31:4799 , piece_id=XSNIMIYWDNFHQBA6QUC7CBWIBWFCAVQAWGU7TC4BYFRYYBNVFXUQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1vMQm9RufCEcHca9k1JEhyED9MfYjvZcT2MFYic3PmEKyUoC7X, address:145.79.227.31:4799): protocol: rpc: dial tcp 145.79.227.31:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506462112 (211h56m45.207407008s) [noise=true , address=145.79.227.28:4726 , piece_id=VIN7CKNY7QLRE6N4BD4HCCCIP562JKPCJS65T6JLAM3UDIOU5AWQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4, address:145.79.227.28:4726): protocol: rpc: dial tcp 145.79.227.28:4726: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506480207 (211h56m45.207425102s) [noise=true , address=145.79.227.17:4972 , piece_id=OLGT7DIRZXQIP6633JN5KYS4MLNLDLFCXRH4MBTNFD3G2VMPEYAQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX, address:145.79.227.17:4972): protocol: rpc: dial tcp 145.79.227.17:4972: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506556480 (211h56m45.207501365s) [noise=true , address=145.79.227.10:4401 , piece_id=BG3YFCVVN7YWJCXXG5SJUTJR4XX6MWB4WSY53HKT75Q5G5CKO6AQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1gYjGpNnkeFRobb7yhMnm1o9N3H13Uo1fqQrBpRad4uU4rKKm1, address:145.79.227.10:4401): protocol: rpc: dial tcp 145.79.227.10:4401: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506628455 (211h56m45.20757335s) [noise=true , address=145.79.227.15:4873 , piece_id=3HLFIEI44DIPVBJXCVZJGHYWWQCDQEBLXWLRBQLZDKIACUNY4FPA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506698967 (211h56m45.207643862s) [noise=true , address=145.79.227.30:4762 , piece_id=OCEK43QHXUZZE2ROPYLNQ6SKITW7NTIDZQJZL6DYQBBGTFWVDLJQ, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: rpc: dial tcp 145.79.227.30:4762: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506715748 (211h56m45.207660633s) [noise=true , address=145.79.227.21:4474 , piece_id=OMMWGGUJEYCQUKXS7CXIJYSVQVVFWHLHQKABFTEAMEOKN7YRYBWA, seg_pos={0 0}, upload=186434]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 07:10:18.506736387 (211h56m45.207681282s) [seg_pos={0 0}, upload=186434]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Nov 5 07:10:18.550795347 (211h56m45.251740242s) [upload=186434]: Done uploading segments...
Nov 5 07:10:18.550815294 (211h56m45.25176018s) [upload=186434]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 447.629175ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
412.890549ms
FAIL (2025-11-05 07:22:28 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 412.907582ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
378.707831ms
FAIL (2025-11-05 07:22:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 378.722048ms
edge
gateway
us-select-1
|