Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [................X...........................X...X.......X...] duration: 494.024363ms FAIL (2025-08-20 21:45:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 21:43:04.984773961 (292h16m45.716041591s) [upload=303913]: Starting upload Aug 20 21:43:04.984815389 (292h16m45.716083009s) [upload=303913]: Done starting upload Aug 20 21:43:04.984921399 (292h16m45.716189019s) [upload=303913]: Uploading segments... Aug 20 21:43:04.985034380 (292h16m45.716302s) [upload=303913]: Got next segment. Inline: false Aug 20 21:43:04.985061772 (292h16m45.716329402s) [upload=303913]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 20 21:43:04.985065379 (292h16m45.716333009s) [upload=303913]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 20 21:43:04.987320367 (292h16m45.718587997s) [upload=303913]: Next segment err: metaclient: Too Many Requests Aug 20 21:43:04.987334443 (292h16m45.718602093s) [upload=303913]: Done uploading segments... Aug 20 21:43:04.987347518 (292h16m45.718615148s) [upload=303913]: Upload finished. err: metaclient: Too Many Requests Duration: 494.050943ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 651.400484ms FAIL (2025-08-20 21:45:16 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 651.448372ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 216.314445ms FAIL (2025-08-20 21:44:59 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 216.337138ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................X...........................X...X.......X..] duration: 1.526571831s FAIL (2025-08-20 21:44:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 21:43:04.984773961 (292h16m45.716041591s) [upload=303913]: Starting upload Aug 20 21:43:04.984815389 (292h16m45.716083009s) [upload=303913]: Done starting upload Aug 20 21:43:04.984921399 (292h16m45.716189019s) [upload=303913]: Uploading segments... Aug 20 21:43:04.985034380 (292h16m45.716302s) [upload=303913]: Got next segment. Inline: false Aug 20 21:43:04.985061772 (292h16m45.716329402s) [upload=303913]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 20 21:43:04.985065379 (292h16m45.716333009s) [upload=303913]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 20 21:43:04.987320367 (292h16m45.718587997s) [upload=303913]: Next segment err: metaclient: Too Many Requests Aug 20 21:43:04.987334443 (292h16m45.718602093s) [upload=303913]: Done uploading segments... Aug 20 21:43:04.987347518 (292h16m45.718615148s) [upload=303913]: Upload finished. err: metaclient: Too Many Requests Duration: 1.526591458s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 397.80062ms FAIL (2025-08-20 21:44:03 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 397.813945ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..................X...........................X...X.......X.] duration: 1.959544227s FAIL (2025-08-20 21:44:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 21:43:04.984773961 (292h16m45.716041591s) [upload=303913]: Starting upload Aug 20 21:43:04.984815389 (292h16m45.716083009s) [upload=303913]: Done starting upload Aug 20 21:43:04.984921399 (292h16m45.716189019s) [upload=303913]: Uploading segments... Aug 20 21:43:04.985034380 (292h16m45.716302s) [upload=303913]: Got next segment. Inline: false Aug 20 21:43:04.985061772 (292h16m45.716329402s) [upload=303913]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 20 21:43:04.985065379 (292h16m45.716333009s) [upload=303913]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 20 21:43:04.987320367 (292h16m45.718587997s) [upload=303913]: Next segment err: metaclient: Too Many Requests Aug 20 21:43:04.987334443 (292h16m45.718602093s) [upload=303913]: Done uploading segments... Aug 20 21:43:04.987347518 (292h16m45.718615148s) [upload=303913]: Upload finished. err: metaclient: Too Many Requests Duration: 1.959563633s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 167.027397ms FAIL (2025-08-20 21:43:51 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 167.051782ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 320.088575ms FAIL (2025-08-20 21:43:20 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 320.134071ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...................X...........................X...X.......X] duration: 16.491631ms FAIL (2025-08-20 21:43:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 21:43:04.984773961 (292h16m45.716041591s) [upload=303913]: Starting upload Aug 20 21:43:04.984815389 (292h16m45.716083009s) [upload=303913]: Done starting upload Aug 20 21:43:04.984921399 (292h16m45.716189019s) [upload=303913]: Uploading segments... Aug 20 21:43:04.985034380 (292h16m45.716302s) [upload=303913]: Got next segment. Inline: false Aug 20 21:43:04.985061772 (292h16m45.716329402s) [upload=303913]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 20 21:43:04.985065379 (292h16m45.716333009s) [upload=303913]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 20 21:43:04.987320367 (292h16m45.718587997s) [upload=303913]: Next segment err: metaclient: Too Many Requests Aug 20 21:43:04.987334443 (292h16m45.718602093s) [upload=303913]: Done uploading segments... Aug 20 21:43:04.987347518 (292h16m45.718615148s) [upload=303913]: Upload finished. err: metaclient: Too Many Requests Duration: 16.512621ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 199.079517ms FAIL (2025-08-20 21:42:57 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 199.099825ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 417.421174ms FAIL (2025-08-20 21:42:44 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 417.441603ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 290.70535ms FAIL (2025-08-20 21:42:07 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 290.73277ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................X...........................X...X.......] duration: 1.30836848s FAIL (2025-08-20 21:42:00 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 20 21:37:09.636593435 (292h10m50.367861085s) [upload=303808]: Starting upload Aug 20 21:37:09.636653198 (292h10m50.367920847s) [upload=303808]: Done starting upload Aug 20 21:37:09.636753336 (292h10m50.368020996s) [upload=303808]: Uploading segments... Aug 20 21:37:09.637182232 (292h10m50.368449942s) [upload=303808]: Got next segment. Inline: false Aug 20 21:37:09.637250320 (292h10m50.36851797s) [upload=303808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 20 21:37:09.637259017 (292h10m50.368526697s) [upload=303808]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 20 21:37:09.665336609 (292h10m50.396604259s) [seg_pos={0 0}, upload=303808]: Begin upload segment... Aug 20 21:37:09.665405298 (292h10m50.396672948s) [seg_pos={0 0}, upload=303808]: Done begin upload segment. Aug 20 21:37:09.665449631 (292h10m50.396717281s) [noise=true , address=77.90.31.19:4857 , piece_id=35T4SGOZJOLSII7E4FHY7ZRTRFIDARU7XXOZU37JKVHJCPJSG32Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.665464088 (292h10m50.396731738s) [noise=true , address=45.91.116.7:4034 , piece_id=WBYA32MRBLGGSARZ6NMFFTVGQWEJKS5ZBFHKDN44JZM6MDCYYN3Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.665915878 (292h10m50.397183527s) [noise=true , address=45.91.116.13:4158 , piece_id=E6YFRFN2RQGQ36RTH47TY4GPKNMBNX6MW6KTBUOT4MWA2DAUVMZQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666053176 (292h10m50.397320826s) [noise=true , address=45.91.116.11:4137 , piece_id=K5AJVLK3HM5GY6CUYAUNCNSNVTC5EVCL3ENBD4S7ENBRKJLMDYQA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666291714 (292h10m50.397559365s) [noise=true , address=77.90.31.16:4742 , piece_id=OUS76BQH6H6M6UPIFJWJNHJ5ORNHERZMRRYO47PPWY5O7CTW4SNA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666575257 (292h10m50.397842917s) [noise=true , address=77.90.31.15:4716 , piece_id=VXCGNR6ZE5EV5HPENW6IV7WEGSUJNOLZUGLZ77Q6X4HLEA6R2YPA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666633165 (292h10m50.397900816s) [noise=true , address=104.36.82.35:4604 , piece_id=3XCW633LNRPSU6R3QNBJGXK32WP6QFW56ZZ6ELB2KZNT4OUFL73A, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666989635 (292h10m50.398257286s) [noise=true , address=104.36.82.51:4081 , piece_id=YJWSUTEX2PWCCNTB55BCKOG7N54ZLS4FBRNMKRIZGSBVTLRUMBHQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.667135670 (292h10m50.39840332s) [noise=true , address=77.90.31.10:4548 , piece_id=EZZNIDRZKSM77GNXKCXGCLX4YNSGX2Z2LBOMOQQ3RZYU7PSIKICQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.667733994 (292h10m50.399001635s) [noise=true , address=104.36.82.40:4971 , piece_id=4W76WZ62OT45S7I7FLH7NWCQVCYYE2AWD5OVQA4JUIJD7AM3FUOA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.668397070 (292h10m50.39966478s) [noise=true , address=45.91.116.6:4987 , piece_id=FIUC5YIKRZGGQH7TLGJ2N5LJ5YHTNYETDJZGD2RZHQCITYBYDORA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.668910936 (292h10m50.400178576s) [noise=true , address=77.90.31.18:4811 , piece_id=GATLUREPOZCE6F2FJ3RXRUBLXKGIW44QCYU37RW2CF2QWXYCGMYQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.669323512 (292h10m50.400591162s) [noise=true , address=45.91.116.5:4315 , piece_id=UESB4LHFHNRU2LZLYFDXVKAICW3WEG2WHVNTH2WTXMF4DVEPZ2YQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.669753800 (292h10m50.40102145s) [noise=true , address=104.36.82.15:4272 , piece_id=REOMI6Z6RQYCGKAUOUVC5RQMKPZTJW7YWUXVWQSR5UOU5GI2EEZQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670089471 (292h10m50.401357121s) [noise=true , address=77.90.31.21:4881 , piece_id=XWIHQ3IZZDNAJJS3CISNSTIOKVOVOMZYXH7F4GLQGN2ZWD343AVQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670544656 (292h10m50.401812306s) [noise=true , address=45.91.116.4:4961 , piece_id=YWSHG7EWRLELH6Y7HETYGCJ7CG46IBIH2PUL753AXOAH4UQY7F4Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670938015 (292h10m50.402205666s) [noise=true , address=45.91.116.12:4245 , piece_id=I4FY6SZTKNF6YFK2N4RHFAX6Q42L5SQ3DDPH5FLGL2YW72W7DOMQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.671340090 (292h10m50.402607741s) [noise=true , address=104.36.82.39:4743 , piece_id=LCEJ3OJBFVFRSW6BKXLCDODZSXOUYGAF3HNHDRKV3BTWXFC6CEYQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.786342191 (292h10m50.517609821s) [upload=303808]: Next returned nil segment Aug 20 21:37:09.786354274 (292h10m50.517621905s) [upload=303808]: Waiting for error group managing segments... Aug 20 21:37:09.796139942 (292h10m50.527407562s) [noise=true , address=45.91.116.13:4158 , piece_id=E6YFRFN2RQGQ36RTH47TY4GPKNMBNX6MW6KTBUOT4MWA2DAUVMZQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.798993265 (292h10m50.530260895s) [noise=true , address=45.91.116.4:4961 , piece_id=YWSHG7EWRLELH6Y7HETYGCJ7CG46IBIH2PUL753AXOAH4UQY7F4Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.799321912 (292h10m50.530589532s) [noise=true , address=104.36.82.39:4743 , piece_id=LCEJ3OJBFVFRSW6BKXLCDODZSXOUYGAF3HNHDRKV3BTWXFC6CEYQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.799790192 (292h10m50.531057822s) [noise=true , address=77.90.31.19:4857 , piece_id=35T4SGOZJOLSII7E4FHY7ZRTRFIDARU7XXOZU37JKVHJCPJSG32Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.801795931 (292h10m50.533063551s) [noise=true , address=104.36.82.51:4081 , piece_id=YJWSUTEX2PWCCNTB55BCKOG7N54ZLS4FBRNMKRIZGSBVTLRUMBHQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.804906016 (292h10m50.536173646s) [noise=true , address=45.91.116.11:4137 , piece_id=K5AJVLK3HM5GY6CUYAUNCNSNVTC5EVCL3ENBD4S7ENBRKJLMDYQA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.807465596 (292h10m50.538733216s) [noise=true , address=45.91.116.6:4987 , piece_id=FIUC5YIKRZGGQH7TLGJ2N5LJ5YHTNYETDJZGD2RZHQCITYBYDORA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.807957671 (292h10m50.53922529s) [noise=true , address=45.91.116.7:4034 , piece_id=WBYA32MRBLGGSARZ6NMFFTVGQWEJKS5ZBFHKDN44JZM6MDCYYN3Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.812102068 (292h10m50.543369698s) [noise=true , address=45.91.116.5:4315 , piece_id=UESB4LHFHNRU2LZLYFDXVKAICW3WEG2WHVNTH2WTXMF4DVEPZ2YQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.812796804 (292h10m50.544064424s) [noise=true , address=45.91.116.12:4245 , piece_id=I4FY6SZTKNF6YFK2N4RHFAX6Q42L5SQ3DDPH5FLGL2YW72W7DOMQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.813134078 (292h10m50.544401697s) [noise=true , address=104.36.82.15:4272 , piece_id=REOMI6Z6RQYCGKAUOUVC5RQMKPZTJW7YWUXVWQSR5UOU5GI2EEZQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.828079833 (292h10m50.559347454s) [noise=true , address=104.36.82.40:4971 , piece_id=4W76WZ62OT45S7I7FLH7NWCQVCYYE2AWD5OVQA4JUIJD7AM3FUOA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.834761841 (292h10m50.56602946s) [noise=true , address=77.90.31.21:4881 , piece_id=XWIHQ3IZZDNAJJS3CISNSTIOKVOVOMZYXH7F4GLQGN2ZWD343AVQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.836488866 (292h10m50.567756496s) [noise=true , address=77.90.31.15:4716 , piece_id=VXCGNR6ZE5EV5HPENW6IV7WEGSUJNOLZUGLZ77Q6X4HLEA6R2YPA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.836506549 (292h10m50.567774179s) [seg_pos={0 0}, upload=303808]: Segment reached optimal threshold of 14 pieces. Aug 20 21:37:09.836622287 (292h10m50.567889917s) [noise=true , address=77.90.31.16:4742 , piece_id=OUS76BQH6H6M6UPIFJWJNHJ5ORNHERZMRRYO47PPWY5O7CTW4SNA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836653606 (292h10m50.567921236s) [noise=true , address=77.90.31.10:4548 , piece_id=EZZNIDRZKSM77GNXKCXGCLX4YNSGX2Z2LBOMOQQ3RZYU7PSIKICQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836740098 (292h10m50.568007728s) [noise=true , address=77.90.31.18:4811 , piece_id=GATLUREPOZCE6F2FJ3RXRUBLXKGIW44QCYU37RW2CF2QWXYCGMYQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AZxy9wnMgVu2PdFNtFrShYhWfF6PL4mgWumjqVk68voKsnMk6): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836745187 (292h10m50.568012817s) [noise=true , address=104.36.82.35:4604 , piece_id=3XCW633LNRPSU6R3QNBJGXK32WP6QFW56ZZ6ELB2KZNT4OUFL73A, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836766718 (292h10m50.568034338s) [seg_pos={0 0}, upload=303808]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 20 21:37:09.836835627 (292h10m50.568103247s) [upload=303808]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 20 21:37:09.836839785 (292h10m50.568107405s) [upload=303808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 20 21:37:10.058695062 (292h10m50.789962712s) [upload=303808]: Done uploading segments... Aug 20 21:37:10.058720261 (292h10m50.78998792s) [upload=303808]: Upload finished. err: <nil> Duration: 1.308435096s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 793.626498ms FAIL (2025-08-20 21:41:50 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 793.649411ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 290.303908ms FAIL (2025-08-20 21:41:10 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 290.324927ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................X...........................X...X......] duration: 735.03234ms FAIL (2025-08-20 21:41:01 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 20 21:37:09.636593435 (292h10m50.367861085s) [upload=303808]: Starting upload Aug 20 21:37:09.636653198 (292h10m50.367920847s) [upload=303808]: Done starting upload Aug 20 21:37:09.636753336 (292h10m50.368020996s) [upload=303808]: Uploading segments... Aug 20 21:37:09.637182232 (292h10m50.368449942s) [upload=303808]: Got next segment. Inline: false Aug 20 21:37:09.637250320 (292h10m50.36851797s) [upload=303808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 20 21:37:09.637259017 (292h10m50.368526697s) [upload=303808]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 20 21:37:09.665336609 (292h10m50.396604259s) [seg_pos={0 0}, upload=303808]: Begin upload segment... Aug 20 21:37:09.665405298 (292h10m50.396672948s) [seg_pos={0 0}, upload=303808]: Done begin upload segment. Aug 20 21:37:09.665449631 (292h10m50.396717281s) [noise=true , address=77.90.31.19:4857 , piece_id=35T4SGOZJOLSII7E4FHY7ZRTRFIDARU7XXOZU37JKVHJCPJSG32Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.665464088 (292h10m50.396731738s) [noise=true , address=45.91.116.7:4034 , piece_id=WBYA32MRBLGGSARZ6NMFFTVGQWEJKS5ZBFHKDN44JZM6MDCYYN3Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.665915878 (292h10m50.397183527s) [noise=true , address=45.91.116.13:4158 , piece_id=E6YFRFN2RQGQ36RTH47TY4GPKNMBNX6MW6KTBUOT4MWA2DAUVMZQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666053176 (292h10m50.397320826s) [noise=true , address=45.91.116.11:4137 , piece_id=K5AJVLK3HM5GY6CUYAUNCNSNVTC5EVCL3ENBD4S7ENBRKJLMDYQA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666291714 (292h10m50.397559365s) [noise=true , address=77.90.31.16:4742 , piece_id=OUS76BQH6H6M6UPIFJWJNHJ5ORNHERZMRRYO47PPWY5O7CTW4SNA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666575257 (292h10m50.397842917s) [noise=true , address=77.90.31.15:4716 , piece_id=VXCGNR6ZE5EV5HPENW6IV7WEGSUJNOLZUGLZ77Q6X4HLEA6R2YPA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666633165 (292h10m50.397900816s) [noise=true , address=104.36.82.35:4604 , piece_id=3XCW633LNRPSU6R3QNBJGXK32WP6QFW56ZZ6ELB2KZNT4OUFL73A, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666989635 (292h10m50.398257286s) [noise=true , address=104.36.82.51:4081 , piece_id=YJWSUTEX2PWCCNTB55BCKOG7N54ZLS4FBRNMKRIZGSBVTLRUMBHQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.667135670 (292h10m50.39840332s) [noise=true , address=77.90.31.10:4548 , piece_id=EZZNIDRZKSM77GNXKCXGCLX4YNSGX2Z2LBOMOQQ3RZYU7PSIKICQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.667733994 (292h10m50.399001635s) [noise=true , address=104.36.82.40:4971 , piece_id=4W76WZ62OT45S7I7FLH7NWCQVCYYE2AWD5OVQA4JUIJD7AM3FUOA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.668397070 (292h10m50.39966478s) [noise=true , address=45.91.116.6:4987 , piece_id=FIUC5YIKRZGGQH7TLGJ2N5LJ5YHTNYETDJZGD2RZHQCITYBYDORA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.668910936 (292h10m50.400178576s) [noise=true , address=77.90.31.18:4811 , piece_id=GATLUREPOZCE6F2FJ3RXRUBLXKGIW44QCYU37RW2CF2QWXYCGMYQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.669323512 (292h10m50.400591162s) [noise=true , address=45.91.116.5:4315 , piece_id=UESB4LHFHNRU2LZLYFDXVKAICW3WEG2WHVNTH2WTXMF4DVEPZ2YQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.669753800 (292h10m50.40102145s) [noise=true , address=104.36.82.15:4272 , piece_id=REOMI6Z6RQYCGKAUOUVC5RQMKPZTJW7YWUXVWQSR5UOU5GI2EEZQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670089471 (292h10m50.401357121s) [noise=true , address=77.90.31.21:4881 , piece_id=XWIHQ3IZZDNAJJS3CISNSTIOKVOVOMZYXH7F4GLQGN2ZWD343AVQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670544656 (292h10m50.401812306s) [noise=true , address=45.91.116.4:4961 , piece_id=YWSHG7EWRLELH6Y7HETYGCJ7CG46IBIH2PUL753AXOAH4UQY7F4Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670938015 (292h10m50.402205666s) [noise=true , address=45.91.116.12:4245 , piece_id=I4FY6SZTKNF6YFK2N4RHFAX6Q42L5SQ3DDPH5FLGL2YW72W7DOMQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.671340090 (292h10m50.402607741s) [noise=true , address=104.36.82.39:4743 , piece_id=LCEJ3OJBFVFRSW6BKXLCDODZSXOUYGAF3HNHDRKV3BTWXFC6CEYQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.786342191 (292h10m50.517609821s) [upload=303808]: Next returned nil segment Aug 20 21:37:09.786354274 (292h10m50.517621905s) [upload=303808]: Waiting for error group managing segments... Aug 20 21:37:09.796139942 (292h10m50.527407562s) [noise=true , address=45.91.116.13:4158 , piece_id=E6YFRFN2RQGQ36RTH47TY4GPKNMBNX6MW6KTBUOT4MWA2DAUVMZQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.798993265 (292h10m50.530260895s) [noise=true , address=45.91.116.4:4961 , piece_id=YWSHG7EWRLELH6Y7HETYGCJ7CG46IBIH2PUL753AXOAH4UQY7F4Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.799321912 (292h10m50.530589532s) [noise=true , address=104.36.82.39:4743 , piece_id=LCEJ3OJBFVFRSW6BKXLCDODZSXOUYGAF3HNHDRKV3BTWXFC6CEYQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.799790192 (292h10m50.531057822s) [noise=true , address=77.90.31.19:4857 , piece_id=35T4SGOZJOLSII7E4FHY7ZRTRFIDARU7XXOZU37JKVHJCPJSG32Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.801795931 (292h10m50.533063551s) [noise=true , address=104.36.82.51:4081 , piece_id=YJWSUTEX2PWCCNTB55BCKOG7N54ZLS4FBRNMKRIZGSBVTLRUMBHQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.804906016 (292h10m50.536173646s) [noise=true , address=45.91.116.11:4137 , piece_id=K5AJVLK3HM5GY6CUYAUNCNSNVTC5EVCL3ENBD4S7ENBRKJLMDYQA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.807465596 (292h10m50.538733216s) [noise=true , address=45.91.116.6:4987 , piece_id=FIUC5YIKRZGGQH7TLGJ2N5LJ5YHTNYETDJZGD2RZHQCITYBYDORA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.807957671 (292h10m50.53922529s) [noise=true , address=45.91.116.7:4034 , piece_id=WBYA32MRBLGGSARZ6NMFFTVGQWEJKS5ZBFHKDN44JZM6MDCYYN3Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.812102068 (292h10m50.543369698s) [noise=true , address=45.91.116.5:4315 , piece_id=UESB4LHFHNRU2LZLYFDXVKAICW3WEG2WHVNTH2WTXMF4DVEPZ2YQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.812796804 (292h10m50.544064424s) [noise=true , address=45.91.116.12:4245 , piece_id=I4FY6SZTKNF6YFK2N4RHFAX6Q42L5SQ3DDPH5FLGL2YW72W7DOMQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.813134078 (292h10m50.544401697s) [noise=true , address=104.36.82.15:4272 , piece_id=REOMI6Z6RQYCGKAUOUVC5RQMKPZTJW7YWUXVWQSR5UOU5GI2EEZQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.828079833 (292h10m50.559347454s) [noise=true , address=104.36.82.40:4971 , piece_id=4W76WZ62OT45S7I7FLH7NWCQVCYYE2AWD5OVQA4JUIJD7AM3FUOA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.834761841 (292h10m50.56602946s) [noise=true , address=77.90.31.21:4881 , piece_id=XWIHQ3IZZDNAJJS3CISNSTIOKVOVOMZYXH7F4GLQGN2ZWD343AVQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.836488866 (292h10m50.567756496s) [noise=true , address=77.90.31.15:4716 , piece_id=VXCGNR6ZE5EV5HPENW6IV7WEGSUJNOLZUGLZ77Q6X4HLEA6R2YPA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.836506549 (292h10m50.567774179s) [seg_pos={0 0}, upload=303808]: Segment reached optimal threshold of 14 pieces. Aug 20 21:37:09.836622287 (292h10m50.567889917s) [noise=true , address=77.90.31.16:4742 , piece_id=OUS76BQH6H6M6UPIFJWJNHJ5ORNHERZMRRYO47PPWY5O7CTW4SNA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836653606 (292h10m50.567921236s) [noise=true , address=77.90.31.10:4548 , piece_id=EZZNIDRZKSM77GNXKCXGCLX4YNSGX2Z2LBOMOQQ3RZYU7PSIKICQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836740098 (292h10m50.568007728s) [noise=true , address=77.90.31.18:4811 , piece_id=GATLUREPOZCE6F2FJ3RXRUBLXKGIW44QCYU37RW2CF2QWXYCGMYQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AZxy9wnMgVu2PdFNtFrShYhWfF6PL4mgWumjqVk68voKsnMk6): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836745187 (292h10m50.568012817s) [noise=true , address=104.36.82.35:4604 , piece_id=3XCW633LNRPSU6R3QNBJGXK32WP6QFW56ZZ6ELB2KZNT4OUFL73A, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836766718 (292h10m50.568034338s) [seg_pos={0 0}, upload=303808]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 20 21:37:09.836835627 (292h10m50.568103247s) [upload=303808]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 20 21:37:09.836839785 (292h10m50.568107405s) [upload=303808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 20 21:37:10.058695062 (292h10m50.789962712s) [upload=303808]: Done uploading segments... Aug 20 21:37:10.058720261 (292h10m50.78998792s) [upload=303808]: Upload finished. err: <nil> Duration: 735.054121ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 638.743998ms FAIL (2025-08-20 21:40:52 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 638.764187ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 386.607929ms FAIL (2025-08-20 21:40:27 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 386.623408ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................X...........................X...X.....] duration: 491.260731ms FAIL (2025-08-20 21:40:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 20 21:37:09.636593435 (292h10m50.367861085s) [upload=303808]: Starting upload Aug 20 21:37:09.636653198 (292h10m50.367920847s) [upload=303808]: Done starting upload Aug 20 21:37:09.636753336 (292h10m50.368020996s) [upload=303808]: Uploading segments... Aug 20 21:37:09.637182232 (292h10m50.368449942s) [upload=303808]: Got next segment. Inline: false Aug 20 21:37:09.637250320 (292h10m50.36851797s) [upload=303808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 20 21:37:09.637259017 (292h10m50.368526697s) [upload=303808]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 20 21:37:09.665336609 (292h10m50.396604259s) [seg_pos={0 0}, upload=303808]: Begin upload segment... Aug 20 21:37:09.665405298 (292h10m50.396672948s) [seg_pos={0 0}, upload=303808]: Done begin upload segment. Aug 20 21:37:09.665449631 (292h10m50.396717281s) [noise=true , address=77.90.31.19:4857 , piece_id=35T4SGOZJOLSII7E4FHY7ZRTRFIDARU7XXOZU37JKVHJCPJSG32Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.665464088 (292h10m50.396731738s) [noise=true , address=45.91.116.7:4034 , piece_id=WBYA32MRBLGGSARZ6NMFFTVGQWEJKS5ZBFHKDN44JZM6MDCYYN3Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.665915878 (292h10m50.397183527s) [noise=true , address=45.91.116.13:4158 , piece_id=E6YFRFN2RQGQ36RTH47TY4GPKNMBNX6MW6KTBUOT4MWA2DAUVMZQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666053176 (292h10m50.397320826s) [noise=true , address=45.91.116.11:4137 , piece_id=K5AJVLK3HM5GY6CUYAUNCNSNVTC5EVCL3ENBD4S7ENBRKJLMDYQA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666291714 (292h10m50.397559365s) [noise=true , address=77.90.31.16:4742 , piece_id=OUS76BQH6H6M6UPIFJWJNHJ5ORNHERZMRRYO47PPWY5O7CTW4SNA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666575257 (292h10m50.397842917s) [noise=true , address=77.90.31.15:4716 , piece_id=VXCGNR6ZE5EV5HPENW6IV7WEGSUJNOLZUGLZ77Q6X4HLEA6R2YPA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666633165 (292h10m50.397900816s) [noise=true , address=104.36.82.35:4604 , piece_id=3XCW633LNRPSU6R3QNBJGXK32WP6QFW56ZZ6ELB2KZNT4OUFL73A, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666989635 (292h10m50.398257286s) [noise=true , address=104.36.82.51:4081 , piece_id=YJWSUTEX2PWCCNTB55BCKOG7N54ZLS4FBRNMKRIZGSBVTLRUMBHQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.667135670 (292h10m50.39840332s) [noise=true , address=77.90.31.10:4548 , piece_id=EZZNIDRZKSM77GNXKCXGCLX4YNSGX2Z2LBOMOQQ3RZYU7PSIKICQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.667733994 (292h10m50.399001635s) [noise=true , address=104.36.82.40:4971 , piece_id=4W76WZ62OT45S7I7FLH7NWCQVCYYE2AWD5OVQA4JUIJD7AM3FUOA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.668397070 (292h10m50.39966478s) [noise=true , address=45.91.116.6:4987 , piece_id=FIUC5YIKRZGGQH7TLGJ2N5LJ5YHTNYETDJZGD2RZHQCITYBYDORA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.668910936 (292h10m50.400178576s) [noise=true , address=77.90.31.18:4811 , piece_id=GATLUREPOZCE6F2FJ3RXRUBLXKGIW44QCYU37RW2CF2QWXYCGMYQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.669323512 (292h10m50.400591162s) [noise=true , address=45.91.116.5:4315 , piece_id=UESB4LHFHNRU2LZLYFDXVKAICW3WEG2WHVNTH2WTXMF4DVEPZ2YQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.669753800 (292h10m50.40102145s) [noise=true , address=104.36.82.15:4272 , piece_id=REOMI6Z6RQYCGKAUOUVC5RQMKPZTJW7YWUXVWQSR5UOU5GI2EEZQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670089471 (292h10m50.401357121s) [noise=true , address=77.90.31.21:4881 , piece_id=XWIHQ3IZZDNAJJS3CISNSTIOKVOVOMZYXH7F4GLQGN2ZWD343AVQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670544656 (292h10m50.401812306s) [noise=true , address=45.91.116.4:4961 , piece_id=YWSHG7EWRLELH6Y7HETYGCJ7CG46IBIH2PUL753AXOAH4UQY7F4Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670938015 (292h10m50.402205666s) [noise=true , address=45.91.116.12:4245 , piece_id=I4FY6SZTKNF6YFK2N4RHFAX6Q42L5SQ3DDPH5FLGL2YW72W7DOMQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.671340090 (292h10m50.402607741s) [noise=true , address=104.36.82.39:4743 , piece_id=LCEJ3OJBFVFRSW6BKXLCDODZSXOUYGAF3HNHDRKV3BTWXFC6CEYQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.786342191 (292h10m50.517609821s) [upload=303808]: Next returned nil segment Aug 20 21:37:09.786354274 (292h10m50.517621905s) [upload=303808]: Waiting for error group managing segments... Aug 20 21:37:09.796139942 (292h10m50.527407562s) [noise=true , address=45.91.116.13:4158 , piece_id=E6YFRFN2RQGQ36RTH47TY4GPKNMBNX6MW6KTBUOT4MWA2DAUVMZQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.798993265 (292h10m50.530260895s) [noise=true , address=45.91.116.4:4961 , piece_id=YWSHG7EWRLELH6Y7HETYGCJ7CG46IBIH2PUL753AXOAH4UQY7F4Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.799321912 (292h10m50.530589532s) [noise=true , address=104.36.82.39:4743 , piece_id=LCEJ3OJBFVFRSW6BKXLCDODZSXOUYGAF3HNHDRKV3BTWXFC6CEYQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.799790192 (292h10m50.531057822s) [noise=true , address=77.90.31.19:4857 , piece_id=35T4SGOZJOLSII7E4FHY7ZRTRFIDARU7XXOZU37JKVHJCPJSG32Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.801795931 (292h10m50.533063551s) [noise=true , address=104.36.82.51:4081 , piece_id=YJWSUTEX2PWCCNTB55BCKOG7N54ZLS4FBRNMKRIZGSBVTLRUMBHQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.804906016 (292h10m50.536173646s) [noise=true , address=45.91.116.11:4137 , piece_id=K5AJVLK3HM5GY6CUYAUNCNSNVTC5EVCL3ENBD4S7ENBRKJLMDYQA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.807465596 (292h10m50.538733216s) [noise=true , address=45.91.116.6:4987 , piece_id=FIUC5YIKRZGGQH7TLGJ2N5LJ5YHTNYETDJZGD2RZHQCITYBYDORA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.807957671 (292h10m50.53922529s) [noise=true , address=45.91.116.7:4034 , piece_id=WBYA32MRBLGGSARZ6NMFFTVGQWEJKS5ZBFHKDN44JZM6MDCYYN3Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.812102068 (292h10m50.543369698s) [noise=true , address=45.91.116.5:4315 , piece_id=UESB4LHFHNRU2LZLYFDXVKAICW3WEG2WHVNTH2WTXMF4DVEPZ2YQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.812796804 (292h10m50.544064424s) [noise=true , address=45.91.116.12:4245 , piece_id=I4FY6SZTKNF6YFK2N4RHFAX6Q42L5SQ3DDPH5FLGL2YW72W7DOMQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.813134078 (292h10m50.544401697s) [noise=true , address=104.36.82.15:4272 , piece_id=REOMI6Z6RQYCGKAUOUVC5RQMKPZTJW7YWUXVWQSR5UOU5GI2EEZQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.828079833 (292h10m50.559347454s) [noise=true , address=104.36.82.40:4971 , piece_id=4W76WZ62OT45S7I7FLH7NWCQVCYYE2AWD5OVQA4JUIJD7AM3FUOA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.834761841 (292h10m50.56602946s) [noise=true , address=77.90.31.21:4881 , piece_id=XWIHQ3IZZDNAJJS3CISNSTIOKVOVOMZYXH7F4GLQGN2ZWD343AVQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.836488866 (292h10m50.567756496s) [noise=true , address=77.90.31.15:4716 , piece_id=VXCGNR6ZE5EV5HPENW6IV7WEGSUJNOLZUGLZ77Q6X4HLEA6R2YPA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.836506549 (292h10m50.567774179s) [seg_pos={0 0}, upload=303808]: Segment reached optimal threshold of 14 pieces. Aug 20 21:37:09.836622287 (292h10m50.567889917s) [noise=true , address=77.90.31.16:4742 , piece_id=OUS76BQH6H6M6UPIFJWJNHJ5ORNHERZMRRYO47PPWY5O7CTW4SNA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836653606 (292h10m50.567921236s) [noise=true , address=77.90.31.10:4548 , piece_id=EZZNIDRZKSM77GNXKCXGCLX4YNSGX2Z2LBOMOQQ3RZYU7PSIKICQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836740098 (292h10m50.568007728s) [noise=true , address=77.90.31.18:4811 , piece_id=GATLUREPOZCE6F2FJ3RXRUBLXKGIW44QCYU37RW2CF2QWXYCGMYQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AZxy9wnMgVu2PdFNtFrShYhWfF6PL4mgWumjqVk68voKsnMk6): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836745187 (292h10m50.568012817s) [noise=true , address=104.36.82.35:4604 , piece_id=3XCW633LNRPSU6R3QNBJGXK32WP6QFW56ZZ6ELB2KZNT4OUFL73A, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836766718 (292h10m50.568034338s) [seg_pos={0 0}, upload=303808]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 20 21:37:09.836835627 (292h10m50.568103247s) [upload=303808]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 20 21:37:09.836839785 (292h10m50.568107405s) [upload=303808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 20 21:37:10.058695062 (292h10m50.789962712s) [upload=303808]: Done uploading segments... Aug 20 21:37:10.058720261 (292h10m50.78998792s) [upload=303808]: Upload finished. err: <nil> Duration: 491.284787ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 444.884943ms FAIL (2025-08-20 21:39:46 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 444.909569ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 171.654451ms FAIL (2025-08-20 21:39:37 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 171.678056ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................X...........................X...X....] duration: 1.504727181s FAIL (2025-08-20 21:39:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 20 21:37:09.636593435 (292h10m50.367861085s) [upload=303808]: Starting upload Aug 20 21:37:09.636653198 (292h10m50.367920847s) [upload=303808]: Done starting upload Aug 20 21:37:09.636753336 (292h10m50.368020996s) [upload=303808]: Uploading segments... Aug 20 21:37:09.637182232 (292h10m50.368449942s) [upload=303808]: Got next segment. Inline: false Aug 20 21:37:09.637250320 (292h10m50.36851797s) [upload=303808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 20 21:37:09.637259017 (292h10m50.368526697s) [upload=303808]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 20 21:37:09.665336609 (292h10m50.396604259s) [seg_pos={0 0}, upload=303808]: Begin upload segment... Aug 20 21:37:09.665405298 (292h10m50.396672948s) [seg_pos={0 0}, upload=303808]: Done begin upload segment. Aug 20 21:37:09.665449631 (292h10m50.396717281s) [noise=true , address=77.90.31.19:4857 , piece_id=35T4SGOZJOLSII7E4FHY7ZRTRFIDARU7XXOZU37JKVHJCPJSG32Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.665464088 (292h10m50.396731738s) [noise=true , address=45.91.116.7:4034 , piece_id=WBYA32MRBLGGSARZ6NMFFTVGQWEJKS5ZBFHKDN44JZM6MDCYYN3Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.665915878 (292h10m50.397183527s) [noise=true , address=45.91.116.13:4158 , piece_id=E6YFRFN2RQGQ36RTH47TY4GPKNMBNX6MW6KTBUOT4MWA2DAUVMZQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666053176 (292h10m50.397320826s) [noise=true , address=45.91.116.11:4137 , piece_id=K5AJVLK3HM5GY6CUYAUNCNSNVTC5EVCL3ENBD4S7ENBRKJLMDYQA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666291714 (292h10m50.397559365s) [noise=true , address=77.90.31.16:4742 , piece_id=OUS76BQH6H6M6UPIFJWJNHJ5ORNHERZMRRYO47PPWY5O7CTW4SNA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666575257 (292h10m50.397842917s) [noise=true , address=77.90.31.15:4716 , piece_id=VXCGNR6ZE5EV5HPENW6IV7WEGSUJNOLZUGLZ77Q6X4HLEA6R2YPA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666633165 (292h10m50.397900816s) [noise=true , address=104.36.82.35:4604 , piece_id=3XCW633LNRPSU6R3QNBJGXK32WP6QFW56ZZ6ELB2KZNT4OUFL73A, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666989635 (292h10m50.398257286s) [noise=true , address=104.36.82.51:4081 , piece_id=YJWSUTEX2PWCCNTB55BCKOG7N54ZLS4FBRNMKRIZGSBVTLRUMBHQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.667135670 (292h10m50.39840332s) [noise=true , address=77.90.31.10:4548 , piece_id=EZZNIDRZKSM77GNXKCXGCLX4YNSGX2Z2LBOMOQQ3RZYU7PSIKICQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.667733994 (292h10m50.399001635s) [noise=true , address=104.36.82.40:4971 , piece_id=4W76WZ62OT45S7I7FLH7NWCQVCYYE2AWD5OVQA4JUIJD7AM3FUOA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.668397070 (292h10m50.39966478s) [noise=true , address=45.91.116.6:4987 , piece_id=FIUC5YIKRZGGQH7TLGJ2N5LJ5YHTNYETDJZGD2RZHQCITYBYDORA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.668910936 (292h10m50.400178576s) [noise=true , address=77.90.31.18:4811 , piece_id=GATLUREPOZCE6F2FJ3RXRUBLXKGIW44QCYU37RW2CF2QWXYCGMYQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.669323512 (292h10m50.400591162s) [noise=true , address=45.91.116.5:4315 , piece_id=UESB4LHFHNRU2LZLYFDXVKAICW3WEG2WHVNTH2WTXMF4DVEPZ2YQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.669753800 (292h10m50.40102145s) [noise=true , address=104.36.82.15:4272 , piece_id=REOMI6Z6RQYCGKAUOUVC5RQMKPZTJW7YWUXVWQSR5UOU5GI2EEZQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670089471 (292h10m50.401357121s) [noise=true , address=77.90.31.21:4881 , piece_id=XWIHQ3IZZDNAJJS3CISNSTIOKVOVOMZYXH7F4GLQGN2ZWD343AVQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670544656 (292h10m50.401812306s) [noise=true , address=45.91.116.4:4961 , piece_id=YWSHG7EWRLELH6Y7HETYGCJ7CG46IBIH2PUL753AXOAH4UQY7F4Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670938015 (292h10m50.402205666s) [noise=true , address=45.91.116.12:4245 , piece_id=I4FY6SZTKNF6YFK2N4RHFAX6Q42L5SQ3DDPH5FLGL2YW72W7DOMQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.671340090 (292h10m50.402607741s) [noise=true , address=104.36.82.39:4743 , piece_id=LCEJ3OJBFVFRSW6BKXLCDODZSXOUYGAF3HNHDRKV3BTWXFC6CEYQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.786342191 (292h10m50.517609821s) [upload=303808]: Next returned nil segment Aug 20 21:37:09.786354274 (292h10m50.517621905s) [upload=303808]: Waiting for error group managing segments... Aug 20 21:37:09.796139942 (292h10m50.527407562s) [noise=true , address=45.91.116.13:4158 , piece_id=E6YFRFN2RQGQ36RTH47TY4GPKNMBNX6MW6KTBUOT4MWA2DAUVMZQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.798993265 (292h10m50.530260895s) [noise=true , address=45.91.116.4:4961 , piece_id=YWSHG7EWRLELH6Y7HETYGCJ7CG46IBIH2PUL753AXOAH4UQY7F4Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.799321912 (292h10m50.530589532s) [noise=true , address=104.36.82.39:4743 , piece_id=LCEJ3OJBFVFRSW6BKXLCDODZSXOUYGAF3HNHDRKV3BTWXFC6CEYQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.799790192 (292h10m50.531057822s) [noise=true , address=77.90.31.19:4857 , piece_id=35T4SGOZJOLSII7E4FHY7ZRTRFIDARU7XXOZU37JKVHJCPJSG32Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.801795931 (292h10m50.533063551s) [noise=true , address=104.36.82.51:4081 , piece_id=YJWSUTEX2PWCCNTB55BCKOG7N54ZLS4FBRNMKRIZGSBVTLRUMBHQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.804906016 (292h10m50.536173646s) [noise=true , address=45.91.116.11:4137 , piece_id=K5AJVLK3HM5GY6CUYAUNCNSNVTC5EVCL3ENBD4S7ENBRKJLMDYQA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.807465596 (292h10m50.538733216s) [noise=true , address=45.91.116.6:4987 , piece_id=FIUC5YIKRZGGQH7TLGJ2N5LJ5YHTNYETDJZGD2RZHQCITYBYDORA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.807957671 (292h10m50.53922529s) [noise=true , address=45.91.116.7:4034 , piece_id=WBYA32MRBLGGSARZ6NMFFTVGQWEJKS5ZBFHKDN44JZM6MDCYYN3Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.812102068 (292h10m50.543369698s) [noise=true , address=45.91.116.5:4315 , piece_id=UESB4LHFHNRU2LZLYFDXVKAICW3WEG2WHVNTH2WTXMF4DVEPZ2YQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.812796804 (292h10m50.544064424s) [noise=true , address=45.91.116.12:4245 , piece_id=I4FY6SZTKNF6YFK2N4RHFAX6Q42L5SQ3DDPH5FLGL2YW72W7DOMQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.813134078 (292h10m50.544401697s) [noise=true , address=104.36.82.15:4272 , piece_id=REOMI6Z6RQYCGKAUOUVC5RQMKPZTJW7YWUXVWQSR5UOU5GI2EEZQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.828079833 (292h10m50.559347454s) [noise=true , address=104.36.82.40:4971 , piece_id=4W76WZ62OT45S7I7FLH7NWCQVCYYE2AWD5OVQA4JUIJD7AM3FUOA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.834761841 (292h10m50.56602946s) [noise=true , address=77.90.31.21:4881 , piece_id=XWIHQ3IZZDNAJJS3CISNSTIOKVOVOMZYXH7F4GLQGN2ZWD343AVQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.836488866 (292h10m50.567756496s) [noise=true , address=77.90.31.15:4716 , piece_id=VXCGNR6ZE5EV5HPENW6IV7WEGSUJNOLZUGLZ77Q6X4HLEA6R2YPA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.836506549 (292h10m50.567774179s) [seg_pos={0 0}, upload=303808]: Segment reached optimal threshold of 14 pieces. Aug 20 21:37:09.836622287 (292h10m50.567889917s) [noise=true , address=77.90.31.16:4742 , piece_id=OUS76BQH6H6M6UPIFJWJNHJ5ORNHERZMRRYO47PPWY5O7CTW4SNA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836653606 (292h10m50.567921236s) [noise=true , address=77.90.31.10:4548 , piece_id=EZZNIDRZKSM77GNXKCXGCLX4YNSGX2Z2LBOMOQQ3RZYU7PSIKICQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836740098 (292h10m50.568007728s) [noise=true , address=77.90.31.18:4811 , piece_id=GATLUREPOZCE6F2FJ3RXRUBLXKGIW44QCYU37RW2CF2QWXYCGMYQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AZxy9wnMgVu2PdFNtFrShYhWfF6PL4mgWumjqVk68voKsnMk6): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836745187 (292h10m50.568012817s) [noise=true , address=104.36.82.35:4604 , piece_id=3XCW633LNRPSU6R3QNBJGXK32WP6QFW56ZZ6ELB2KZNT4OUFL73A, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836766718 (292h10m50.568034338s) [seg_pos={0 0}, upload=303808]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 20 21:37:09.836835627 (292h10m50.568103247s) [upload=303808]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 20 21:37:09.836839785 (292h10m50.568107405s) [upload=303808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 20 21:37:10.058695062 (292h10m50.789962712s) [upload=303808]: Done uploading segments... Aug 20 21:37:10.058720261 (292h10m50.78998792s) [upload=303808]: Upload finished. err: <nil> Duration: 1.504755364s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 995.880975ms FAIL (2025-08-20 21:39:00 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 995.916471ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 566.477451ms FAIL (2025-08-20 21:38:45 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 566.497179ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................X...........................X...X...] duration: 1.628675905s FAIL (2025-08-20 21:38:35 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 20 21:37:09.636593435 (292h10m50.367861085s) [upload=303808]: Starting upload Aug 20 21:37:09.636653198 (292h10m50.367920847s) [upload=303808]: Done starting upload Aug 20 21:37:09.636753336 (292h10m50.368020996s) [upload=303808]: Uploading segments... Aug 20 21:37:09.637182232 (292h10m50.368449942s) [upload=303808]: Got next segment. Inline: false Aug 20 21:37:09.637250320 (292h10m50.36851797s) [upload=303808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 20 21:37:09.637259017 (292h10m50.368526697s) [upload=303808]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 20 21:37:09.665336609 (292h10m50.396604259s) [seg_pos={0 0}, upload=303808]: Begin upload segment... Aug 20 21:37:09.665405298 (292h10m50.396672948s) [seg_pos={0 0}, upload=303808]: Done begin upload segment. Aug 20 21:37:09.665449631 (292h10m50.396717281s) [noise=true , address=77.90.31.19:4857 , piece_id=35T4SGOZJOLSII7E4FHY7ZRTRFIDARU7XXOZU37JKVHJCPJSG32Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.665464088 (292h10m50.396731738s) [noise=true , address=45.91.116.7:4034 , piece_id=WBYA32MRBLGGSARZ6NMFFTVGQWEJKS5ZBFHKDN44JZM6MDCYYN3Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.665915878 (292h10m50.397183527s) [noise=true , address=45.91.116.13:4158 , piece_id=E6YFRFN2RQGQ36RTH47TY4GPKNMBNX6MW6KTBUOT4MWA2DAUVMZQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666053176 (292h10m50.397320826s) [noise=true , address=45.91.116.11:4137 , piece_id=K5AJVLK3HM5GY6CUYAUNCNSNVTC5EVCL3ENBD4S7ENBRKJLMDYQA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666291714 (292h10m50.397559365s) [noise=true , address=77.90.31.16:4742 , piece_id=OUS76BQH6H6M6UPIFJWJNHJ5ORNHERZMRRYO47PPWY5O7CTW4SNA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666575257 (292h10m50.397842917s) [noise=true , address=77.90.31.15:4716 , piece_id=VXCGNR6ZE5EV5HPENW6IV7WEGSUJNOLZUGLZ77Q6X4HLEA6R2YPA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666633165 (292h10m50.397900816s) [noise=true , address=104.36.82.35:4604 , piece_id=3XCW633LNRPSU6R3QNBJGXK32WP6QFW56ZZ6ELB2KZNT4OUFL73A, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666989635 (292h10m50.398257286s) [noise=true , address=104.36.82.51:4081 , piece_id=YJWSUTEX2PWCCNTB55BCKOG7N54ZLS4FBRNMKRIZGSBVTLRUMBHQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.667135670 (292h10m50.39840332s) [noise=true , address=77.90.31.10:4548 , piece_id=EZZNIDRZKSM77GNXKCXGCLX4YNSGX2Z2LBOMOQQ3RZYU7PSIKICQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.667733994 (292h10m50.399001635s) [noise=true , address=104.36.82.40:4971 , piece_id=4W76WZ62OT45S7I7FLH7NWCQVCYYE2AWD5OVQA4JUIJD7AM3FUOA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.668397070 (292h10m50.39966478s) [noise=true , address=45.91.116.6:4987 , piece_id=FIUC5YIKRZGGQH7TLGJ2N5LJ5YHTNYETDJZGD2RZHQCITYBYDORA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.668910936 (292h10m50.400178576s) [noise=true , address=77.90.31.18:4811 , piece_id=GATLUREPOZCE6F2FJ3RXRUBLXKGIW44QCYU37RW2CF2QWXYCGMYQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.669323512 (292h10m50.400591162s) [noise=true , address=45.91.116.5:4315 , piece_id=UESB4LHFHNRU2LZLYFDXVKAICW3WEG2WHVNTH2WTXMF4DVEPZ2YQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.669753800 (292h10m50.40102145s) [noise=true , address=104.36.82.15:4272 , piece_id=REOMI6Z6RQYCGKAUOUVC5RQMKPZTJW7YWUXVWQSR5UOU5GI2EEZQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670089471 (292h10m50.401357121s) [noise=true , address=77.90.31.21:4881 , piece_id=XWIHQ3IZZDNAJJS3CISNSTIOKVOVOMZYXH7F4GLQGN2ZWD343AVQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670544656 (292h10m50.401812306s) [noise=true , address=45.91.116.4:4961 , piece_id=YWSHG7EWRLELH6Y7HETYGCJ7CG46IBIH2PUL753AXOAH4UQY7F4Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670938015 (292h10m50.402205666s) [noise=true , address=45.91.116.12:4245 , piece_id=I4FY6SZTKNF6YFK2N4RHFAX6Q42L5SQ3DDPH5FLGL2YW72W7DOMQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.671340090 (292h10m50.402607741s) [noise=true , address=104.36.82.39:4743 , piece_id=LCEJ3OJBFVFRSW6BKXLCDODZSXOUYGAF3HNHDRKV3BTWXFC6CEYQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.786342191 (292h10m50.517609821s) [upload=303808]: Next returned nil segment Aug 20 21:37:09.786354274 (292h10m50.517621905s) [upload=303808]: Waiting for error group managing segments... Aug 20 21:37:09.796139942 (292h10m50.527407562s) [noise=true , address=45.91.116.13:4158 , piece_id=E6YFRFN2RQGQ36RTH47TY4GPKNMBNX6MW6KTBUOT4MWA2DAUVMZQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.798993265 (292h10m50.530260895s) [noise=true , address=45.91.116.4:4961 , piece_id=YWSHG7EWRLELH6Y7HETYGCJ7CG46IBIH2PUL753AXOAH4UQY7F4Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.799321912 (292h10m50.530589532s) [noise=true , address=104.36.82.39:4743 , piece_id=LCEJ3OJBFVFRSW6BKXLCDODZSXOUYGAF3HNHDRKV3BTWXFC6CEYQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.799790192 (292h10m50.531057822s) [noise=true , address=77.90.31.19:4857 , piece_id=35T4SGOZJOLSII7E4FHY7ZRTRFIDARU7XXOZU37JKVHJCPJSG32Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.801795931 (292h10m50.533063551s) [noise=true , address=104.36.82.51:4081 , piece_id=YJWSUTEX2PWCCNTB55BCKOG7N54ZLS4FBRNMKRIZGSBVTLRUMBHQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.804906016 (292h10m50.536173646s) [noise=true , address=45.91.116.11:4137 , piece_id=K5AJVLK3HM5GY6CUYAUNCNSNVTC5EVCL3ENBD4S7ENBRKJLMDYQA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.807465596 (292h10m50.538733216s) [noise=true , address=45.91.116.6:4987 , piece_id=FIUC5YIKRZGGQH7TLGJ2N5LJ5YHTNYETDJZGD2RZHQCITYBYDORA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.807957671 (292h10m50.53922529s) [noise=true , address=45.91.116.7:4034 , piece_id=WBYA32MRBLGGSARZ6NMFFTVGQWEJKS5ZBFHKDN44JZM6MDCYYN3Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.812102068 (292h10m50.543369698s) [noise=true , address=45.91.116.5:4315 , piece_id=UESB4LHFHNRU2LZLYFDXVKAICW3WEG2WHVNTH2WTXMF4DVEPZ2YQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.812796804 (292h10m50.544064424s) [noise=true , address=45.91.116.12:4245 , piece_id=I4FY6SZTKNF6YFK2N4RHFAX6Q42L5SQ3DDPH5FLGL2YW72W7DOMQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.813134078 (292h10m50.544401697s) [noise=true , address=104.36.82.15:4272 , piece_id=REOMI6Z6RQYCGKAUOUVC5RQMKPZTJW7YWUXVWQSR5UOU5GI2EEZQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.828079833 (292h10m50.559347454s) [noise=true , address=104.36.82.40:4971 , piece_id=4W76WZ62OT45S7I7FLH7NWCQVCYYE2AWD5OVQA4JUIJD7AM3FUOA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.834761841 (292h10m50.56602946s) [noise=true , address=77.90.31.21:4881 , piece_id=XWIHQ3IZZDNAJJS3CISNSTIOKVOVOMZYXH7F4GLQGN2ZWD343AVQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.836488866 (292h10m50.567756496s) [noise=true , address=77.90.31.15:4716 , piece_id=VXCGNR6ZE5EV5HPENW6IV7WEGSUJNOLZUGLZ77Q6X4HLEA6R2YPA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.836506549 (292h10m50.567774179s) [seg_pos={0 0}, upload=303808]: Segment reached optimal threshold of 14 pieces. Aug 20 21:37:09.836622287 (292h10m50.567889917s) [noise=true , address=77.90.31.16:4742 , piece_id=OUS76BQH6H6M6UPIFJWJNHJ5ORNHERZMRRYO47PPWY5O7CTW4SNA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836653606 (292h10m50.567921236s) [noise=true , address=77.90.31.10:4548 , piece_id=EZZNIDRZKSM77GNXKCXGCLX4YNSGX2Z2LBOMOQQ3RZYU7PSIKICQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836740098 (292h10m50.568007728s) [noise=true , address=77.90.31.18:4811 , piece_id=GATLUREPOZCE6F2FJ3RXRUBLXKGIW44QCYU37RW2CF2QWXYCGMYQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AZxy9wnMgVu2PdFNtFrShYhWfF6PL4mgWumjqVk68voKsnMk6): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836745187 (292h10m50.568012817s) [noise=true , address=104.36.82.35:4604 , piece_id=3XCW633LNRPSU6R3QNBJGXK32WP6QFW56ZZ6ELB2KZNT4OUFL73A, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836766718 (292h10m50.568034338s) [seg_pos={0 0}, upload=303808]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 20 21:37:09.836835627 (292h10m50.568103247s) [upload=303808]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 20 21:37:09.836839785 (292h10m50.568107405s) [upload=303808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 20 21:37:10.058695062 (292h10m50.789962712s) [upload=303808]: Done uploading segments... Aug 20 21:37:10.058720261 (292h10m50.78998792s) [upload=303808]: Upload finished. err: <nil> Duration: 1.628701112s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................X...........................X...X..] duration: 1.016653932s FAIL (2025-08-20 21:38:12 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 20 21:37:09.636593435 (292h10m50.367861085s) [upload=303808]: Starting upload Aug 20 21:37:09.636653198 (292h10m50.367920847s) [upload=303808]: Done starting upload Aug 20 21:37:09.636753336 (292h10m50.368020996s) [upload=303808]: Uploading segments... Aug 20 21:37:09.637182232 (292h10m50.368449942s) [upload=303808]: Got next segment. Inline: false Aug 20 21:37:09.637250320 (292h10m50.36851797s) [upload=303808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 20 21:37:09.637259017 (292h10m50.368526697s) [upload=303808]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 20 21:37:09.665336609 (292h10m50.396604259s) [seg_pos={0 0}, upload=303808]: Begin upload segment... Aug 20 21:37:09.665405298 (292h10m50.396672948s) [seg_pos={0 0}, upload=303808]: Done begin upload segment. Aug 20 21:37:09.665449631 (292h10m50.396717281s) [noise=true , address=77.90.31.19:4857 , piece_id=35T4SGOZJOLSII7E4FHY7ZRTRFIDARU7XXOZU37JKVHJCPJSG32Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.665464088 (292h10m50.396731738s) [noise=true , address=45.91.116.7:4034 , piece_id=WBYA32MRBLGGSARZ6NMFFTVGQWEJKS5ZBFHKDN44JZM6MDCYYN3Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.665915878 (292h10m50.397183527s) [noise=true , address=45.91.116.13:4158 , piece_id=E6YFRFN2RQGQ36RTH47TY4GPKNMBNX6MW6KTBUOT4MWA2DAUVMZQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666053176 (292h10m50.397320826s) [noise=true , address=45.91.116.11:4137 , piece_id=K5AJVLK3HM5GY6CUYAUNCNSNVTC5EVCL3ENBD4S7ENBRKJLMDYQA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666291714 (292h10m50.397559365s) [noise=true , address=77.90.31.16:4742 , piece_id=OUS76BQH6H6M6UPIFJWJNHJ5ORNHERZMRRYO47PPWY5O7CTW4SNA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666575257 (292h10m50.397842917s) [noise=true , address=77.90.31.15:4716 , piece_id=VXCGNR6ZE5EV5HPENW6IV7WEGSUJNOLZUGLZ77Q6X4HLEA6R2YPA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666633165 (292h10m50.397900816s) [noise=true , address=104.36.82.35:4604 , piece_id=3XCW633LNRPSU6R3QNBJGXK32WP6QFW56ZZ6ELB2KZNT4OUFL73A, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666989635 (292h10m50.398257286s) [noise=true , address=104.36.82.51:4081 , piece_id=YJWSUTEX2PWCCNTB55BCKOG7N54ZLS4FBRNMKRIZGSBVTLRUMBHQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.667135670 (292h10m50.39840332s) [noise=true , address=77.90.31.10:4548 , piece_id=EZZNIDRZKSM77GNXKCXGCLX4YNSGX2Z2LBOMOQQ3RZYU7PSIKICQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.667733994 (292h10m50.399001635s) [noise=true , address=104.36.82.40:4971 , piece_id=4W76WZ62OT45S7I7FLH7NWCQVCYYE2AWD5OVQA4JUIJD7AM3FUOA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.668397070 (292h10m50.39966478s) [noise=true , address=45.91.116.6:4987 , piece_id=FIUC5YIKRZGGQH7TLGJ2N5LJ5YHTNYETDJZGD2RZHQCITYBYDORA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.668910936 (292h10m50.400178576s) [noise=true , address=77.90.31.18:4811 , piece_id=GATLUREPOZCE6F2FJ3RXRUBLXKGIW44QCYU37RW2CF2QWXYCGMYQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.669323512 (292h10m50.400591162s) [noise=true , address=45.91.116.5:4315 , piece_id=UESB4LHFHNRU2LZLYFDXVKAICW3WEG2WHVNTH2WTXMF4DVEPZ2YQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.669753800 (292h10m50.40102145s) [noise=true , address=104.36.82.15:4272 , piece_id=REOMI6Z6RQYCGKAUOUVC5RQMKPZTJW7YWUXVWQSR5UOU5GI2EEZQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670089471 (292h10m50.401357121s) [noise=true , address=77.90.31.21:4881 , piece_id=XWIHQ3IZZDNAJJS3CISNSTIOKVOVOMZYXH7F4GLQGN2ZWD343AVQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670544656 (292h10m50.401812306s) [noise=true , address=45.91.116.4:4961 , piece_id=YWSHG7EWRLELH6Y7HETYGCJ7CG46IBIH2PUL753AXOAH4UQY7F4Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670938015 (292h10m50.402205666s) [noise=true , address=45.91.116.12:4245 , piece_id=I4FY6SZTKNF6YFK2N4RHFAX6Q42L5SQ3DDPH5FLGL2YW72W7DOMQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.671340090 (292h10m50.402607741s) [noise=true , address=104.36.82.39:4743 , piece_id=LCEJ3OJBFVFRSW6BKXLCDODZSXOUYGAF3HNHDRKV3BTWXFC6CEYQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.786342191 (292h10m50.517609821s) [upload=303808]: Next returned nil segment Aug 20 21:37:09.786354274 (292h10m50.517621905s) [upload=303808]: Waiting for error group managing segments... Aug 20 21:37:09.796139942 (292h10m50.527407562s) [noise=true , address=45.91.116.13:4158 , piece_id=E6YFRFN2RQGQ36RTH47TY4GPKNMBNX6MW6KTBUOT4MWA2DAUVMZQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.798993265 (292h10m50.530260895s) [noise=true , address=45.91.116.4:4961 , piece_id=YWSHG7EWRLELH6Y7HETYGCJ7CG46IBIH2PUL753AXOAH4UQY7F4Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.799321912 (292h10m50.530589532s) [noise=true , address=104.36.82.39:4743 , piece_id=LCEJ3OJBFVFRSW6BKXLCDODZSXOUYGAF3HNHDRKV3BTWXFC6CEYQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.799790192 (292h10m50.531057822s) [noise=true , address=77.90.31.19:4857 , piece_id=35T4SGOZJOLSII7E4FHY7ZRTRFIDARU7XXOZU37JKVHJCPJSG32Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.801795931 (292h10m50.533063551s) [noise=true , address=104.36.82.51:4081 , piece_id=YJWSUTEX2PWCCNTB55BCKOG7N54ZLS4FBRNMKRIZGSBVTLRUMBHQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.804906016 (292h10m50.536173646s) [noise=true , address=45.91.116.11:4137 , piece_id=K5AJVLK3HM5GY6CUYAUNCNSNVTC5EVCL3ENBD4S7ENBRKJLMDYQA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.807465596 (292h10m50.538733216s) [noise=true , address=45.91.116.6:4987 , piece_id=FIUC5YIKRZGGQH7TLGJ2N5LJ5YHTNYETDJZGD2RZHQCITYBYDORA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.807957671 (292h10m50.53922529s) [noise=true , address=45.91.116.7:4034 , piece_id=WBYA32MRBLGGSARZ6NMFFTVGQWEJKS5ZBFHKDN44JZM6MDCYYN3Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.812102068 (292h10m50.543369698s) [noise=true , address=45.91.116.5:4315 , piece_id=UESB4LHFHNRU2LZLYFDXVKAICW3WEG2WHVNTH2WTXMF4DVEPZ2YQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.812796804 (292h10m50.544064424s) [noise=true , address=45.91.116.12:4245 , piece_id=I4FY6SZTKNF6YFK2N4RHFAX6Q42L5SQ3DDPH5FLGL2YW72W7DOMQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.813134078 (292h10m50.544401697s) [noise=true , address=104.36.82.15:4272 , piece_id=REOMI6Z6RQYCGKAUOUVC5RQMKPZTJW7YWUXVWQSR5UOU5GI2EEZQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.828079833 (292h10m50.559347454s) [noise=true , address=104.36.82.40:4971 , piece_id=4W76WZ62OT45S7I7FLH7NWCQVCYYE2AWD5OVQA4JUIJD7AM3FUOA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.834761841 (292h10m50.56602946s) [noise=true , address=77.90.31.21:4881 , piece_id=XWIHQ3IZZDNAJJS3CISNSTIOKVOVOMZYXH7F4GLQGN2ZWD343AVQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.836488866 (292h10m50.567756496s) [noise=true , address=77.90.31.15:4716 , piece_id=VXCGNR6ZE5EV5HPENW6IV7WEGSUJNOLZUGLZ77Q6X4HLEA6R2YPA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.836506549 (292h10m50.567774179s) [seg_pos={0 0}, upload=303808]: Segment reached optimal threshold of 14 pieces. Aug 20 21:37:09.836622287 (292h10m50.567889917s) [noise=true , address=77.90.31.16:4742 , piece_id=OUS76BQH6H6M6UPIFJWJNHJ5ORNHERZMRRYO47PPWY5O7CTW4SNA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836653606 (292h10m50.567921236s) [noise=true , address=77.90.31.10:4548 , piece_id=EZZNIDRZKSM77GNXKCXGCLX4YNSGX2Z2LBOMOQQ3RZYU7PSIKICQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836740098 (292h10m50.568007728s) [noise=true , address=77.90.31.18:4811 , piece_id=GATLUREPOZCE6F2FJ3RXRUBLXKGIW44QCYU37RW2CF2QWXYCGMYQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AZxy9wnMgVu2PdFNtFrShYhWfF6PL4mgWumjqVk68voKsnMk6): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836745187 (292h10m50.568012817s) [noise=true , address=104.36.82.35:4604 , piece_id=3XCW633LNRPSU6R3QNBJGXK32WP6QFW56ZZ6ELB2KZNT4OUFL73A, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836766718 (292h10m50.568034338s) [seg_pos={0 0}, upload=303808]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 20 21:37:09.836835627 (292h10m50.568103247s) [upload=303808]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 20 21:37:09.836839785 (292h10m50.568107405s) [upload=303808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 20 21:37:10.058695062 (292h10m50.789962712s) [upload=303808]: Done uploading segments... Aug 20 21:37:10.058720261 (292h10m50.78998792s) [upload=303808]: Upload finished. err: <nil> Duration: 1.016673048s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 265.688809ms FAIL (2025-08-20 21:38:11 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 265.709869ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 366.528776ms FAIL (2025-08-20 21:38:11 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 366.709566ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........................X...........................X...X.] duration: 2.909790559s FAIL (2025-08-20 21:37:44 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 20 21:37:09.636593435 (292h10m50.367861085s) [upload=303808]: Starting upload Aug 20 21:37:09.636653198 (292h10m50.367920847s) [upload=303808]: Done starting upload Aug 20 21:37:09.636753336 (292h10m50.368020996s) [upload=303808]: Uploading segments... Aug 20 21:37:09.637182232 (292h10m50.368449942s) [upload=303808]: Got next segment. Inline: false Aug 20 21:37:09.637250320 (292h10m50.36851797s) [upload=303808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 20 21:37:09.637259017 (292h10m50.368526697s) [upload=303808]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 20 21:37:09.665336609 (292h10m50.396604259s) [seg_pos={0 0}, upload=303808]: Begin upload segment... Aug 20 21:37:09.665405298 (292h10m50.396672948s) [seg_pos={0 0}, upload=303808]: Done begin upload segment. Aug 20 21:37:09.665449631 (292h10m50.396717281s) [noise=true , address=77.90.31.19:4857 , piece_id=35T4SGOZJOLSII7E4FHY7ZRTRFIDARU7XXOZU37JKVHJCPJSG32Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.665464088 (292h10m50.396731738s) [noise=true , address=45.91.116.7:4034 , piece_id=WBYA32MRBLGGSARZ6NMFFTVGQWEJKS5ZBFHKDN44JZM6MDCYYN3Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.665915878 (292h10m50.397183527s) [noise=true , address=45.91.116.13:4158 , piece_id=E6YFRFN2RQGQ36RTH47TY4GPKNMBNX6MW6KTBUOT4MWA2DAUVMZQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666053176 (292h10m50.397320826s) [noise=true , address=45.91.116.11:4137 , piece_id=K5AJVLK3HM5GY6CUYAUNCNSNVTC5EVCL3ENBD4S7ENBRKJLMDYQA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666291714 (292h10m50.397559365s) [noise=true , address=77.90.31.16:4742 , piece_id=OUS76BQH6H6M6UPIFJWJNHJ5ORNHERZMRRYO47PPWY5O7CTW4SNA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666575257 (292h10m50.397842917s) [noise=true , address=77.90.31.15:4716 , piece_id=VXCGNR6ZE5EV5HPENW6IV7WEGSUJNOLZUGLZ77Q6X4HLEA6R2YPA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666633165 (292h10m50.397900816s) [noise=true , address=104.36.82.35:4604 , piece_id=3XCW633LNRPSU6R3QNBJGXK32WP6QFW56ZZ6ELB2KZNT4OUFL73A, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666989635 (292h10m50.398257286s) [noise=true , address=104.36.82.51:4081 , piece_id=YJWSUTEX2PWCCNTB55BCKOG7N54ZLS4FBRNMKRIZGSBVTLRUMBHQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.667135670 (292h10m50.39840332s) [noise=true , address=77.90.31.10:4548 , piece_id=EZZNIDRZKSM77GNXKCXGCLX4YNSGX2Z2LBOMOQQ3RZYU7PSIKICQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.667733994 (292h10m50.399001635s) [noise=true , address=104.36.82.40:4971 , piece_id=4W76WZ62OT45S7I7FLH7NWCQVCYYE2AWD5OVQA4JUIJD7AM3FUOA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.668397070 (292h10m50.39966478s) [noise=true , address=45.91.116.6:4987 , piece_id=FIUC5YIKRZGGQH7TLGJ2N5LJ5YHTNYETDJZGD2RZHQCITYBYDORA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.668910936 (292h10m50.400178576s) [noise=true , address=77.90.31.18:4811 , piece_id=GATLUREPOZCE6F2FJ3RXRUBLXKGIW44QCYU37RW2CF2QWXYCGMYQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.669323512 (292h10m50.400591162s) [noise=true , address=45.91.116.5:4315 , piece_id=UESB4LHFHNRU2LZLYFDXVKAICW3WEG2WHVNTH2WTXMF4DVEPZ2YQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.669753800 (292h10m50.40102145s) [noise=true , address=104.36.82.15:4272 , piece_id=REOMI6Z6RQYCGKAUOUVC5RQMKPZTJW7YWUXVWQSR5UOU5GI2EEZQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670089471 (292h10m50.401357121s) [noise=true , address=77.90.31.21:4881 , piece_id=XWIHQ3IZZDNAJJS3CISNSTIOKVOVOMZYXH7F4GLQGN2ZWD343AVQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670544656 (292h10m50.401812306s) [noise=true , address=45.91.116.4:4961 , piece_id=YWSHG7EWRLELH6Y7HETYGCJ7CG46IBIH2PUL753AXOAH4UQY7F4Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670938015 (292h10m50.402205666s) [noise=true , address=45.91.116.12:4245 , piece_id=I4FY6SZTKNF6YFK2N4RHFAX6Q42L5SQ3DDPH5FLGL2YW72W7DOMQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.671340090 (292h10m50.402607741s) [noise=true , address=104.36.82.39:4743 , piece_id=LCEJ3OJBFVFRSW6BKXLCDODZSXOUYGAF3HNHDRKV3BTWXFC6CEYQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.786342191 (292h10m50.517609821s) [upload=303808]: Next returned nil segment Aug 20 21:37:09.786354274 (292h10m50.517621905s) [upload=303808]: Waiting for error group managing segments... Aug 20 21:37:09.796139942 (292h10m50.527407562s) [noise=true , address=45.91.116.13:4158 , piece_id=E6YFRFN2RQGQ36RTH47TY4GPKNMBNX6MW6KTBUOT4MWA2DAUVMZQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.798993265 (292h10m50.530260895s) [noise=true , address=45.91.116.4:4961 , piece_id=YWSHG7EWRLELH6Y7HETYGCJ7CG46IBIH2PUL753AXOAH4UQY7F4Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.799321912 (292h10m50.530589532s) [noise=true , address=104.36.82.39:4743 , piece_id=LCEJ3OJBFVFRSW6BKXLCDODZSXOUYGAF3HNHDRKV3BTWXFC6CEYQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.799790192 (292h10m50.531057822s) [noise=true , address=77.90.31.19:4857 , piece_id=35T4SGOZJOLSII7E4FHY7ZRTRFIDARU7XXOZU37JKVHJCPJSG32Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.801795931 (292h10m50.533063551s) [noise=true , address=104.36.82.51:4081 , piece_id=YJWSUTEX2PWCCNTB55BCKOG7N54ZLS4FBRNMKRIZGSBVTLRUMBHQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.804906016 (292h10m50.536173646s) [noise=true , address=45.91.116.11:4137 , piece_id=K5AJVLK3HM5GY6CUYAUNCNSNVTC5EVCL3ENBD4S7ENBRKJLMDYQA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.807465596 (292h10m50.538733216s) [noise=true , address=45.91.116.6:4987 , piece_id=FIUC5YIKRZGGQH7TLGJ2N5LJ5YHTNYETDJZGD2RZHQCITYBYDORA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.807957671 (292h10m50.53922529s) [noise=true , address=45.91.116.7:4034 , piece_id=WBYA32MRBLGGSARZ6NMFFTVGQWEJKS5ZBFHKDN44JZM6MDCYYN3Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.812102068 (292h10m50.543369698s) [noise=true , address=45.91.116.5:4315 , piece_id=UESB4LHFHNRU2LZLYFDXVKAICW3WEG2WHVNTH2WTXMF4DVEPZ2YQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.812796804 (292h10m50.544064424s) [noise=true , address=45.91.116.12:4245 , piece_id=I4FY6SZTKNF6YFK2N4RHFAX6Q42L5SQ3DDPH5FLGL2YW72W7DOMQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.813134078 (292h10m50.544401697s) [noise=true , address=104.36.82.15:4272 , piece_id=REOMI6Z6RQYCGKAUOUVC5RQMKPZTJW7YWUXVWQSR5UOU5GI2EEZQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.828079833 (292h10m50.559347454s) [noise=true , address=104.36.82.40:4971 , piece_id=4W76WZ62OT45S7I7FLH7NWCQVCYYE2AWD5OVQA4JUIJD7AM3FUOA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.834761841 (292h10m50.56602946s) [noise=true , address=77.90.31.21:4881 , piece_id=XWIHQ3IZZDNAJJS3CISNSTIOKVOVOMZYXH7F4GLQGN2ZWD343AVQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.836488866 (292h10m50.567756496s) [noise=true , address=77.90.31.15:4716 , piece_id=VXCGNR6ZE5EV5HPENW6IV7WEGSUJNOLZUGLZ77Q6X4HLEA6R2YPA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.836506549 (292h10m50.567774179s) [seg_pos={0 0}, upload=303808]: Segment reached optimal threshold of 14 pieces. Aug 20 21:37:09.836622287 (292h10m50.567889917s) [noise=true , address=77.90.31.16:4742 , piece_id=OUS76BQH6H6M6UPIFJWJNHJ5ORNHERZMRRYO47PPWY5O7CTW4SNA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836653606 (292h10m50.567921236s) [noise=true , address=77.90.31.10:4548 , piece_id=EZZNIDRZKSM77GNXKCXGCLX4YNSGX2Z2LBOMOQQ3RZYU7PSIKICQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836740098 (292h10m50.568007728s) [noise=true , address=77.90.31.18:4811 , piece_id=GATLUREPOZCE6F2FJ3RXRUBLXKGIW44QCYU37RW2CF2QWXYCGMYQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AZxy9wnMgVu2PdFNtFrShYhWfF6PL4mgWumjqVk68voKsnMk6): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836745187 (292h10m50.568012817s) [noise=true , address=104.36.82.35:4604 , piece_id=3XCW633LNRPSU6R3QNBJGXK32WP6QFW56ZZ6ELB2KZNT4OUFL73A, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836766718 (292h10m50.568034338s) [seg_pos={0 0}, upload=303808]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 20 21:37:09.836835627 (292h10m50.568103247s) [upload=303808]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 20 21:37:09.836839785 (292h10m50.568107405s) [upload=303808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 20 21:37:10.058695062 (292h10m50.789962712s) [upload=303808]: Done uploading segments... Aug 20 21:37:10.058720261 (292h10m50.78998792s) [upload=303808]: Upload finished. err: <nil> Duration: 2.9098125s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........................X...........................X...X] duration: 483.915066ms FAIL (2025-08-20 21:37:10 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 20 21:37:09.636593435 (292h10m50.367861085s) [upload=303808]: Starting upload Aug 20 21:37:09.636653198 (292h10m50.367920847s) [upload=303808]: Done starting upload Aug 20 21:37:09.636753336 (292h10m50.368020996s) [upload=303808]: Uploading segments... Aug 20 21:37:09.637182232 (292h10m50.368449942s) [upload=303808]: Got next segment. Inline: false Aug 20 21:37:09.637250320 (292h10m50.36851797s) [upload=303808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 20 21:37:09.637259017 (292h10m50.368526697s) [upload=303808]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 20 21:37:09.665336609 (292h10m50.396604259s) [seg_pos={0 0}, upload=303808]: Begin upload segment... Aug 20 21:37:09.665405298 (292h10m50.396672948s) [seg_pos={0 0}, upload=303808]: Done begin upload segment. Aug 20 21:37:09.665449631 (292h10m50.396717281s) [noise=true , address=77.90.31.19:4857 , piece_id=35T4SGOZJOLSII7E4FHY7ZRTRFIDARU7XXOZU37JKVHJCPJSG32Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.665464088 (292h10m50.396731738s) [noise=true , address=45.91.116.7:4034 , piece_id=WBYA32MRBLGGSARZ6NMFFTVGQWEJKS5ZBFHKDN44JZM6MDCYYN3Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.665915878 (292h10m50.397183527s) [noise=true , address=45.91.116.13:4158 , piece_id=E6YFRFN2RQGQ36RTH47TY4GPKNMBNX6MW6KTBUOT4MWA2DAUVMZQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666053176 (292h10m50.397320826s) [noise=true , address=45.91.116.11:4137 , piece_id=K5AJVLK3HM5GY6CUYAUNCNSNVTC5EVCL3ENBD4S7ENBRKJLMDYQA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666291714 (292h10m50.397559365s) [noise=true , address=77.90.31.16:4742 , piece_id=OUS76BQH6H6M6UPIFJWJNHJ5ORNHERZMRRYO47PPWY5O7CTW4SNA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666575257 (292h10m50.397842917s) [noise=true , address=77.90.31.15:4716 , piece_id=VXCGNR6ZE5EV5HPENW6IV7WEGSUJNOLZUGLZ77Q6X4HLEA6R2YPA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666633165 (292h10m50.397900816s) [noise=true , address=104.36.82.35:4604 , piece_id=3XCW633LNRPSU6R3QNBJGXK32WP6QFW56ZZ6ELB2KZNT4OUFL73A, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.666989635 (292h10m50.398257286s) [noise=true , address=104.36.82.51:4081 , piece_id=YJWSUTEX2PWCCNTB55BCKOG7N54ZLS4FBRNMKRIZGSBVTLRUMBHQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.667135670 (292h10m50.39840332s) [noise=true , address=77.90.31.10:4548 , piece_id=EZZNIDRZKSM77GNXKCXGCLX4YNSGX2Z2LBOMOQQ3RZYU7PSIKICQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.667733994 (292h10m50.399001635s) [noise=true , address=104.36.82.40:4971 , piece_id=4W76WZ62OT45S7I7FLH7NWCQVCYYE2AWD5OVQA4JUIJD7AM3FUOA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.668397070 (292h10m50.39966478s) [noise=true , address=45.91.116.6:4987 , piece_id=FIUC5YIKRZGGQH7TLGJ2N5LJ5YHTNYETDJZGD2RZHQCITYBYDORA, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.668910936 (292h10m50.400178576s) [noise=true , address=77.90.31.18:4811 , piece_id=GATLUREPOZCE6F2FJ3RXRUBLXKGIW44QCYU37RW2CF2QWXYCGMYQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.669323512 (292h10m50.400591162s) [noise=true , address=45.91.116.5:4315 , piece_id=UESB4LHFHNRU2LZLYFDXVKAICW3WEG2WHVNTH2WTXMF4DVEPZ2YQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.669753800 (292h10m50.40102145s) [noise=true , address=104.36.82.15:4272 , piece_id=REOMI6Z6RQYCGKAUOUVC5RQMKPZTJW7YWUXVWQSR5UOU5GI2EEZQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670089471 (292h10m50.401357121s) [noise=true , address=77.90.31.21:4881 , piece_id=XWIHQ3IZZDNAJJS3CISNSTIOKVOVOMZYXH7F4GLQGN2ZWD343AVQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670544656 (292h10m50.401812306s) [noise=true , address=45.91.116.4:4961 , piece_id=YWSHG7EWRLELH6Y7HETYGCJ7CG46IBIH2PUL753AXOAH4UQY7F4Q, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.670938015 (292h10m50.402205666s) [noise=true , address=45.91.116.12:4245 , piece_id=I4FY6SZTKNF6YFK2N4RHFAX6Q42L5SQ3DDPH5FLGL2YW72W7DOMQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.671340090 (292h10m50.402607741s) [noise=true , address=104.36.82.39:4743 , piece_id=LCEJ3OJBFVFRSW6BKXLCDODZSXOUYGAF3HNHDRKV3BTWXFC6CEYQ, seg_pos={0 0}, upload=303808]: Uploading piece... Aug 20 21:37:09.786342191 (292h10m50.517609821s) [upload=303808]: Next returned nil segment Aug 20 21:37:09.786354274 (292h10m50.517621905s) [upload=303808]: Waiting for error group managing segments... Aug 20 21:37:09.796139942 (292h10m50.527407562s) [noise=true , address=45.91.116.13:4158 , piece_id=E6YFRFN2RQGQ36RTH47TY4GPKNMBNX6MW6KTBUOT4MWA2DAUVMZQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.798993265 (292h10m50.530260895s) [noise=true , address=45.91.116.4:4961 , piece_id=YWSHG7EWRLELH6Y7HETYGCJ7CG46IBIH2PUL753AXOAH4UQY7F4Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.799321912 (292h10m50.530589532s) [noise=true , address=104.36.82.39:4743 , piece_id=LCEJ3OJBFVFRSW6BKXLCDODZSXOUYGAF3HNHDRKV3BTWXFC6CEYQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.799790192 (292h10m50.531057822s) [noise=true , address=77.90.31.19:4857 , piece_id=35T4SGOZJOLSII7E4FHY7ZRTRFIDARU7XXOZU37JKVHJCPJSG32Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.801795931 (292h10m50.533063551s) [noise=true , address=104.36.82.51:4081 , piece_id=YJWSUTEX2PWCCNTB55BCKOG7N54ZLS4FBRNMKRIZGSBVTLRUMBHQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.804906016 (292h10m50.536173646s) [noise=true , address=45.91.116.11:4137 , piece_id=K5AJVLK3HM5GY6CUYAUNCNSNVTC5EVCL3ENBD4S7ENBRKJLMDYQA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.807465596 (292h10m50.538733216s) [noise=true , address=45.91.116.6:4987 , piece_id=FIUC5YIKRZGGQH7TLGJ2N5LJ5YHTNYETDJZGD2RZHQCITYBYDORA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.807957671 (292h10m50.53922529s) [noise=true , address=45.91.116.7:4034 , piece_id=WBYA32MRBLGGSARZ6NMFFTVGQWEJKS5ZBFHKDN44JZM6MDCYYN3Q, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.812102068 (292h10m50.543369698s) [noise=true , address=45.91.116.5:4315 , piece_id=UESB4LHFHNRU2LZLYFDXVKAICW3WEG2WHVNTH2WTXMF4DVEPZ2YQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.812796804 (292h10m50.544064424s) [noise=true , address=45.91.116.12:4245 , piece_id=I4FY6SZTKNF6YFK2N4RHFAX6Q42L5SQ3DDPH5FLGL2YW72W7DOMQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.813134078 (292h10m50.544401697s) [noise=true , address=104.36.82.15:4272 , piece_id=REOMI6Z6RQYCGKAUOUVC5RQMKPZTJW7YWUXVWQSR5UOU5GI2EEZQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.828079833 (292h10m50.559347454s) [noise=true , address=104.36.82.40:4971 , piece_id=4W76WZ62OT45S7I7FLH7NWCQVCYYE2AWD5OVQA4JUIJD7AM3FUOA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.834761841 (292h10m50.56602946s) [noise=true , address=77.90.31.21:4881 , piece_id=XWIHQ3IZZDNAJJS3CISNSTIOKVOVOMZYXH7F4GLQGN2ZWD343AVQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.836488866 (292h10m50.567756496s) [noise=true , address=77.90.31.15:4716 , piece_id=VXCGNR6ZE5EV5HPENW6IV7WEGSUJNOLZUGLZ77Q6X4HLEA6R2YPA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: <nil> Aug 20 21:37:09.836506549 (292h10m50.567774179s) [seg_pos={0 0}, upload=303808]: Segment reached optimal threshold of 14 pieces. Aug 20 21:37:09.836622287 (292h10m50.567889917s) [noise=true , address=77.90.31.16:4742 , piece_id=OUS76BQH6H6M6UPIFJWJNHJ5ORNHERZMRRYO47PPWY5O7CTW4SNA, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1me3JXQFLGyr6REuWPk7f7arC5d72HcDbexXuez45dYBKqVA3k): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836653606 (292h10m50.567921236s) [noise=true , address=77.90.31.10:4548 , piece_id=EZZNIDRZKSM77GNXKCXGCLX4YNSGX2Z2LBOMOQQ3RZYU7PSIKICQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pj8fDt6E3oe2jUTDBrfN3wL7KVuJymqmGf5Y1x4tozmGfTcr7): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836740098 (292h10m50.568007728s) [noise=true , address=77.90.31.18:4811 , piece_id=GATLUREPOZCE6F2FJ3RXRUBLXKGIW44QCYU37RW2CF2QWXYCGMYQ, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AZxy9wnMgVu2PdFNtFrShYhWfF6PL4mgWumjqVk68voKsnMk6): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836745187 (292h10m50.568012817s) [noise=true , address=104.36.82.35:4604 , piece_id=3XCW633LNRPSU6R3QNBJGXK32WP6QFW56ZZ6ELB2KZNT4OUFL73A, seg_pos={0 0}, upload=303808]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 20 21:37:09.836766718 (292h10m50.568034338s) [seg_pos={0 0}, upload=303808]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 20 21:37:09.836835627 (292h10m50.568103247s) [upload=303808]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 20 21:37:09.836839785 (292h10m50.568107405s) [upload=303808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 20 21:37:10.058695062 (292h10m50.789962712s) [upload=303808]: Done uploading segments... Aug 20 21:37:10.058720261 (292h10m50.78998792s) [upload=303808]: Upload finished. err: <nil> Duration: 483.940004ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 640.314257ms FAIL (2025-08-20 21:37:10 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 640.337783ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 364.590815ms FAIL (2025-08-20 21:37:09 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 364.60968ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................X...........................X...] duration: 647.856011ms FAIL (2025-08-20 21:36:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 21:35:17.938920968 (292h8m58.670188618s) [upload=303777]: Starting upload Aug 20 21:35:17.938986010 (292h8m58.67025366s) [upload=303777]: Done starting upload Aug 20 21:35:17.939064467 (292h8m58.670332117s) [upload=303777]: Uploading segments... Aug 20 21:35:17.939350394 (292h8m58.670618045s) [upload=303777]: Got next segment. Inline: false Aug 20 21:35:17.939401351 (292h8m58.67066901s) [upload=303777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 20 21:35:17.939406651 (292h8m58.6706743s) [upload=303777]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 20 21:35:17.943106251 (292h8m58.674373902s) [upload=303777]: Next segment err: metaclient: Too Many Requests Aug 20 21:35:17.943122994 (292h8m58.674390643s) [upload=303777]: Done uploading segments... Aug 20 21:35:17.943136740 (292h8m58.674404389s) [upload=303777]: Upload finished. err: metaclient: Too Many Requests Duration: 647.879545ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 545.058458ms FAIL (2025-08-20 21:36:36 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 545.075869ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................X...........................X..] duration: 3.270563866s FAIL (2025-08-20 21:36:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 21:35:17.938920968 (292h8m58.670188618s) [upload=303777]: Starting upload Aug 20 21:35:17.938986010 (292h8m58.67025366s) [upload=303777]: Done starting upload Aug 20 21:35:17.939064467 (292h8m58.670332117s) [upload=303777]: Uploading segments... Aug 20 21:35:17.939350394 (292h8m58.670618045s) [upload=303777]: Got next segment. Inline: false Aug 20 21:35:17.939401351 (292h8m58.67066901s) [upload=303777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 20 21:35:17.939406651 (292h8m58.6706743s) [upload=303777]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 20 21:35:17.943106251 (292h8m58.674373902s) [upload=303777]: Next segment err: metaclient: Too Many Requests Aug 20 21:35:17.943122994 (292h8m58.674390643s) [upload=303777]: Done uploading segments... Aug 20 21:35:17.943136740 (292h8m58.674404389s) [upload=303777]: Upload finished. err: metaclient: Too Many Requests Duration: 3.270592059s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 347.436359ms FAIL (2025-08-20 21:35:57 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 347.458119ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................X...........................X.] duration: 1.629254541s FAIL (2025-08-20 21:35:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 21:35:17.938920968 (292h8m58.670188618s) [upload=303777]: Starting upload Aug 20 21:35:17.938986010 (292h8m58.67025366s) [upload=303777]: Done starting upload Aug 20 21:35:17.939064467 (292h8m58.670332117s) [upload=303777]: Uploading segments... Aug 20 21:35:17.939350394 (292h8m58.670618045s) [upload=303777]: Got next segment. Inline: false Aug 20 21:35:17.939401351 (292h8m58.67066901s) [upload=303777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 20 21:35:17.939406651 (292h8m58.6706743s) [upload=303777]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 20 21:35:17.943106251 (292h8m58.674373902s) [upload=303777]: Next segment err: metaclient: Too Many Requests Aug 20 21:35:17.943122994 (292h8m58.674390643s) [upload=303777]: Done uploading segments... Aug 20 21:35:17.943136740 (292h8m58.674404389s) [upload=303777]: Upload finished. err: metaclient: Too Many Requests Duration: 1.629268627s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 593.787487ms FAIL (2025-08-20 21:35:22 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 593.805931ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................X...........................X] duration: 18.56785ms FAIL (2025-08-20 21:35:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 21:35:17.938920968 (292h8m58.670188618s) [upload=303777]: Starting upload Aug 20 21:35:17.938986010 (292h8m58.67025366s) [upload=303777]: Done starting upload Aug 20 21:35:17.939064467 (292h8m58.670332117s) [upload=303777]: Uploading segments... Aug 20 21:35:17.939350394 (292h8m58.670618045s) [upload=303777]: Got next segment. Inline: false Aug 20 21:35:17.939401351 (292h8m58.67066901s) [upload=303777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 20 21:35:17.939406651 (292h8m58.6706743s) [upload=303777]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 20 21:35:17.943106251 (292h8m58.674373902s) [upload=303777]: Next segment err: metaclient: Too Many Requests Aug 20 21:35:17.943122994 (292h8m58.674390643s) [upload=303777]: Done uploading segments... Aug 20 21:35:17.943136740 (292h8m58.674404389s) [upload=303777]: Upload finished. err: metaclient: Too Many Requests Duration: 18.58911ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 646.393756ms FAIL (2025-08-20 21:35:07 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 646.41673ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 398.570879ms FAIL (2025-08-20 21:34:18 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 398.588211ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 697.682538ms FAIL (2025-08-20 21:34:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 21:13:07.605238528 (291h46m48.336506149s) [upload=303403]: Starting upload Aug 20 21:13:07.605303280 (291h46m48.3365709s) [upload=303403]: Done starting upload Aug 20 21:13:07.605442902 (291h46m48.336710522s) [upload=303403]: Uploading segments... Aug 20 21:13:07.605557979 (291h46m48.336825598s) [upload=303403]: Got next segment. Inline: false Aug 20 21:13:07.605603324 (291h46m48.336870944s) [upload=303403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 20 21:13:07.605607742 (291h46m48.336875362s) [upload=303403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 20 21:13:07.661271197 (291h46m48.392538827s) [upload=303403]: Next segment err: metaclient: Too Many Requests Aug 20 21:13:07.661295744 (291h46m48.392563374s) [upload=303403]: Done uploading segments... Aug 20 21:13:07.661309089 (291h46m48.392576719s) [upload=303403]: Upload finished. err: metaclient: Too Many Requests Duration: 697.703788ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 215.390482ms FAIL (2025-08-20 21:33:58 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 215.414088ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 508.052462ms FAIL (2025-08-20 21:33:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 21:13:07.605238528 (291h46m48.336506149s) [upload=303403]: Starting upload Aug 20 21:13:07.605303280 (291h46m48.3365709s) [upload=303403]: Done starting upload Aug 20 21:13:07.605442902 (291h46m48.336710522s) [upload=303403]: Uploading segments... Aug 20 21:13:07.605557979 (291h46m48.336825598s) [upload=303403]: Got next segment. Inline: false Aug 20 21:13:07.605603324 (291h46m48.336870944s) [upload=303403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 20 21:13:07.605607742 (291h46m48.336875362s) [upload=303403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 20 21:13:07.661271197 (291h46m48.392538827s) [upload=303403]: Next segment err: metaclient: Too Many Requests Aug 20 21:13:07.661295744 (291h46m48.392563374s) [upload=303403]: Done uploading segments... Aug 20 21:13:07.661309089 (291h46m48.392576719s) [upload=303403]: Upload finished. err: metaclient: Too Many Requests Duration: 508.078331ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 381.642175ms FAIL (2025-08-20 21:33:23 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 381.662112ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 430.097366ms FAIL (2025-08-20 21:33:18 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 430.148551ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 368.538519ms FAIL (2025-08-20 21:32:22 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 368.557835ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 1.029873448s FAIL (2025-08-20 21:32:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 21:13:07.605238528 (291h46m48.336506149s) [upload=303403]: Starting upload Aug 20 21:13:07.605303280 (291h46m48.3365709s) [upload=303403]: Done starting upload Aug 20 21:13:07.605442902 (291h46m48.336710522s) [upload=303403]: Uploading segments... Aug 20 21:13:07.605557979 (291h46m48.336825598s) [upload=303403]: Got next segment. Inline: false Aug 20 21:13:07.605603324 (291h46m48.336870944s) [upload=303403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 20 21:13:07.605607742 (291h46m48.336875362s) [upload=303403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 20 21:13:07.661271197 (291h46m48.392538827s) [upload=303403]: Next segment err: metaclient: Too Many Requests Aug 20 21:13:07.661295744 (291h46m48.392563374s) [upload=303403]: Done uploading segments... Aug 20 21:13:07.661309089 (291h46m48.392576719s) [upload=303403]: Upload finished. err: metaclient: Too Many Requests Duration: 1.029944872s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 350.814108ms FAIL (2025-08-20 21:32:07 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 350.859643ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 1.255982058s FAIL (2025-08-20 21:31:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 21:13:07.605238528 (291h46m48.336506149s) [upload=303403]: Starting upload Aug 20 21:13:07.605303280 (291h46m48.3365709s) [upload=303403]: Done starting upload Aug 20 21:13:07.605442902 (291h46m48.336710522s) [upload=303403]: Uploading segments... Aug 20 21:13:07.605557979 (291h46m48.336825598s) [upload=303403]: Got next segment. Inline: false Aug 20 21:13:07.605603324 (291h46m48.336870944s) [upload=303403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 20 21:13:07.605607742 (291h46m48.336875362s) [upload=303403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 20 21:13:07.661271197 (291h46m48.392538827s) [upload=303403]: Next segment err: metaclient: Too Many Requests Aug 20 21:13:07.661295744 (291h46m48.392563374s) [upload=303403]: Done uploading segments... Aug 20 21:13:07.661309089 (291h46m48.392576719s) [upload=303403]: Upload finished. err: metaclient: Too Many Requests Duration: 1.256000463s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)