Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
4.937062241s
FAIL (2025-08-19 13:06:16 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 4.937085184s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
1.01430731s
FAIL (2025-08-19 13:05:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:20:07.677466493 (258h53m48.408734123s) [upload=269265]: Starting upload Aug 19 12:20:07.677509174 (258h53m48.408776804s) [upload=269265]: Done starting upload Aug 19 12:20:07.677563275 (258h53m48.408830906s) [upload=269265]: Uploading segments... Aug 19 12:20:07.677623548 (258h53m48.408891179s) [upload=269265]: Got next segment. Inline: true Aug 19 12:20:07.677627495 (258h53m48.408895126s) [upload=269265]: Waiting for error group managing segments... Aug 19 12:20:07.677658874 (258h53m48.408926495s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:20:07.677662702 (258h53m48.408930321s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 12:20:07.677665737 (258h53m48.408933357s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 12:20:07.680023482 (258h53m48.411291112s) [upload=269265]: Done uploading segments... Aug 19 12:20:07.680031718 (258h53m48.411299337s) [upload=269265]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.014329881s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
4.718503717s
FAIL (2025-08-19 13:05:49 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 4.718532202s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.29216534s
FAIL (2025-08-19 13:05:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:46:27.864410219 (259h20m8.59567787s) [upload=269715]: Starting upload Aug 19 12:46:27.864472948 (259h20m8.595740597s) [upload=269715]: Done starting upload Aug 19 12:46:27.864558107 (259h20m8.595825757s) [upload=269715]: Uploading segments... Aug 19 12:46:27.864850548 (259h20m8.596118197s) [upload=269715]: Got next segment. Inline: false Aug 19 12:46:27.864898468 (259h20m8.596166117s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:46:27.864904048 (259h20m8.596171698s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 12:46:27.868566564 (259h20m8.599834224s) [upload=269715]: Next segment err: metaclient: Too Many Requests Aug 19 12:46:27.868583536 (259h20m8.599851186s) [upload=269715]: Done uploading segments... Aug 19 12:46:27.868597251 (259h20m8.599864911s) [upload=269715]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.292188723s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
5.048640055s
FAIL (2025-08-19 13:05:27 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.048665212s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
412.644814ms
FAIL (2025-08-19 13:05:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:20:07.677466493 (258h53m48.408734123s) [upload=269265]: Starting upload Aug 19 12:20:07.677509174 (258h53m48.408776804s) [upload=269265]: Done starting upload Aug 19 12:20:07.677563275 (258h53m48.408830906s) [upload=269265]: Uploading segments... Aug 19 12:20:07.677623548 (258h53m48.408891179s) [upload=269265]: Got next segment. Inline: true Aug 19 12:20:07.677627495 (258h53m48.408895126s) [upload=269265]: Waiting for error group managing segments... Aug 19 12:20:07.677658874 (258h53m48.408926495s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:20:07.677662702 (258h53m48.408930321s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 12:20:07.677665737 (258h53m48.408933357s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 12:20:07.680023482 (258h53m48.411291112s) [upload=269265]: Done uploading segments... Aug 19 12:20:07.680031718 (258h53m48.411299337s) [upload=269265]: Upload finished. err: metaclient: Too Many Requests
Duration: 412.667537ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
4.917959847s
FAIL (2025-08-19 13:04:50 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 4.91798334s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
460.859689ms
FAIL (2025-08-19 13:04:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:46:27.864410219 (259h20m8.59567787s) [upload=269715]: Starting upload Aug 19 12:46:27.864472948 (259h20m8.595740597s) [upload=269715]: Done starting upload Aug 19 12:46:27.864558107 (259h20m8.595825757s) [upload=269715]: Uploading segments... Aug 19 12:46:27.864850548 (259h20m8.596118197s) [upload=269715]: Got next segment. Inline: false Aug 19 12:46:27.864898468 (259h20m8.596166117s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:46:27.864904048 (259h20m8.596171698s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 12:46:27.868566564 (259h20m8.599834224s) [upload=269715]: Next segment err: metaclient: Too Many Requests Aug 19 12:46:27.868583536 (259h20m8.599851186s) [upload=269715]: Done uploading segments... Aug 19 12:46:27.868597251 (259h20m8.599864911s) [upload=269715]: Upload finished. err: metaclient: Too Many Requests
Duration: 460.884866ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
150.21262ms
FAIL (2025-08-19 13:04:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:20:07.677466493 (258h53m48.408734123s) [upload=269265]: Starting upload Aug 19 12:20:07.677509174 (258h53m48.408776804s) [upload=269265]: Done starting upload Aug 19 12:20:07.677563275 (258h53m48.408830906s) [upload=269265]: Uploading segments... Aug 19 12:20:07.677623548 (258h53m48.408891179s) [upload=269265]: Got next segment. Inline: true Aug 19 12:20:07.677627495 (258h53m48.408895126s) [upload=269265]: Waiting for error group managing segments... Aug 19 12:20:07.677658874 (258h53m48.408926495s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:20:07.677662702 (258h53m48.408930321s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 12:20:07.677665737 (258h53m48.408933357s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 12:20:07.680023482 (258h53m48.411291112s) [upload=269265]: Done uploading segments... Aug 19 12:20:07.680031718 (258h53m48.411299337s) [upload=269265]: Upload finished. err: metaclient: Too Many Requests
Duration: 150.241505ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
1.713238173s
FAIL (2025-08-19 13:03:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:46:27.864410219 (259h20m8.59567787s) [upload=269715]: Starting upload Aug 19 12:46:27.864472948 (259h20m8.595740597s) [upload=269715]: Done starting upload Aug 19 12:46:27.864558107 (259h20m8.595825757s) [upload=269715]: Uploading segments... Aug 19 12:46:27.864850548 (259h20m8.596118197s) [upload=269715]: Got next segment. Inline: false Aug 19 12:46:27.864898468 (259h20m8.596166117s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:46:27.864904048 (259h20m8.596171698s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 12:46:27.868566564 (259h20m8.599834224s) [upload=269715]: Next segment err: metaclient: Too Many Requests Aug 19 12:46:27.868583536 (259h20m8.599851186s) [upload=269715]: Done uploading segments... Aug 19 12:46:27.868597251 (259h20m8.599864911s) [upload=269715]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.713266086s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
5.323583847s
FAIL (2025-08-19 13:03:39 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.323610537s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
201.271968ms
FAIL (2025-08-19 13:03:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:20:07.677466493 (258h53m48.408734123s) [upload=269265]: Starting upload Aug 19 12:20:07.677509174 (258h53m48.408776804s) [upload=269265]: Done starting upload Aug 19 12:20:07.677563275 (258h53m48.408830906s) [upload=269265]: Uploading segments... Aug 19 12:20:07.677623548 (258h53m48.408891179s) [upload=269265]: Got next segment. Inline: true Aug 19 12:20:07.677627495 (258h53m48.408895126s) [upload=269265]: Waiting for error group managing segments... Aug 19 12:20:07.677658874 (258h53m48.408926495s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:20:07.677662702 (258h53m48.408930321s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 12:20:07.677665737 (258h53m48.408933357s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 12:20:07.680023482 (258h53m48.411291112s) [upload=269265]: Done uploading segments... Aug 19 12:20:07.680031718 (258h53m48.411299337s) [upload=269265]: Upload finished. err: metaclient: Too Many Requests
Duration: 201.293578ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
441.992099ms
FAIL (2025-08-19 13:03:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:46:27.864410219 (259h20m8.59567787s) [upload=269715]: Starting upload Aug 19 12:46:27.864472948 (259h20m8.595740597s) [upload=269715]: Done starting upload Aug 19 12:46:27.864558107 (259h20m8.595825757s) [upload=269715]: Uploading segments... Aug 19 12:46:27.864850548 (259h20m8.596118197s) [upload=269715]: Got next segment. Inline: false Aug 19 12:46:27.864898468 (259h20m8.596166117s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:46:27.864904048 (259h20m8.596171698s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 12:46:27.868566564 (259h20m8.599834224s) [upload=269715]: Next segment err: metaclient: Too Many Requests Aug 19 12:46:27.868583536 (259h20m8.599851186s) [upload=269715]: Done uploading segments... Aug 19 12:46:27.868597251 (259h20m8.599864911s) [upload=269715]: Upload finished. err: metaclient: Too Many Requests
Duration: 442.014421ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
5.085078247s
FAIL (2025-08-19 13:02:41 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.085103213s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.574703715s
FAIL (2025-08-19 13:02:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:20:07.677466493 (258h53m48.408734123s) [upload=269265]: Starting upload Aug 19 12:20:07.677509174 (258h53m48.408776804s) [upload=269265]: Done starting upload Aug 19 12:20:07.677563275 (258h53m48.408830906s) [upload=269265]: Uploading segments... Aug 19 12:20:07.677623548 (258h53m48.408891179s) [upload=269265]: Got next segment. Inline: true Aug 19 12:20:07.677627495 (258h53m48.408895126s) [upload=269265]: Waiting for error group managing segments... Aug 19 12:20:07.677658874 (258h53m48.408926495s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:20:07.677662702 (258h53m48.408930321s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 12:20:07.677665737 (258h53m48.408933357s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 12:20:07.680023482 (258h53m48.411291112s) [upload=269265]: Done uploading segments... Aug 19 12:20:07.680031718 (258h53m48.411299337s) [upload=269265]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.574731587s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
679.219758ms
FAIL (2025-08-19 13:02:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:46:27.864410219 (259h20m8.59567787s) [upload=269715]: Starting upload Aug 19 12:46:27.864472948 (259h20m8.595740597s) [upload=269715]: Done starting upload Aug 19 12:46:27.864558107 (259h20m8.595825757s) [upload=269715]: Uploading segments... Aug 19 12:46:27.864850548 (259h20m8.596118197s) [upload=269715]: Got next segment. Inline: false Aug 19 12:46:27.864898468 (259h20m8.596166117s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:46:27.864904048 (259h20m8.596171698s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 12:46:27.868566564 (259h20m8.599834224s) [upload=269715]: Next segment err: metaclient: Too Many Requests Aug 19 12:46:27.868583536 (259h20m8.599851186s) [upload=269715]: Done uploading segments... Aug 19 12:46:27.868597251 (259h20m8.599864911s) [upload=269715]: Upload finished. err: metaclient: Too Many Requests
Duration: 679.236279ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
533.884113ms
FAIL (2025-08-19 13:01:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:20:07.677466493 (258h53m48.408734123s) [upload=269265]: Starting upload Aug 19 12:20:07.677509174 (258h53m48.408776804s) [upload=269265]: Done starting upload Aug 19 12:20:07.677563275 (258h53m48.408830906s) [upload=269265]: Uploading segments... Aug 19 12:20:07.677623548 (258h53m48.408891179s) [upload=269265]: Got next segment. Inline: true Aug 19 12:20:07.677627495 (258h53m48.408895126s) [upload=269265]: Waiting for error group managing segments... Aug 19 12:20:07.677658874 (258h53m48.408926495s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:20:07.677662702 (258h53m48.408930321s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 12:20:07.677665737 (258h53m48.408933357s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 12:20:07.680023482 (258h53m48.411291112s) [upload=269265]: Done uploading segments... Aug 19 12:20:07.680031718 (258h53m48.411299337s) [upload=269265]: Upload finished. err: metaclient: Too Many Requests
Duration: 533.90442ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
4.962912709s
FAIL (2025-08-19 13:01:30 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 4.962944088s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
836.273062ms
FAIL (2025-08-19 13:01:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:46:27.864410219 (259h20m8.59567787s) [upload=269715]: Starting upload Aug 19 12:46:27.864472948 (259h20m8.595740597s) [upload=269715]: Done starting upload Aug 19 12:46:27.864558107 (259h20m8.595825757s) [upload=269715]: Uploading segments... Aug 19 12:46:27.864850548 (259h20m8.596118197s) [upload=269715]: Got next segment. Inline: false Aug 19 12:46:27.864898468 (259h20m8.596166117s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:46:27.864904048 (259h20m8.596171698s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 12:46:27.868566564 (259h20m8.599834224s) [upload=269715]: Next segment err: metaclient: Too Many Requests Aug 19 12:46:27.868583536 (259h20m8.599851186s) [upload=269715]: Done uploading segments... Aug 19 12:46:27.868597251 (259h20m8.599864911s) [upload=269715]: Upload finished. err: metaclient: Too Many Requests
Duration: 836.318818ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
159.772801ms
FAIL (2025-08-19 13:00:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:20:07.677466493 (258h53m48.408734123s) [upload=269265]: Starting upload Aug 19 12:20:07.677509174 (258h53m48.408776804s) [upload=269265]: Done starting upload Aug 19 12:20:07.677563275 (258h53m48.408830906s) [upload=269265]: Uploading segments... Aug 19 12:20:07.677623548 (258h53m48.408891179s) [upload=269265]: Got next segment. Inline: true Aug 19 12:20:07.677627495 (258h53m48.408895126s) [upload=269265]: Waiting for error group managing segments... Aug 19 12:20:07.677658874 (258h53m48.408926495s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:20:07.677662702 (258h53m48.408930321s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 12:20:07.677665737 (258h53m48.408933357s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 12:20:07.680023482 (258h53m48.411291112s) [upload=269265]: Done uploading segments... Aug 19 12:20:07.680031718 (258h53m48.411299337s) [upload=269265]: Upload finished. err: metaclient: Too Many Requests
Duration: 159.797578ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
5.0738074s
FAIL (2025-08-19 13:00:39 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.073830173s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
176.267081ms
FAIL (2025-08-19 13:00:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:20:07.677466493 (258h53m48.408734123s) [upload=269265]: Starting upload Aug 19 12:20:07.677509174 (258h53m48.408776804s) [upload=269265]: Done starting upload Aug 19 12:20:07.677563275 (258h53m48.408830906s) [upload=269265]: Uploading segments... Aug 19 12:20:07.677623548 (258h53m48.408891179s) [upload=269265]: Got next segment. Inline: true Aug 19 12:20:07.677627495 (258h53m48.408895126s) [upload=269265]: Waiting for error group managing segments... Aug 19 12:20:07.677658874 (258h53m48.408926495s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:20:07.677662702 (258h53m48.408930321s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 12:20:07.677665737 (258h53m48.408933357s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 12:20:07.680023482 (258h53m48.411291112s) [upload=269265]: Done uploading segments... Aug 19 12:20:07.680031718 (258h53m48.411299337s) [upload=269265]: Upload finished. err: metaclient: Too Many Requests
Duration: 176.292939ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
667.448584ms
FAIL (2025-08-19 13:00:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:46:27.864410219 (259h20m8.59567787s) [upload=269715]: Starting upload Aug 19 12:46:27.864472948 (259h20m8.595740597s) [upload=269715]: Done starting upload Aug 19 12:46:27.864558107 (259h20m8.595825757s) [upload=269715]: Uploading segments... Aug 19 12:46:27.864850548 (259h20m8.596118197s) [upload=269715]: Got next segment. Inline: false Aug 19 12:46:27.864898468 (259h20m8.596166117s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:46:27.864904048 (259h20m8.596171698s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 12:46:27.868566564 (259h20m8.599834224s) [upload=269715]: Next segment err: metaclient: Too Many Requests Aug 19 12:46:27.868583536 (259h20m8.599851186s) [upload=269715]: Done uploading segments... Aug 19 12:46:27.868597251 (259h20m8.599864911s) [upload=269715]: Upload finished. err: metaclient: Too Many Requests
Duration: 667.471207ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
478.26106ms
FAIL (2025-08-19 12:59:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:46:27.864410219 (259h20m8.59567787s) [upload=269715]: Starting upload Aug 19 12:46:27.864472948 (259h20m8.595740597s) [upload=269715]: Done starting upload Aug 19 12:46:27.864558107 (259h20m8.595825757s) [upload=269715]: Uploading segments... Aug 19 12:46:27.864850548 (259h20m8.596118197s) [upload=269715]: Got next segment. Inline: false Aug 19 12:46:27.864898468 (259h20m8.596166117s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:46:27.864904048 (259h20m8.596171698s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 12:46:27.868566564 (259h20m8.599834224s) [upload=269715]: Next segment err: metaclient: Too Many Requests Aug 19 12:46:27.868583536 (259h20m8.599851186s) [upload=269715]: Done uploading segments... Aug 19 12:46:27.868597251 (259h20m8.599864911s) [upload=269715]: Upload finished. err: metaclient: Too Many Requests
Duration: 478.285356ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
5.158194324s
FAIL (2025-08-19 12:59:32 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.158320722s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
604.312998ms
FAIL (2025-08-19 12:59:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:46:27.864410219 (259h20m8.59567787s) [upload=269715]: Starting upload Aug 19 12:46:27.864472948 (259h20m8.595740597s) [upload=269715]: Done starting upload Aug 19 12:46:27.864558107 (259h20m8.595825757s) [upload=269715]: Uploading segments... Aug 19 12:46:27.864850548 (259h20m8.596118197s) [upload=269715]: Got next segment. Inline: false Aug 19 12:46:27.864898468 (259h20m8.596166117s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:46:27.864904048 (259h20m8.596171698s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 12:46:27.868566564 (259h20m8.599834224s) [upload=269715]: Next segment err: metaclient: Too Many Requests Aug 19 12:46:27.868583536 (259h20m8.599851186s) [upload=269715]: Done uploading segments... Aug 19 12:46:27.868597251 (259h20m8.599864911s) [upload=269715]: Upload finished. err: metaclient: Too Many Requests
Duration: 604.331062ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
142.519117ms
FAIL (2025-08-19 12:59:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:20:07.677466493 (258h53m48.408734123s) [upload=269265]: Starting upload Aug 19 12:20:07.677509174 (258h53m48.408776804s) [upload=269265]: Done starting upload Aug 19 12:20:07.677563275 (258h53m48.408830906s) [upload=269265]: Uploading segments... Aug 19 12:20:07.677623548 (258h53m48.408891179s) [upload=269265]: Got next segment. Inline: true Aug 19 12:20:07.677627495 (258h53m48.408895126s) [upload=269265]: Waiting for error group managing segments... Aug 19 12:20:07.677658874 (258h53m48.408926495s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:20:07.677662702 (258h53m48.408930321s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 12:20:07.677665737 (258h53m48.408933357s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 12:20:07.680023482 (258h53m48.411291112s) [upload=269265]: Done uploading segments... Aug 19 12:20:07.680031718 (258h53m48.411299337s) [upload=269265]: Upload finished. err: metaclient: Too Many Requests
Duration: 142.557129ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
4.765263479s
FAIL (2025-08-19 12:59:15 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 4.765291512s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
166.784105ms
FAIL (2025-08-19 12:58:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:20:07.677466493 (258h53m48.408734123s) [upload=269265]: Starting upload Aug 19 12:20:07.677509174 (258h53m48.408776804s) [upload=269265]: Done starting upload Aug 19 12:20:07.677563275 (258h53m48.408830906s) [upload=269265]: Uploading segments... Aug 19 12:20:07.677623548 (258h53m48.408891179s) [upload=269265]: Got next segment. Inline: true Aug 19 12:20:07.677627495 (258h53m48.408895126s) [upload=269265]: Waiting for error group managing segments... Aug 19 12:20:07.677658874 (258h53m48.408926495s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:20:07.677662702 (258h53m48.408930321s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 12:20:07.677665737 (258h53m48.408933357s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 12:20:07.680023482 (258h53m48.411291112s) [upload=269265]: Done uploading segments... Aug 19 12:20:07.680031718 (258h53m48.411299337s) [upload=269265]: Upload finished. err: metaclient: Too Many Requests
Duration: 166.807568ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
4.911281862s
FAIL (2025-08-19 12:58:38 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 4.911298634s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
445.022922ms
FAIL (2025-08-19 12:58:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:46:27.864410219 (259h20m8.59567787s) [upload=269715]: Starting upload Aug 19 12:46:27.864472948 (259h20m8.595740597s) [upload=269715]: Done starting upload Aug 19 12:46:27.864558107 (259h20m8.595825757s) [upload=269715]: Uploading segments... Aug 19 12:46:27.864850548 (259h20m8.596118197s) [upload=269715]: Got next segment. Inline: false Aug 19 12:46:27.864898468 (259h20m8.596166117s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:46:27.864904048 (259h20m8.596171698s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 12:46:27.868566564 (259h20m8.599834224s) [upload=269715]: Next segment err: metaclient: Too Many Requests Aug 19 12:46:27.868583536 (259h20m8.599851186s) [upload=269715]: Done uploading segments... Aug 19 12:46:27.868597251 (259h20m8.599864911s) [upload=269715]: Upload finished. err: metaclient: Too Many Requests
Duration: 445.064931ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
4.761466944s
FAIL (2025-08-19 12:58:18 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 4.761492211s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
168.190504ms
FAIL (2025-08-19 12:58:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:20:07.677466493 (258h53m48.408734123s) [upload=269265]: Starting upload Aug 19 12:20:07.677509174 (258h53m48.408776804s) [upload=269265]: Done starting upload Aug 19 12:20:07.677563275 (258h53m48.408830906s) [upload=269265]: Uploading segments... Aug 19 12:20:07.677623548 (258h53m48.408891179s) [upload=269265]: Got next segment. Inline: true Aug 19 12:20:07.677627495 (258h53m48.408895126s) [upload=269265]: Waiting for error group managing segments... Aug 19 12:20:07.677658874 (258h53m48.408926495s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:20:07.677662702 (258h53m48.408930321s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 12:20:07.677665737 (258h53m48.408933357s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 12:20:07.680023482 (258h53m48.411291112s) [upload=269265]: Done uploading segments... Aug 19 12:20:07.680031718 (258h53m48.411299337s) [upload=269265]: Upload finished. err: metaclient: Too Many Requests
Duration: 168.271536ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
463.003014ms
FAIL (2025-08-19 12:57:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:46:27.864410219 (259h20m8.59567787s) [upload=269715]: Starting upload Aug 19 12:46:27.864472948 (259h20m8.595740597s) [upload=269715]: Done starting upload Aug 19 12:46:27.864558107 (259h20m8.595825757s) [upload=269715]: Uploading segments... Aug 19 12:46:27.864850548 (259h20m8.596118197s) [upload=269715]: Got next segment. Inline: false Aug 19 12:46:27.864898468 (259h20m8.596166117s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:46:27.864904048 (259h20m8.596171698s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 12:46:27.868566564 (259h20m8.599834224s) [upload=269715]: Next segment err: metaclient: Too Many Requests Aug 19 12:46:27.868583536 (259h20m8.599851186s) [upload=269715]: Done uploading segments... Aug 19 12:46:27.868597251 (259h20m8.599864911s) [upload=269715]: Upload finished. err: metaclient: Too Many Requests
Duration: 463.026298ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
581.783163ms
FAIL (2025-08-19 12:57:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:46:27.864410219 (259h20m8.59567787s) [upload=269715]: Starting upload Aug 19 12:46:27.864472948 (259h20m8.595740597s) [upload=269715]: Done starting upload Aug 19 12:46:27.864558107 (259h20m8.595825757s) [upload=269715]: Uploading segments... Aug 19 12:46:27.864850548 (259h20m8.596118197s) [upload=269715]: Got next segment. Inline: false Aug 19 12:46:27.864898468 (259h20m8.596166117s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:46:27.864904048 (259h20m8.596171698s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 12:46:27.868566564 (259h20m8.599834224s) [upload=269715]: Next segment err: metaclient: Too Many Requests Aug 19 12:46:27.868583536 (259h20m8.599851186s) [upload=269715]: Done uploading segments... Aug 19 12:46:27.868597251 (259h20m8.599864911s) [upload=269715]: Upload finished. err: metaclient: Too Many Requests
Duration: 581.815904ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
1.843419284s
FAIL (2025-08-19 12:57:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:20:07.677466493 (258h53m48.408734123s) [upload=269265]: Starting upload Aug 19 12:20:07.677509174 (258h53m48.408776804s) [upload=269265]: Done starting upload Aug 19 12:20:07.677563275 (258h53m48.408830906s) [upload=269265]: Uploading segments... Aug 19 12:20:07.677623548 (258h53m48.408891179s) [upload=269265]: Got next segment. Inline: true Aug 19 12:20:07.677627495 (258h53m48.408895126s) [upload=269265]: Waiting for error group managing segments... Aug 19 12:20:07.677658874 (258h53m48.408926495s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:20:07.677662702 (258h53m48.408930321s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 12:20:07.677665737 (258h53m48.408933357s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 12:20:07.680023482 (258h53m48.411291112s) [upload=269265]: Done uploading segments... Aug 19 12:20:07.680031718 (258h53m48.411299337s) [upload=269265]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.84343812s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.116601109s
FAIL (2025-08-19 12:57:15 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.116633179s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
459.548284ms
FAIL (2025-08-19 12:56:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:46:27.864410219 (259h20m8.59567787s) [upload=269715]: Starting upload Aug 19 12:46:27.864472948 (259h20m8.595740597s) [upload=269715]: Done starting upload Aug 19 12:46:27.864558107 (259h20m8.595825757s) [upload=269715]: Uploading segments... Aug 19 12:46:27.864850548 (259h20m8.596118197s) [upload=269715]: Got next segment. Inline: false Aug 19 12:46:27.864898468 (259h20m8.596166117s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:46:27.864904048 (259h20m8.596171698s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 12:46:27.868566564 (259h20m8.599834224s) [upload=269715]: Next segment err: metaclient: Too Many Requests Aug 19 12:46:27.868583536 (259h20m8.599851186s) [upload=269715]: Done uploading segments... Aug 19 12:46:27.868597251 (259h20m8.599864911s) [upload=269715]: Upload finished. err: metaclient: Too Many Requests
Duration: 459.570556ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
179.821748ms
FAIL (2025-08-19 12:56:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:20:07.677466493 (258h53m48.408734123s) [upload=269265]: Starting upload Aug 19 12:20:07.677509174 (258h53m48.408776804s) [upload=269265]: Done starting upload Aug 19 12:20:07.677563275 (258h53m48.408830906s) [upload=269265]: Uploading segments... Aug 19 12:20:07.677623548 (258h53m48.408891179s) [upload=269265]: Got next segment. Inline: true Aug 19 12:20:07.677627495 (258h53m48.408895126s) [upload=269265]: Waiting for error group managing segments... Aug 19 12:20:07.677658874 (258h53m48.408926495s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:20:07.677662702 (258h53m48.408930321s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 12:20:07.677665737 (258h53m48.408933357s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 12:20:07.680023482 (258h53m48.411291112s) [upload=269265]: Done uploading segments... Aug 19 12:20:07.680031718 (258h53m48.411299337s) [upload=269265]: Upload finished. err: metaclient: Too Many Requests
Duration: 179.84448ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.29038639s
FAIL (2025-08-19 12:56:20 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.290408231s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
188.129396ms
FAIL (2025-08-19 12:55:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:20:07.677466493 (258h53m48.408734123s) [upload=269265]: Starting upload Aug 19 12:20:07.677509174 (258h53m48.408776804s) [upload=269265]: Done starting upload Aug 19 12:20:07.677563275 (258h53m48.408830906s) [upload=269265]: Uploading segments... Aug 19 12:20:07.677623548 (258h53m48.408891179s) [upload=269265]: Got next segment. Inline: true Aug 19 12:20:07.677627495 (258h53m48.408895126s) [upload=269265]: Waiting for error group managing segments... Aug 19 12:20:07.677658874 (258h53m48.408926495s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:20:07.677662702 (258h53m48.408930321s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 12:20:07.677665737 (258h53m48.408933357s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 12:20:07.680023482 (258h53m48.411291112s) [upload=269265]: Done uploading segments... Aug 19 12:20:07.680031718 (258h53m48.411299337s) [upload=269265]: Upload finished. err: metaclient: Too Many Requests
Duration: 188.154624ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
5.344814246s
FAIL (2025-08-19 12:55:31 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.344838481s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
439.900027ms
FAIL (2025-08-19 12:55:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:46:27.864410219 (259h20m8.59567787s) [upload=269715]: Starting upload Aug 19 12:46:27.864472948 (259h20m8.595740597s) [upload=269715]: Done starting upload Aug 19 12:46:27.864558107 (259h20m8.595825757s) [upload=269715]: Uploading segments... Aug 19 12:46:27.864850548 (259h20m8.596118197s) [upload=269715]: Got next segment. Inline: false Aug 19 12:46:27.864898468 (259h20m8.596166117s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:46:27.864904048 (259h20m8.596171698s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 12:46:27.868566564 (259h20m8.599834224s) [upload=269715]: Next segment err: metaclient: Too Many Requests Aug 19 12:46:27.868583536 (259h20m8.599851186s) [upload=269715]: Done uploading segments... Aug 19 12:46:27.868597251 (259h20m8.599864911s) [upload=269715]: Upload finished. err: metaclient: Too Many Requests
Duration: 439.922228ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
595.534116ms
FAIL (2025-08-19 12:55:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:20:07.677466493 (258h53m48.408734123s) [upload=269265]: Starting upload Aug 19 12:20:07.677509174 (258h53m48.408776804s) [upload=269265]: Done starting upload Aug 19 12:20:07.677563275 (258h53m48.408830906s) [upload=269265]: Uploading segments... Aug 19 12:20:07.677623548 (258h53m48.408891179s) [upload=269265]: Got next segment. Inline: true Aug 19 12:20:07.677627495 (258h53m48.408895126s) [upload=269265]: Waiting for error group managing segments... Aug 19 12:20:07.677658874 (258h53m48.408926495s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:20:07.677662702 (258h53m48.408930321s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 12:20:07.677665737 (258h53m48.408933357s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 12:20:07.680023482 (258h53m48.411291112s) [upload=269265]: Done uploading segments... Aug 19 12:20:07.680031718 (258h53m48.411299337s) [upload=269265]: Upload finished. err: metaclient: Too Many Requests
Duration: 595.558463ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
844.126767ms
FAIL (2025-08-19 12:55:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:46:27.864410219 (259h20m8.59567787s) [upload=269715]: Starting upload Aug 19 12:46:27.864472948 (259h20m8.595740597s) [upload=269715]: Done starting upload Aug 19 12:46:27.864558107 (259h20m8.595825757s) [upload=269715]: Uploading segments... Aug 19 12:46:27.864850548 (259h20m8.596118197s) [upload=269715]: Got next segment. Inline: false Aug 19 12:46:27.864898468 (259h20m8.596166117s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:46:27.864904048 (259h20m8.596171698s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 12:46:27.868566564 (259h20m8.599834224s) [upload=269715]: Next segment err: metaclient: Too Many Requests Aug 19 12:46:27.868583536 (259h20m8.599851186s) [upload=269715]: Done uploading segments... Aug 19 12:46:27.868597251 (259h20m8.599864911s) [upload=269715]: Upload finished. err: metaclient: Too Many Requests
Duration: 844.148288ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
5.065288964s
FAIL (2025-08-19 12:54:46 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.065338427s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
724.143605ms
FAIL (2025-08-19 12:54:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:46:27.864410219 (259h20m8.59567787s) [upload=269715]: Starting upload Aug 19 12:46:27.864472948 (259h20m8.595740597s) [upload=269715]: Done starting upload Aug 19 12:46:27.864558107 (259h20m8.595825757s) [upload=269715]: Uploading segments... Aug 19 12:46:27.864850548 (259h20m8.596118197s) [upload=269715]: Got next segment. Inline: false Aug 19 12:46:27.864898468 (259h20m8.596166117s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:46:27.864904048 (259h20m8.596171698s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 12:46:27.868566564 (259h20m8.599834224s) [upload=269715]: Next segment err: metaclient: Too Many Requests Aug 19 12:46:27.868583536 (259h20m8.599851186s) [upload=269715]: Done uploading segments... Aug 19 12:46:27.868597251 (259h20m8.599864911s) [upload=269715]: Upload finished. err: metaclient: Too Many Requests
Duration: 724.170507ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
269.162487ms
FAIL (2025-08-19 12:54:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:20:07.677466493 (258h53m48.408734123s) [upload=269265]: Starting upload Aug 19 12:20:07.677509174 (258h53m48.408776804s) [upload=269265]: Done starting upload Aug 19 12:20:07.677563275 (258h53m48.408830906s) [upload=269265]: Uploading segments... Aug 19 12:20:07.677623548 (258h53m48.408891179s) [upload=269265]: Got next segment. Inline: true Aug 19 12:20:07.677627495 (258h53m48.408895126s) [upload=269265]: Waiting for error group managing segments... Aug 19 12:20:07.677658874 (258h53m48.408926495s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:20:07.677662702 (258h53m48.408930321s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 12:20:07.677665737 (258h53m48.408933357s) [upload=269265]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 12:20:07.680023482 (258h53m48.411291112s) [upload=269265]: Done uploading segments... Aug 19 12:20:07.680031718 (258h53m48.411299337s) [upload=269265]: Upload finished. err: metaclient: Too Many Requests
Duration: 269.189937ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.215451946s
FAIL (2025-08-19 12:53:46 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.215479908s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
614.694573ms
FAIL (2025-08-19 12:53:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 12:46:27.864410219 (259h20m8.59567787s) [upload=269715]: Starting upload Aug 19 12:46:27.864472948 (259h20m8.595740597s) [upload=269715]: Done starting upload Aug 19 12:46:27.864558107 (259h20m8.595825757s) [upload=269715]: Uploading segments... Aug 19 12:46:27.864850548 (259h20m8.596118197s) [upload=269715]: Got next segment. Inline: false Aug 19 12:46:27.864898468 (259h20m8.596166117s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 12:46:27.864904048 (259h20m8.596171698s) [upload=269715]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 12:46:27.868566564 (259h20m8.599834224s) [upload=269715]: Next segment err: metaclient: Too Many Requests Aug 19 12:46:27.868583536 (259h20m8.599851186s) [upload=269715]: Done uploading segments... Aug 19 12:46:27.868597251 (259h20m8.599864911s) [upload=269715]: Upload finished. err: metaclient: Too Many Requests
Duration: 614.713449ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|