Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
171.934364ms
FAIL (2025-08-09 05:15:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 171.955182ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
312.702191ms
FAIL (2025-08-09 05:14:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 312.737346ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
153.616121ms
FAIL (2025-08-09 05:12:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 153.64771ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
140.071375ms
FAIL (2025-08-09 05:12:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 140.097084ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
140.51283ms
FAIL (2025-08-09 05:11:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 140.536965ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
239.078924ms
FAIL (2025-08-09 05:11:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 239.105734ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
139.905977ms
FAIL (2025-08-09 05:10:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 139.932126ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
428.625717ms
FAIL (2025-08-09 05:09:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 428.665133ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
155.931993ms
FAIL (2025-08-09 05:09:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 155.958772ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
545.734607ms
FAIL (2025-08-09 05:09:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 545.919523ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
153.458855ms
FAIL (2025-08-09 05:08:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 153.478371ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
427.810465ms
FAIL (2025-08-09 05:08:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 427.838407ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
409.324057ms
FAIL (2025-08-09 05:07:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 409.346569ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
161.242766ms
FAIL (2025-08-09 05:07:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 161.267823ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
718.656255ms
FAIL (2025-08-09 05:06:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 718.677335ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
30.648001ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 05:06:18 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 30.675373ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
515.510138ms
FAIL (2025-08-09 05:06:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 515.614523ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
217.219108ms
FAIL (2025-08-09 05:06:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 217.244595ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
702.396904ms
FAIL (2025-08-09 05:05:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 702.430687ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
424.712834ms
FAIL (2025-08-09 05:05:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 424.731348ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
155.92479ms
FAIL (2025-08-09 05:05:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 155.941793ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
562.786287ms
FAIL (2025-08-09 05:05:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 562.918905ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
157.117384ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 05:05:26 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 157.138685ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
25.790315ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 05:04:42 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 25.812415ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
672.490017ms
FAIL (2025-08-09 05:04:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 672.506818ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
285.310468ms
FAIL (2025-08-09 05:04:35 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 285.347858ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
166.772229ms
FAIL (2025-08-09 05:04:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 166.798639ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
112.838826ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 05:04:26 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 112.871708ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
641.153879ms
FAIL (2025-08-09 05:04:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 641.174169ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
450.283514ms
FAIL (2025-08-09 05:03:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 450.45818ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
27.787872ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 05:03:42 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 27.805876ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
240.992428ms
FAIL (2025-08-09 05:03:39 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 241.013227ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
175.772639ms
FAIL (2025-08-09 05:03:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 175.796203ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
377.470754ms
FAIL (2025-08-09 05:03:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 377.491152ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
22.244383ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 05:02:48 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 22.263059ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
405.719527ms
FAIL (2025-08-09 05:02:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 405.736648ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
401.402791ms
FAIL (2025-08-09 05:02:40 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 401.424632ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
454.817162ms
FAIL (2025-08-09 05:02:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 454.842028ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
617.078486ms
FAIL (2025-08-09 05:02:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 617.101378ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
30.360243ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 05:02:18 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 30.380952ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X.............................X.............................] duration:
186.263483ms
FAIL (2025-08-09 05:02:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 186.446275ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
369.911111ms
FAIL (2025-08-09 05:02:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 369.953741ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
210.391133ms
FAIL (2025-08-09 05:01:52 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 210.417573ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
394.821055ms
FAIL (2025-08-09 05:01:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 394.847194ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
499.178913ms
FAIL (2025-08-09 05:01:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 499.202847ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
25.332829ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 05:01:28 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 25.344551ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X.............................X............................] duration:
149.793984ms
FAIL (2025-08-09 05:01:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 149.821396ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
198.793543ms
FAIL (2025-08-09 05:01:09 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 198.808872ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
599.919707ms
FAIL (2025-08-09 05:01:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 599.938393ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
427.412253ms
FAIL (2025-08-09 05:00:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 427.435255ms
edge
gateway
us-select-1
|