Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
171.822736ms
FAIL (2025-08-21 18:14:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 171.847993ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [........X.X....] duration:
255.278056ms remote:
"tcp:34.202.203.47:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:10:05 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/
FAIL (2025-08-21 18:14:02 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 255.295208ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
400.258324ms
FAIL (2025-08-21 18:13:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 400.282359ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [.......X.....X.] duration:
454.064871ms remote:
"tcp:34.202.203.47:443" response headers:
Date=Thu, 21 Aug 2025 18:12:14 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:13:23 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 454.095319ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
3 out of 15 is failed (threshold=6) [X........X.X...] duration:
145.557272ms remote:
"tcp:34.202.203.47:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:10:05 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/
FAIL (2025-08-21 18:13:07 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 145.574293ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
162.815904ms
FAIL (2025-08-21 18:13:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 162.843646ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
1.582412825s
FAIL (2025-08-21 18:12:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.582443323s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
166.274291ms
FAIL (2025-08-21 18:12:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 166.296222ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
1.568114989s
FAIL (2025-08-21 18:12:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.568138072s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
4 out of 15 is failed (threshold=6) [XX........X.X..] duration:
75.582512ms remote:
"tcp:34.202.203.47:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:10:05 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/
FAIL (2025-08-21 18:12:24 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 75.596779ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [........X.....X] duration:
1.021760749s remote:
"tcp:34.202.203.47:443" response headers:
Date=Thu, 21 Aug 2025 18:12:14 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:12:14 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.021775055s
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
637.317246ms
FAIL (2025-08-21 18:12:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 637.336882ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
146.810997ms
FAIL (2025-08-21 18:12:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 146.834831ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [X........X.....] duration:
296.203082ms remote:
"tcp:54.243.86.28:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:09:11 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:11:45 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 296.221225ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
146.048664ms
FAIL (2025-08-21 18:11:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 146.073582ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
407.754136ms
FAIL (2025-08-21 18:11:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 407.774465ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [.X........X....] duration:
458.141418ms remote:
"tcp:54.243.86.28:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:09:11 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:11:30 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 458.165442ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.372890205s
FAIL (2025-08-21 18:11:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.372911966s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
4 out of 15 is failed (threshold=6) [.XX........X.X.] duration:
61.83149ms remote:
"tcp:34.202.203.47:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:10:05 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/
FAIL (2025-08-21 18:11:10 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 61.856847ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [..X........X...] duration:
274.825662ms remote:
"tcp:54.243.86.28:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:09:11 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:11:09 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 274.84086ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
372.364582ms
FAIL (2025-08-21 18:10:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 372.387966ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
539.541558ms
FAIL (2025-08-21 18:10:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 539.5684ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [...X........X..] duration:
110.55322ms remote:
"tcp:54.243.86.28:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:09:11 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:10:22 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 110.579238ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
5 out of 15 is failed (threshold=6) [X.XX........X.X] duration:
1.045458066s remote:
"tcp:34.202.203.47:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:10:05 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/
FAIL (2025-08-21 18:10:05 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.045475568s
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
457.522884ms
FAIL (2025-08-21 18:09:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 457.552009ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
443.47418ms
FAIL (2025-08-21 18:09:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 443.503796ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
5 out of 15 is failed (threshold=6) [XX.XX........X.] duration:
78.120271ms remote:
"tcp:54.243.86.28:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:08:36 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/
FAIL (2025-08-21 18:09:31 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 78.139948ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [....X........X.] duration:
764.843322ms remote:
"tcp:54.243.86.28:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:09:11 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:09:29 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 764.862949ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X.........................X.................................] duration:
154.588929ms
FAIL (2025-08-21 18:09:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 154.61087ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.199942861s
FAIL (2025-08-21 18:09:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.199960504s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [.....X........X] duration:
1.014998686s remote:
"tcp:54.243.86.28:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:09:11 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:09:11 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.015016479s
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [......X........] duration:
435.252117ms remote:
"tcp:18.211.166.153:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:03:34 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:08:38 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 435.328792ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
5 out of 15 is failed (threshold=6) [.XX.XX........X] duration:
1.043641295s remote:
"tcp:54.243.86.28:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:08:36 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/
FAIL (2025-08-21 18:08:36 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.043658868s
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
1.008006093s
FAIL (2025-08-21 18:08:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.008028455s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X.........................X................................] duration:
171.110828ms
FAIL (2025-08-21 18:08:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 171.127789ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
1.641613859s
FAIL (2025-08-21 18:07:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.641633487s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X.........................X...............................] duration:
172.33627ms
FAIL (2025-08-21 18:07:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 172.361598ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
1.945441441s
FAIL (2025-08-21 18:07:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.945465927s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.......X.......] duration:
68.485099ms remote:
"tcp:18.211.166.153:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:03:34 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:07:29 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 68.502963ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
4 out of 15 is failed (threshold=6) [..XX.XX........] duration:
88.067137ms remote:
"tcp:18.211.166.153:443" response headers:
Date=Thu, 21 Aug 2025 18:00:56 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/
FAIL (2025-08-21 18:07:21 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 88.09024ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [........X......] duration:
82.509748ms remote:
"tcp:18.211.166.153:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:03:34 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:07:03 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 82.532672ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.878892637s
FAIL (2025-08-21 18:06:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.878920038s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.........X.....] duration:
313.292848ms remote:
"tcp:18.211.166.153:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:03:34 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:06:44 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 313.314059ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
4 out of 15 is failed (threshold=6) [...XX.XX.......] duration:
87.780161ms remote:
"tcp:18.211.166.153:443" response headers:
Date=Thu, 21 Aug 2025 18:00:56 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/
FAIL (2025-08-21 18:06:36 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 87.799807ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X.........................X..............................] duration:
460.215483ms
FAIL (2025-08-21 18:06:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 460.240189ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [X.........X....] duration:
71.996196ms remote:
"tcp:18.211.166.153:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:03:34 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:06:28 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 72.016263ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X.........................X.............................] duration:
371.667761ms
FAIL (2025-08-21 18:06:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 371.687417ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [.X.........X...] duration:
387.890319ms remote:
"tcp:18.211.166.153:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:03:34 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:06:07 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 387.923833ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X.........................X............................] duration:
174.915224ms
FAIL (2025-08-21 18:06:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 174.933098ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
1.146904571s
FAIL (2025-08-21 18:05:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.1469302s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|