Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
4 out of 15 is failed (threshold=6) [....XX.XX......] duration:
73.136324ms remote:
"tcp:18.211.166.153:443" response headers:
Date=Thu, 21 Aug 2025 18:00:56 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/
FAIL (2025-08-21 18:05:35 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 73.160349ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X.........................X...........................] duration:
406.065523ms
FAIL (2025-08-21 18:05:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 406.091713ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [..X.........X..] duration:
258.072508ms remote:
"tcp:18.211.166.153:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:03:34 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:05:04 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 258.098868ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.408685535s
FAIL (2025-08-21 18:04:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.408705881s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
4 out of 15 is failed (threshold=6) [.....XX.XX.....] duration:
76.615304ms remote:
"tcp:18.211.166.153:443" response headers:
Date=Thu, 21 Aug 2025 18:00:56 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/
FAIL (2025-08-21 18:04:56 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 76.636733ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X.........................X..........................] duration:
187.542777ms
FAIL (2025-08-21 18:04:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 187.568155ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
4 out of 15 is failed (threshold=6) [......XX.XX....] duration:
174.318624ms remote:
"tcp:18.211.166.153:443" response headers:
Date=Thu, 21 Aug 2025 18:00:56 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/
FAIL (2025-08-21 18:04:13 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 174.336447ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
1.349936265s
FAIL (2025-08-21 18:04:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.349954629s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [...X.........X.] duration:
393.796937ms remote:
"tcp:18.211.166.153:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:03:34 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:03:54 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 393.829618ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X.........................X.........................] duration:
147.584909ms
FAIL (2025-08-21 18:03:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 147.604666ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
1.297596184s
FAIL (2025-08-21 18:03:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.297622013s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [....X.........X] duration:
1.233784227s remote:
"tcp:18.211.166.153:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:03:34 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:03:34 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.233801649s
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X.........................X........................] duration:
174.946463ms
FAIL (2025-08-21 18:03:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 175.06168ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
4 out of 15 is failed (threshold=6) [.......XX.XX...] duration:
118.975012ms remote:
"tcp:18.211.166.153:443" response headers:
Date=Thu, 21 Aug 2025 18:00:56 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/
FAIL (2025-08-21 18:03:19 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 119.001361ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
1.74337011s
FAIL (2025-08-21 18:03:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.743389998s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.....X.........] duration:
405.879665ms remote:
"tcp:18.211.166.153:443" response headers:
Date=Thu, 21 Aug 2025 17:56:18 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:03:03 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 405.892619ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
4 out of 15 is failed (threshold=6) [........XX.XX..] duration:
291.742268ms remote:
"tcp:18.211.166.153:443" response headers:
Date=Thu, 21 Aug 2025 18:00:56 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/
FAIL (2025-08-21 18:02:40 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 291.762296ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
1.382914111s
FAIL (2025-08-21 18:02:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.382948175s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
737.176735ms
FAIL (2025-08-21 18:02:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 737.19529ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X.........................X.......................] duration:
242.835341ms
FAIL (2025-08-21 18:02:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 242.851683ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [......X........] duration:
356.372899ms remote:
"tcp:18.211.166.153:443" response headers:
Date=Thu, 21 Aug 2025 17:56:18 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:02:06 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 356.39969ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
5 out of 15 is failed (threshold=6) [X........XX.XX.] duration:
86.961509ms remote:
"tcp:18.211.166.153:443" response headers:
Date=Thu, 21 Aug 2025 18:00:56 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/
FAIL (2025-08-21 18:02:02 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 86.981538ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.732596871s
FAIL (2025-08-21 18:02:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.732619143s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X.........................X......................] duration:
220.763698ms
FAIL (2025-08-21 18:01:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 220.79222ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.......X.......] duration:
59.54864ms remote:
"tcp:18.211.166.153:443" response headers:
Date=Thu, 21 Aug 2025 17:56:18 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:01:18 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 59.568297ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X.........................X.....................] duration:
263.357877ms
FAIL (2025-08-21 18:01:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 263.38072ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
5 out of 15 is failed (threshold=6) [.X........XX.XX] duration:
1.020692202s remote:
"tcp:18.211.166.153:443" response headers:
Date=Thu, 21 Aug 2025 18:00:56 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/
FAIL (2025-08-21 18:00:56 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.020713512s
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
362.672674ms
FAIL (2025-08-21 18:00:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 362.694203ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [........X......] duration:
422.927472ms remote:
"tcp:18.211.166.153:443" response headers:
Date=Thu, 21 Aug 2025 17:56:18 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:00:51 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 422.939715ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
4 out of 15 is failed (threshold=6) [..X........XX.X] duration:
1.035077737s remote:
"tcp:18.211.166.153:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 18:00:33 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/
FAIL (2025-08-21 18:00:33 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.035173796s
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
1.370885261s
FAIL (2025-08-21 18:00:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.370926668s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X.........................X....................] duration:
304.974055ms
FAIL (2025-08-21 18:00:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 305.0083ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
1.625983614s
FAIL (2025-08-21 18:00:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.626007798s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
1 out of 15 is failed (threshold=6) [.........X.....] duration:
611.711618ms remote:
"tcp:18.211.166.153:443" response headers:
Date=Thu, 21 Aug 2025 17:56:18 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 18:00:02 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 611.731755ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X.........................X...................] duration:
288.531673ms
FAIL (2025-08-21 17:59:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 288.579083ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
566.692124ms
FAIL (2025-08-21 17:59:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 566.719717ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
3 out of 15 is failed (threshold=6) [...X........XX.] duration:
270.084124ms remote:
"tcp:54.243.86.28:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 17:59:11 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/
FAIL (2025-08-21 17:59:27 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 270.108259ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
3 out of 15 is failed (threshold=6) [....X........XX] duration:
1.024885532s remote:
"tcp:54.243.86.28:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 17:59:11 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/
FAIL (2025-08-21 17:59:11 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.024930777s
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [X.........X....] duration:
384.172784ms remote:
"tcp:18.211.166.153:443" response headers:
Date=Thu, 21 Aug 2025 17:56:18 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:59:11 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 384.195426ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
441.198434ms
FAIL (2025-08-21 17:58:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 441.221118ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X.........................X..................] duration:
183.690477ms
FAIL (2025-08-21 17:58:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 183.714322ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [.X.........X...] duration:
102.43218ms remote:
"tcp:18.211.166.153:443" response headers:
Date=Thu, 21 Aug 2025 17:56:18 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:58:22 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 102.452668ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
1.439186388s
FAIL (2025-08-21 17:58:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.439201856s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X.........................X.................] duration:
127.838599ms
FAIL (2025-08-21 17:58:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 127.885979ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [.....X........X] duration:
1.018676642s remote:
"tcp:18.211.166.153:443" response headers:
Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 17:57:56 GMT target:
https://www.storj.io/
FAIL (2025-08-21 17:57:56 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.01876061s
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [..X.........X..] duration:
799.766213ms remote:
"tcp:18.211.166.153:443" response headers:
Date=Thu, 21 Aug 2025 17:56:18 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:57:29 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 799.788877ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
2 out of 15 is failed (threshold=6) [...X.........X.] duration:
450.764294ms remote:
"tcp:18.211.166.153:443" response headers:
Date=Thu, 21 Aug 2025 17:56:18 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:57:13 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 450.788519ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X.........................X................] duration:
579.582474ms
FAIL (2025-08-21 17:57:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments... Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments... Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments... Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 579.621497ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
396.258095ms
FAIL (2025-08-21 17:57:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments... Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments... Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 396.287972ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [X.....X........] duration:
107.622956ms remote:
"tcp:18.211.166.153:443" response headers:
Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 17:51:05 GMT Content-Type=text/html target:
https://www.storj.io/
FAIL (2025-08-21 17:56:51 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 107.640839ms
core
website
|