Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 117669 reports (Page 1538 of 2354)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [..................X.........................X...............]
duration:
265.518364ms
FAIL (2025-08-21 17:56:43 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload
Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload
Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments...
Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true
Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments...
Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments...
Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 265.54329ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
2 out of 15 is failed (threshold=6) [....X.........X]
duration:
1.01478605s
remote:
"tcp:18.211.166.153:443"
response headers:
Date=Thu, 21 Aug 2025 17:56:18 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:56:18 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.014808873s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration:
593.307266ms
FAIL (2025-08-21 17:56:06 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 593.327323ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
3 out of 15 is failed (threshold=6) [XX.....X.......]
duration:
560.176099ms
remote:
"tcp:18.211.166.153:443"
response headers:
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:51:05 GMT
Content-Type=text/html
target:
https://www.storj.io/
FAIL (2025-08-21 17:56:02 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 560.194895ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [...................X.........................X..............]
duration:
250.113503ms
FAIL (2025-08-21 17:55:37 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload
Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload
Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments...
Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true
Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments...
Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments...
Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 250.137878ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
1 out of 15 is failed (threshold=6) [.....X.........]
duration:
62.645796ms
remote:
"tcp:18.211.166.153:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:50:35 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:55:36 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 62.665722ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
3 out of 15 is failed (threshold=6) [.XX.....X......]
duration:
168.723998ms
remote:
"tcp:18.211.166.153:443"
response headers:
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:51:05 GMT
Content-Type=text/html
target:
https://www.storj.io/
FAIL (2025-08-21 17:55:28 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 168.741662ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [....................X.........................X.............]
duration:
142.305919ms
FAIL (2025-08-21 17:55:21 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload
Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload
Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments...
Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true
Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments...
Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments...
Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 142.328712ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................]
duration:
1.53424942s
FAIL (2025-08-21 17:54:57 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.534294404s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
1 out of 15 is failed (threshold=6) [......X........]
duration:
86.225732ms
remote:
"tcp:18.211.166.153:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:50:35 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:54:41 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 86.24578ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.....................X.........................X............]
duration:
370.714459ms
FAIL (2025-08-21 17:54:37 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload
Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload
Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments...
Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true
Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments...
Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments...
Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 370.743363ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
4 out of 15 is failed (threshold=6) [X.XX.....X.....]
duration:
73.984005ms
remote:
"tcp:18.211.166.153:443"
response headers:
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:51:05 GMT
Content-Type=text/html
target:
https://www.storj.io/
FAIL (2025-08-21 17:54:30 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 74.001978ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................]
duration:
431.095282ms
FAIL (2025-08-21 17:54:20 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 431.1206ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
2 out of 15 is failed (threshold=6) [X......X.......]
duration:
80.871059ms
remote:
"tcp:18.211.166.153:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:50:35 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:54:19 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 80.890605ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
5 out of 15 is failed (threshold=6) [XX.XX.....X....]
duration:
80.154962ms
remote:
"tcp:18.211.166.153:443"
response headers:
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:51:05 GMT
Content-Type=text/html
target:
https://www.storj.io/
FAIL (2025-08-21 17:54:14 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 80.192794ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [......................X.........................X...........]
duration:
128.247547ms
FAIL (2025-08-21 17:54:10 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload
Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload
Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments...
Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true
Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments...
Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments...
Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 128.267645ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
2 out of 15 is failed (threshold=6) [.X......X......]
duration:
73.414242ms
remote:
"tcp:18.211.166.153:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:50:35 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:53:59 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 73.468794ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
3 out of 15 is failed (threshold=6) [X.X......X.....]
duration:
119.759464ms
remote:
"tcp:18.211.166.153:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:50:35 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:53:31 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 119.77879ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
5 out of 15 is failed (threshold=6) [.XX.XX.....X...]
duration:
167.438674ms
remote:
"tcp:18.211.166.153:443"
response headers:
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:51:05 GMT
Content-Type=text/html
target:
https://www.storj.io/
FAIL (2025-08-21 17:53:15 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 167.453171ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................]
duration:
669.73788ms
FAIL (2025-08-21 17:53:11 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 669.755944ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.......................X.........................X..........]
duration:
562.350046ms
FAIL (2025-08-21 17:53:07 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload
Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload
Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments...
Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true
Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments...
Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments...
Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 562.37271ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
3 out of 15 is failed (threshold=6) [.X.X......X....]
duration:
381.938802ms
remote:
"tcp:18.211.166.153:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:50:35 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:52:52 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 381.952909ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
3 out of 15 is failed (threshold=6) [..X.X......X...]
duration:
75.681765ms
remote:
"tcp:18.211.166.153:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:50:35 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:52:22 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 75.707454ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
5 out of 15 is failed (threshold=6) [..XX.XX.....X..]
duration:
102.386093ms
remote:
"tcp:18.211.166.153:443"
response headers:
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:51:05 GMT
Content-Type=text/html
target:
https://www.storj.io/
FAIL (2025-08-21 17:52:21 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 102.401291ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................]
duration:
1.402501482s
FAIL (2025-08-21 17:52:07 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.402513354s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [........................X.........................X.........]
duration:
136.092102ms
FAIL (2025-08-21 17:52:05 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload
Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload
Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments...
Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true
Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments...
Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments...
Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 136.114733ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
4 out of 15 is failed (threshold=6) [X..X.X......X..]
duration:
424.865198ms
remote:
"tcp:18.211.166.153:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:50:35 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:51:57 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 424.882711ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
6 out of 15 is failed (threshold=6) [X..XX.XX.....X.]
duration:
278.729269ms
remote:
"tcp:18.211.166.153:443"
response headers:
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:51:05 GMT
Content-Type=text/html
target:
https://www.storj.io/
FAIL (2025-08-21 17:51:32 UTC)
unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 278.759287ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................]
duration:
1.134280177s
FAIL (2025-08-21 17:51:12 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.134302659s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
6 out of 15 is failed (threshold=6) [.X..XX.XX.....X]
duration:
1.015388204s
remote:
"tcp:18.211.166.153:443"
response headers:
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:51:05 GMT
Content-Type=text/html
target:
https://www.storj.io/
FAIL (2025-08-21 17:51:05 UTC)
unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.015409153s core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
4 out of 15 is failed (threshold=6) [.X..X.X......X.]
duration:
444.973801ms
remote:
"tcp:18.211.166.153:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:50:35 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:51:02 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 445.030117ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.........................X.........................X........]
duration:
532.716022ms
FAIL (2025-08-21 17:50:51 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload
Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload
Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments...
Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true
Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments...
Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments...
Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 532.737173ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration:
1.144227584s
FAIL (2025-08-21 17:50:36 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.144249224s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
4 out of 15 is failed (threshold=6) [..X..X.X......X]
duration:
1.019037825s
remote:
"tcp:18.211.166.153:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:50:35 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:50:35 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.019054315s core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
5 out of 15 is failed (threshold=6) [..X..XX.XX.....]
duration:
743.05269ms
remote:
"tcp:18.211.166.153:443"
response headers:
Date=Thu, 21 Aug 2025 17:46:20 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target:
https://www.storj.io/
FAIL (2025-08-21 17:50:19 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 743.078698ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [..........................X.........................X.......]
duration:
188.465971ms
FAIL (2025-08-21 17:50:11 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload
Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload
Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments...
Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true
Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments...
Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments...
Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 188.489356ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration:
430.491091ms
FAIL (2025-08-21 17:49:44 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 430.529263ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [...........................X.........................X......]
duration:
472.599741ms
FAIL (2025-08-21 17:49:41 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload
Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload
Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments...
Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true
Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments...
Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments...
Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 472.622123ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
5 out of 15 is failed (threshold=6) [...X..XX.XX....]
duration:
162.159211ms
remote:
"tcp:18.211.166.153:443"
response headers:
Date=Thu, 21 Aug 2025 17:46:20 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target:
https://www.storj.io/
FAIL (2025-08-21 17:49:38 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 162.177957ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
3 out of 15 is failed (threshold=6) [...X..X.X......]
duration:
77.380467ms
remote:
"tcp:54.243.86.28:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:46:23 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:49:37 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 77.399122ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
4 out of 15 is failed (threshold=6) [X...X..X.X.....]
duration:
1.213762823s
remote:
"tcp:54.243.86.28:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:46:23 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:49:19 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.213794021s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [............................X.........................X.....]
duration:
433.057335ms
FAIL (2025-08-21 17:49:01 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload
Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload
Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments...
Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true
Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments...
Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments...
Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 433.075308ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
6 out of 15 is failed (threshold=6) [X...X..XX.XX...]
duration:
80.203492ms
remote:
"tcp:18.211.166.153:443"
response headers:
Date=Thu, 21 Aug 2025 17:46:20 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target:
https://www.storj.io/
FAIL (2025-08-21 17:48:56 UTC)
unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 80.224763ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................]
duration:
2.360211956s
FAIL (2025-08-21 17:48:45 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.360229028s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.............................X.........................X....]
duration:
146.004089ms
FAIL (2025-08-21 17:48:41 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload
Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload
Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments...
Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true
Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments...
Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments...
Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 146.046408ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................]
duration:
1.921384256s
FAIL (2025-08-21 17:48:23 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:33:59.350385001 (312h7m40.081652621s) [upload=324499]: Starting upload
Aug 21 17:33:59.350415309 (312h7m40.08168294s) [upload=324499]: Done starting upload
Aug 21 17:33:59.350640743 (312h7m40.081908373s) [upload=324499]: Uploading segments...
Aug 21 17:33:59.351323566 (312h7m40.082591187s) [upload=324499]: Got next segment. Inline: false
Aug 21 17:33:59.351374332 (312h7m40.082641952s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:33:59.351378549 (312h7m40.08264617s) [upload=324499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 17:33:59.354517922 (312h7m40.085785582s) [upload=324499]: Next segment err: metaclient: Too Many Requests
Aug 21 17:33:59.354532639 (312h7m40.085800269s) [upload=324499]: Done uploading segments...
Aug 21 17:33:59.354542808 (312h7m40.085810438s) [upload=324499]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.921405336s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
4 out of 15 is failed (threshold=6) [.X...X..X.X....]
duration:
470.905377ms
remote:
"tcp:54.243.86.28:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:46:23 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:48:22 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 470.921606ms core website
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
4 out of 15 is failed (threshold=6) [..X...X..X.X...]
duration:
135.470624ms
remote:
"tcp:54.243.86.28:443"
response headers:
X-Cluster-Name=us-east-1-prod-hosting-red
Date=Thu, 21 Aug 2025 17:46:23 GMT
Content-Type=text/html
Content-Length=164
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-21 17:48:06 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 135.49521ms core website
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
6 out of 15 is failed (threshold=6) [.X...X..XX.XX..]
duration:
96.629806ms
remote:
"tcp:18.211.166.153:443"
response headers:
Date=Thu, 21 Aug 2025 17:46:20 GMT
Content-Type=text/html
Content-Length=164
X-Cluster-Name=us-east-1-prod-hosting-red
target:
https://www.storj.io/
FAIL (2025-08-21 17:48:04 UTC)
unexpected status code "504 Gateway Time-out"
"<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 96.647058ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [..............................X.........................X...]
duration:
168.269375ms
FAIL (2025-08-21 17:47:55 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 21 17:45:26.360745871 (312h19m7.092013491s) [upload=324704]: Starting upload
Aug 21 17:45:26.360824949 (312h19m7.092092579s) [upload=324704]: Done starting upload
Aug 21 17:45:26.360871646 (312h19m7.092139277s) [upload=324704]: Uploading segments...
Aug 21 17:45:26.360901273 (312h19m7.092168892s) [upload=324704]: Got next segment. Inline: true
Aug 21 17:45:26.360904679 (312h19m7.092172309s) [upload=324704]: Waiting for error group managing segments...
Aug 21 17:45:26.360957487 (312h19m7.092225118s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 17:45:26.360961525 (312h19m7.092229155s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 17:45:26.360963790 (312h19m7.092231409s) [upload=324704]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 17:45:26.363758492 (312h19m7.095026112s) [upload=324704]: Done uploading segments...
Aug 21 17:45:26.363766668 (312h19m7.095034299s) [upload=324704]: Upload finished. err: metaclient: Too Many Requests
Duration: 168.302346ms core uplink us-select-1 us1-placement-20 metainfo-projects